Result | FAILURE |
Tests | 37 failed / 686 succeeded |
Started | |
Elapsed | 48m56s |
Revision | |
Builder | gke-prow-ssd-pool-1a225945-9tvq |
links | {u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/3d463978-5953-4e31-93f2-28c82db7cd77/targets/test'}} |
pod | 4000c2de-eb3d-11e9-8c10-a2868fa7b718 |
resultstore | https://source.cloud.google.com/results/invocations/3d463978-5953-4e31-93f2-28c82db7cd77/targets/test |
infra-commit | a1b81b6af |
job-version | v1.17.0-alpha.1.268+2d8b8703de920b |
pod | 4000c2de-eb3d-11e9-8c10-a2868fa7b718 |
revision | v1.17.0-alpha.1.268+2d8b8703de920b |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sPreStop\sgraceful\spod\sterminated\sshould\swait\suntil\spreStop\shook\scompletes\sthe\sprocess$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:185 Oct 10 09:34:26.738: validate-pod-is-running Unexpected error: <*errors.errorString | 0xc0000a10a0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:227from junit_05.xml
[BeforeEach] [k8s.io] [sig-node] PreStop /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:150 �[1mSTEP�[0m: Creating a kubernetes client Oct 10 09:32:53.158: INFO: >>> kubeConfig: /tmp/kops104699295/kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename prestop �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] [sig-node] PreStop /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:172 [It] graceful pod terminated should wait until preStop hook completes the process /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:185 �[1mSTEP�[0m: creating the pod �[1mSTEP�[0m: submitting the pod to kubernetes �[1mSTEP�[0m: waiting for pod running �[1mSTEP�[0m: deleting the pod gracefully �[1mSTEP�[0m: verifying the pod running state after graceful termination Oct 10 09:34:26.738: FAIL: validate-pod-is-running Unexpected error: <*errors.errorString | 0xc0000a10a0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred [AfterEach] [k8s.io] [sig-node] PreStop /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Collecting events from namespace "prestop-2964". �[1mSTEP�[0m: Found 6 events. Oct 10 09:34:26.882: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-prestop-hook-fe8f1708-1303-4f99-97e5-780e64206501: {default-scheduler } Scheduled: Successfully assigned prestop-2964/pod-prestop-hook-fe8f1708-1303-4f99-97e5-780e64206501 to ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:34:26.882: INFO: At 2019-10-10 09:32:54 +0000 UTC - event for pod-prestop-hook-fe8f1708-1303-4f99-97e5-780e64206501: {kubelet ip-172-20-56-86.sa-east-1.compute.internal} Pulled: Container image "docker.io/library/nginx:1.14-alpine" already present on machine Oct 10 09:34:26.882: INFO: At 2019-10-10 09:32:54 +0000 UTC - event for pod-prestop-hook-fe8f1708-1303-4f99-97e5-780e64206501: {kubelet ip-172-20-56-86.sa-east-1.compute.internal} Created: Created container nginx Oct 10 09:34:26.882: INFO: At 2019-10-10 09:32:54 +0000 UTC - event for pod-prestop-hook-fe8f1708-1303-4f99-97e5-780e64206501: {kubelet ip-172-20-56-86.sa-east-1.compute.internal} Started: Started container nginx Oct 10 09:34:26.882: INFO: At 2019-10-10 09:32:57 +0000 UTC - event for pod-prestop-hook-fe8f1708-1303-4f99-97e5-780e64206501: {kubelet ip-172-20-56-86.sa-east-1.compute.internal} Killing: Stopping container nginx Oct 10 09:34:26.883: INFO: At 2019-10-10 09:33:27 +0000 UTC - event for pod-prestop-hook-fe8f1708-1303-4f99-97e5-780e64206501: {kubelet ip-172-20-56-86.sa-east-1.compute.internal} FailedPreStopHook: Exec lifecycle hook ([sh -c while true; do echo preStop; sleep 1; done]) for Container "nginx" in Pod "pod-prestop-hook-fe8f1708-1303-4f99-97e5-780e64206501_prestop-2964(a81d41f8-1115-4301-b25f-0d1b5dfed5e6)" failed - error: command 'sh -c while true; do echo preStop; sleep 1; done' exited with 137: , message: "preStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\n" Oct 10 09:34:27.026: INFO: POD NODE PHASE GRACE CONDITIONS Oct 10 09:34:27.026: INFO: Oct 10 09:34:27.170: INFO: Logging node info for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:34:27.312: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-37-177.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-37-177.sa-east-1.compute.internal 8ecedabe-969e-476a-8f76-1fb03eedaa56 33981 0 2019-10-10 09:12:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c4.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:master-sa-east-1c kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-37-177.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master:] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-08fb35da4b2014f59,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3949572096 0} {<nil>} 3857004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3844714496 0} {<nil>} 3754604Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:12:53 +0000 UTC,LastTransitionTime:2019-10-10 09:12:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:34:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:34:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:34:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:34:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.177,},NodeAddress{Type:ExternalIP,Address:54.233.97.36,},NodeAddress{Type:Hostname,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-97-36.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:75a86a2fc8e747568f8cd25355ed4a43,SystemUUID:EC277240-730F-D89C-36D2-B12A43ABB39F,BootID:33b7c61a-9c83-42db-9541-8a26846b977a,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[kopeio/etcd-manager@sha256:cb0ed7c56dadbc0f4cd515906d72b30094229d6e0a9fcb7aa44e23680bf9a3a8 kopeio/etcd-manager:3.0.20190930],SizeBytes:656348817,},ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:260130533,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:205085998,},ContainerImage{Names:[kope/dns-controller@sha256:aca3878acdac85716e1317dd2fc85b235551068d667e578fceb9b0e8c3561324 kope/dns-controller:1.15.0-alpha.1],SizeBytes:120867125,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:103791294,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:34:27.313: INFO: Logging kubelet events for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:34:27.457: INFO: Logging pods the kubelet thinks is on node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:34:27.604: INFO: kube-proxy-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:27.604: INFO: Container kube-proxy ready: true, restart count 3 Oct 10 09:34:27.604: INFO: kube-scheduler-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:27.604: INFO: Container kube-scheduler ready: true, restart count 0 Oct 10 09:34:27.604: INFO: etcd-manager-events-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:27.604: INFO: Container etcd-manager ready: true, restart count 0 Oct 10 09:34:27.604: INFO: kops-controller-76f5d459f8-86j85 started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:27.604: INFO: Container kops-controller ready: true, restart count 0 Oct 10 09:34:27.604: INFO: dns-controller-78ccbffc6d-5pnmw started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:27.604: INFO: Container dns-controller ready: true, restart count 0 Oct 10 09:34:27.604: INFO: etcd-manager-main-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:27.604: INFO: Container etcd-manager ready: true, restart count 0 Oct 10 09:34:27.604: INFO: kube-apiserver-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:27.604: INFO: Container kube-apiserver ready: true, restart count 3 Oct 10 09:34:27.604: INFO: kube-controller-manager-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:27.604: INFO: Container kube-controller-manager ready: true, restart count 0 W1010 09:34:27.748709 915 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:34:28.051: INFO: Latency metrics for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:34:28.051: INFO: Logging node info for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:34:28.194: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-42-37.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-42-37.sa-east-1.compute.internal 8fb9f863-77f2-4451-ba99-614781c1c8bc 34158 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-42-37.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node mounted_volume_expand:mounted-volume-expand-8034 node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-1205":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-4356":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-volume-expand-3381":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-volume-expand-4923":"ip-172-20-42-37.sa-east-1.compute.internal"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-020fda63f6b69c0ea,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:34:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:34:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:34:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:34:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.37,},NodeAddress{Type:ExternalIP,Address:54.233.88.138,},NodeAddress{Type:Hostname,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-88-138.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dbea17b1df4f4682b3aea8f7967a81f7,SystemUUID:EC276068-34A4-965C-3CB7-CA4BD3478D25,BootID:883b28de-249e-43a6-8e1c-705f97846842,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa k8s.gcr.io/etcd:3.3.15],SizeBytes:246640776,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:1bafcc6fb1aa990b487850adba9cadc020e42d7905aa8a30481182a477ba24b0 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.10],SizeBytes:61365829,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:fe301db49df08c384001ed752dff6d52b4305a73a7f608f21528048e8a08b51e busybox:latest],SizeBytes:1219782,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0982651b46866db00],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:34:28.194: INFO: Logging kubelet events for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:34:28.338: INFO: Logging pods the kubelet thinks is on node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:34:28.484: INFO: exec-volume-test-aws-gd9n started at 2019-10-10 09:29:35 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:28.484: INFO: Container exec-container-aws-gd9n ready: false, restart count 0 Oct 10 09:34:28.484: INFO: webserver-549d587c76-6mfs9 started at 2019-10-10 09:34:28 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:28.484: INFO: Container httpd ready: false, restart count 0 Oct 10 09:34:28.484: INFO: affinity-nodeport-transition-hd92w started at 2019-10-10 09:33:33 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:28.484: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Oct 10 09:34:28.484: INFO: execpod-affinityjxvsq started at 2019-10-10 09:33:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:28.484: INFO: Container agnhost-pause ready: true, restart count 0 Oct 10 09:34:28.484: INFO: pfpod started at 2019-10-10 09:34:26 +0000 UTC (0+2 container statuses recorded) Oct 10 09:34:28.484: INFO: Container portforwardtester ready: false, restart count 0 Oct 10 09:34:28.484: INFO: Container readiness ready: false, restart count 0 Oct 10 09:34:28.484: INFO: externalsvc-hm56b started at 2019-10-10 09:34:22 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:28.484: INFO: Container externalsvc ready: true, restart count 0 Oct 10 09:34:28.484: INFO: image-pull-test4f3280d4-0792-4e81-8f3e-4e7886bd314a started at 2019-10-10 09:34:25 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:28.484: INFO: Container image-pull-test ready: false, restart count 0 Oct 10 09:34:28.484: INFO: explicit-nonroot-uid started at 2019-10-10 09:34:19 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:28.484: INFO: Container explicit-nonroot-uid ready: false, restart count 0 Oct 10 09:34:28.484: INFO: webserver-5cdb6cbc8f-wkw5q started at 2019-10-10 09:34:25 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:28.484: INFO: Container httpd ready: true, restart count 0 Oct 10 09:34:28.484: INFO: kube-proxy-ip-172-20-42-37.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:28.484: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:34:28.484: INFO: redis-master-m5vrx started at 2019-10-10 09:34:14 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:28.484: INFO: Container redis-master ready: true, restart count 0 Oct 10 09:34:28.484: INFO: configmap-client started at 2019-10-10 09:34:10 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:28.484: INFO: Container configmap-client ready: true, restart count 0 Oct 10 09:34:28.484: INFO: webserver-549d587c76-nbsmq started at 2019-10-10 09:34:28 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:28.484: INFO: Container httpd ready: false, restart count 0 W1010 09:34:28.628444 915 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:34:29.146: INFO: Latency metrics for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:34:29.147: INFO: Logging node info for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:34:29.290: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-49-15.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-49-15.sa-east-1.compute.internal 105a0721-5b17-40b8-b686-ccf439f1ca2a 34155 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-49-15.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6677":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-ephemeral-8821":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-1913":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-6893":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-8860":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-9656":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-5356":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-5574":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-6407":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-volume-expand-3873":"ip-172-20-49-15.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-3724":"csi-mock-csi-mock-volumes-3724","csi-mock-csi-mock-volumes-4205":"csi-mock-csi-mock-volumes-4205","csi-mock-csi-mock-volumes-4873":"csi-mock-csi-mock-volumes-4873","csi-mock-csi-mock-volumes-7612":"csi-mock-csi-mock-volumes-7612","csi-mock-csi-mock-volumes-8888":"csi-mock-csi-mock-volumes-8888"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-056d95303ed61d881,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:34:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:34:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:34:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:34:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.49.15,},NodeAddress{Type:ExternalIP,Address:18.228.205.178,},NodeAddress{Type:Hostname,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-228-205-178.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f468c62663d2465ca17ba5284774252e,SystemUUID:EC23BE58-6EBA-E800-9C73-DEB3BAA2D1B9,BootID:6eb82ab7-2bd7-418a-ba22-36d3a808a22b,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/google-containers/debian-base@sha256:6966a0aedd7592c18ff2dd803c08bd85780ee19f5e3a2e7cf908a4cd837afcde gcr.io/google-containers/debian-base:0.4.1],SizeBytes:42323657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[alpine@sha256:8421d9a84432575381bfabd248f1eb56f3aa21d9d7cd2511583c68c9b7511d10 alpine:3.7],SizeBytes:4206494,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-085f849e64e02110d kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0b0fa084d8405fe9e kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0caeace51988095bb],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:34:29.290: INFO: Logging kubelet events for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:34:29.434: INFO: Logging pods the kubelet thinks is on node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:34:29.580: INFO: pod2 started at 2019-10-10 09:34:27 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:29.581: INFO: Container pause ready: false, restart count 0 Oct 10 09:34:29.581: INFO: affinity-nodeport-transition-8tpj5 started at 2019-10-10 09:33:33 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:29.581: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Oct 10 09:34:29.581: INFO: aws-injector started at 2019-10-10 09:30:35 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:29.581: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:34:29.581: INFO: aws-injector started at 2019-10-10 09:32:03 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:29.581: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:34:29.581: INFO: webserver-5cdb6cbc8f-k82sm started at 2019-10-10 09:34:28 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:29.581: INFO: Container httpd ready: false, restart count 0 Oct 10 09:34:29.581: INFO: liveness-4311afc1-047e-4c80-bcf2-fc64d3506dc4 started at 2019-10-10 09:31:52 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:29.581: INFO: Container liveness ready: true, restart count 0 Oct 10 09:34:29.581: INFO: webserver-549d587c76-jn6rw started at 2019-10-10 09:34:26 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:29.581: INFO: Container httpd ready: true, restart count 0 Oct 10 09:34:29.581: INFO: pod-init-9096e62f-0c16-4a2e-8603-a8a4883aa7d7 started at 2019-10-10 09:33:37 +0000 UTC (2+1 container statuses recorded) Oct 10 09:34:29.581: INFO: Init container init1 ready: false, restart count 3 Oct 10 09:34:29.581: INFO: Init container init2 ready: false, restart count 0 Oct 10 09:34:29.581: INFO: Container run1 ready: false, restart count 0 Oct 10 09:34:29.581: INFO: aws-injector started at 2019-10-10 09:33:45 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:29.581: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:34:29.581: INFO: kube-proxy-ip-172-20-49-15.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:29.581: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:34:29.581: INFO: pod-with-prestop-http-hook started at 2019-10-10 09:34:27 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:29.581: INFO: Container pod-with-prestop-http-hook ready: true, restart count 0 Oct 10 09:34:29.581: INFO: execpodhxj6d started at 2019-10-10 09:34:28 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:29.581: INFO: Container agnhost-pause ready: false, restart count 0 Oct 10 09:34:29.581: INFO: webserver-5cdb6cbc8f-mqrz2 started at 2019-10-10 09:34:27 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:29.581: INFO: Container httpd ready: false, restart count 0 Oct 10 09:34:29.581: INFO: netserver-1 started at 2019-10-10 09:34:28 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:29.581: INFO: Container webserver ready: false, restart count 0 W1010 09:34:29.734351 915 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:34:30.063: INFO: Latency metrics for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:34:30.063: INFO: Logging node info for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:34:30.206: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-56-86.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-56-86.sa-east-1.compute.internal cccbef08-fa00-42b5-ae85-da8efe4ee848 34587 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-56-86.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9823":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-provisioning-5677":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-1005":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-1516":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-6492":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volume-6196":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volumemode-1556":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-1749":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-expand-9939":"ip-172-20-56-86.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-5777":"csi-mock-csi-mock-volumes-5777","csi-mock-csi-mock-volumes-6825":"csi-mock-csi-mock-volumes-6825","csi-mock-csi-mock-volumes-7201":"csi-mock-csi-mock-volumes-7201","csi-mock-csi-mock-volumes-8231":"csi-mock-csi-mock-volumes-8231"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-0b5800b629bcb7519,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:34:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:34:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:34:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:34:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.86,},NodeAddress{Type:ExternalIP,Address:54.207.48.88,},NodeAddress{Type:Hostname,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-207-48-88.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:99be0b3f4ec34abb8f4f249d272797b5,SystemUUID:EC2EB353-C506-B251-A10A-9B28B752A967,BootID:e098fcb6-fca7-433b-9b9f-7e47386c5ca0,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 gluster/glusterdynamic-provisioner:v1.0],SizeBytes:373281573,},ContainerImage{Names:[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6],SizeBytes:373099368,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:bbc3a03235220b170ba48a157dd097dd1379299370e1ed99ce976df0355d24f0 busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-028b66335e31eaf4f kubernetes.io/aws-ebs/aws://sa-east-1c/vol-05da71c2f70c6d1e3 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0765fb05bdb37f4b5 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0f597dc8d7319d060],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:34:30.207: INFO: Logging kubelet events for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:34:30.351: INFO: Logging pods the kubelet thinks is on node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:34:30.498: INFO: exec-volume-test-aws-4jlf started at 2019-10-10 09:31:15 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:30.498: INFO: Container exec-container-aws-4jlf ready: false, restart count 0 Oct 10 09:34:30.498: INFO: webserver-5cdb6cbc8f-47hdq started at 2019-10-10 09:34:27 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:30.498: INFO: Container httpd ready: true, restart count 0 Oct 10 09:34:30.498: INFO: aws-injector started at 2019-10-10 09:31:17 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:30.498: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:34:30.498: INFO: webserver-549d587c76-kg8hz started at 2019-10-10 09:34:28 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:30.498: INFO: Container httpd ready: true, restart count 0 Oct 10 09:34:30.498: INFO: kube-proxy-ip-172-20-56-86.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:30.498: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:34:30.498: INFO: pod1 started at 2019-10-10 09:34:23 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:30.498: INFO: Container pause ready: true, restart count 0 Oct 10 09:34:30.498: INFO: exec-volume-test-aws-preprovisionedpv-j99q started at 2019-10-10 09:32:17 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:30.498: INFO: Container exec-container-aws-preprovisionedpv-j99q ready: false, restart count 0 Oct 10 09:34:30.498: INFO: netserver-2 started at 2019-10-10 09:34:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:30.498: INFO: Container webserver ready: false, restart count 0 Oct 10 09:34:30.498: INFO: webserver-5cdb6cbc8f-znlmz started at 2019-10-10 09:34:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:30.498: INFO: Container httpd ready: false, restart count 0 Oct 10 09:34:30.498: INFO: pod-handle-http-request started at 2019-10-10 09:34:22 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:30.498: INFO: Container pod-handle-http-request ready: true, restart count 0 Oct 10 09:34:30.498: INFO: aws-injector started at 2019-10-10 09:28:01 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:30.498: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:34:30.498: INFO: pod-45e1237d-53b9-4a5e-886a-faa8171da9fe started at 2019-10-10 09:34:23 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:30.498: INFO: Container test-container ready: false, restart count 0 W1010 09:34:30.642675 915 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:34:30.964: INFO: Latency metrics for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:34:30.964: INFO: Logging node info for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:34:31.107: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-60-88.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-60-88.sa-east-1.compute.internal f5a2e6d3-a123-4acc-a9b2-8fa0a5c1c28f 33571 0 2019-10-10 09:14:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-60-88.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4801":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-provisioning-2176":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-provisioning-8958":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-9423":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volume-expand-4947":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volume-expand-6712":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volumemode-1292":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volumemode-4728":"ip-172-20-60-88.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-3023":"csi-mock-csi-mock-volumes-3023","csi-mock-csi-mock-volumes-3750":"csi-mock-csi-mock-volumes-3750","csi-mock-csi-mock-volumes-3882":"csi-mock-csi-mock-volumes-3882","csi-mock-csi-mock-volumes-5042":"csi-mock-csi-mock-volumes-5042","csi-mock-csi-mock-volumes-6797":"csi-mock-csi-mock-volumes-6797"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-087c9d5356d3aafe3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146278400 0} {<nil>} 4049100Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041420800 0} {<nil>} 3946700Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:13 +0000 UTC,LastTransitionTime:2019-10-10 09:14:13 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:33:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:33:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:33:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:33:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.88,},NodeAddress{Type:ExternalIP,Address:18.231.36.128,},NodeAddress{Type:Hostname,Address:ip-172-20-60-88.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-60-88.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-231-36-128.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4f6cfed0b3cc440c814a893a63590a26,SystemUUID:EC2CF3F1-2D60-B6EE-FE1D-D82FEFE80523,BootID:fcb35a82-1eda-4e12-88ea-2fc1cfa0c447,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6],SizeBytes:373099368,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:618a82fa66cf0c75e4753369a6999032372be7308866fc9afb381789b1e5ad52 k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13],SizeBytes:51157394,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:12370202895b621a2ac28226292e4578598f13c1502aa4d3ee90fff4325d9275 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.4.0],SizeBytes:45853555,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-sidecar-amd64@sha256:cedc8fe2098dffc26d17f64061296b7aa54258a31513b6c52df271a98bb522b3 k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.13],SizeBytes:42852039,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64@sha256:45df3e8e0c551bd0c79cdba48ae6677f817971dcbd1eeed7fd1f9a35118410e4 k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13],SizeBytes:41372492,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0559eda2818e41891 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0fac33f38a006d601],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:34:31.107: INFO: Logging kubelet events for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:34:31.252: INFO: Logging pods the kubelet thinks is on node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:34:31.399: INFO: webserver-5cdb6cbc8f-5wchh started at 2019-10-10 09:34:28 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:31.399: INFO: Container httpd ready: true, restart count 0 Oct 10 09:34:31.399: INFO: pod-projected-configmaps-b96a2f31-9ea1-4ab5-aab3-96392e782102 started at 2019-10-10 09:34:28 +0000 UTC (0+3 container statuses recorded) Oct 10 09:34:31.399: INFO: Container createcm-volume-test ready: true, restart count 0 Oct 10 09:34:31.399: INFO: Container delcm-volume-test ready: true, restart count 0 Oct 10 09:34:31.399: INFO: Container updcm-volume-test ready: true, restart count 0 Oct 10 09:34:31.399: INFO: aws-injector started at 2019-10-10 09:31:02 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:31.399: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:34:31.399: INFO: webserver-549d587c76-cmcx9 started at 2019-10-10 09:34:21 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:31.399: INFO: Container httpd ready: true, restart count 0 Oct 10 09:34:31.399: INFO: externalsvc-gprxh started at 2019-10-10 09:34:22 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:31.399: INFO: Container externalsvc ready: true, restart count 0 Oct 10 09:34:31.399: INFO: kube-dns-bb55d6458-g4ktr started at 2019-10-10 09:14:21 +0000 UTC (0+3 container statuses recorded) Oct 10 09:34:31.399: INFO: Container dnsmasq ready: true, restart count 0 Oct 10 09:34:31.399: INFO: Container kubedns ready: true, restart count 0 Oct 10 09:34:31.399: INFO: Container sidecar ready: true, restart count 0 Oct 10 09:34:31.399: INFO: kube-dns-bb55d6458-cx9kh started at 2019-10-10 09:14:29 +0000 UTC (0+3 container statuses recorded) Oct 10 09:34:31.399: INFO: Container dnsmasq ready: true, restart count 0 Oct 10 09:34:31.399: INFO: Container kubedns ready: true, restart count 0 Oct 10 09:34:31.399: INFO: Container sidecar ready: true, restart count 0 Oct 10 09:34:31.399: INFO: netserver-3 started at 2019-10-10 09:34:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:31.399: INFO: Container webserver ready: false, restart count 0 Oct 10 09:34:31.399: INFO: affinity-nodeport-transition-pkt6h started at 2019-10-10 09:33:33 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:31.399: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Oct 10 09:34:31.399: INFO: aws-injector started at 2019-10-10 09:32:35 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:31.399: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:34:31.399: INFO: kube-proxy-ip-172-20-60-88.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:31.399: INFO: Container kube-proxy ready: true, restart count 1 Oct 10 09:34:31.399: INFO: kube-dns-autoscaler-66b775459-74nsm started at 2019-10-10 09:14:21 +0000 UTC (0+1 container statuses recorded) Oct 10 09:34:31.399: INFO: Container autoscaler ready: true, restart count 0 W1010 09:34:31.543205 915 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:34:31.866: INFO: Latency metrics for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:34:31.867: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "prestop-2964" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sPreStop\sgraceful\spod\sterminated\sshould\swait\suntil\spreStop\shook\scompletes\sthe\sprocess$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:185 Oct 10 09:36:09.782: validate-pod-is-running Unexpected error: <*errors.errorString | 0xc0000a10a0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:227from junit_05.xml
[BeforeEach] [k8s.io] [sig-node] PreStop /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:150 �[1mSTEP�[0m: Creating a kubernetes client Oct 10 09:34:32.162: INFO: >>> kubeConfig: /tmp/kops104699295/kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename prestop �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [k8s.io] [sig-node] PreStop /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:172 [It] graceful pod terminated should wait until preStop hook completes the process /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pre_stop.go:185 �[1mSTEP�[0m: creating the pod �[1mSTEP�[0m: submitting the pod to kubernetes �[1mSTEP�[0m: waiting for pod running �[1mSTEP�[0m: deleting the pod gracefully �[1mSTEP�[0m: verifying the pod running state after graceful termination Oct 10 09:36:09.782: FAIL: validate-pod-is-running Unexpected error: <*errors.errorString | 0xc0000a10a0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred [AfterEach] [k8s.io] [sig-node] PreStop /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Collecting events from namespace "prestop-1578". �[1mSTEP�[0m: Found 6 events. Oct 10 09:36:09.926: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for pod-prestop-hook-1e1c0c12-666c-4af2-aedb-9cfe6d8703b8: {default-scheduler } Scheduled: Successfully assigned prestop-1578/pod-prestop-hook-1e1c0c12-666c-4af2-aedb-9cfe6d8703b8 to ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:36:09.926: INFO: At 2019-10-10 09:34:33 +0000 UTC - event for pod-prestop-hook-1e1c0c12-666c-4af2-aedb-9cfe6d8703b8: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Pulled: Container image "docker.io/library/nginx:1.14-alpine" already present on machine Oct 10 09:36:09.926: INFO: At 2019-10-10 09:34:33 +0000 UTC - event for pod-prestop-hook-1e1c0c12-666c-4af2-aedb-9cfe6d8703b8: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Created: Created container nginx Oct 10 09:36:09.926: INFO: At 2019-10-10 09:34:33 +0000 UTC - event for pod-prestop-hook-1e1c0c12-666c-4af2-aedb-9cfe6d8703b8: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Started: Started container nginx Oct 10 09:36:09.926: INFO: At 2019-10-10 09:34:39 +0000 UTC - event for pod-prestop-hook-1e1c0c12-666c-4af2-aedb-9cfe6d8703b8: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Killing: Stopping container nginx Oct 10 09:36:09.926: INFO: At 2019-10-10 09:35:09 +0000 UTC - event for pod-prestop-hook-1e1c0c12-666c-4af2-aedb-9cfe6d8703b8: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} FailedPreStopHook: Exec lifecycle hook ([sh -c while true; do echo preStop; sleep 1; done]) for Container "nginx" in Pod "pod-prestop-hook-1e1c0c12-666c-4af2-aedb-9cfe6d8703b8_prestop-1578(cedcfe34-6e4d-4d42-82b7-e8f8b9e81c65)" failed - error: command 'sh -c while true; do echo preStop; sleep 1; done' exited with 137: , message: "preStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\npreStop\n" Oct 10 09:36:10.068: INFO: POD NODE PHASE GRACE CONDITIONS Oct 10 09:36:10.068: INFO: Oct 10 09:36:10.212: INFO: Logging node info for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:36:10.355: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-37-177.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-37-177.sa-east-1.compute.internal 8ecedabe-969e-476a-8f76-1fb03eedaa56 36482 0 2019-10-10 09:12:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c4.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:master-sa-east-1c kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-37-177.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master:] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-08fb35da4b2014f59,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3949572096 0} {<nil>} 3857004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3844714496 0} {<nil>} 3754604Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:12:53 +0000 UTC,LastTransitionTime:2019-10-10 09:12:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:36:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:36:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:36:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:36:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.177,},NodeAddress{Type:ExternalIP,Address:54.233.97.36,},NodeAddress{Type:Hostname,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-97-36.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:75a86a2fc8e747568f8cd25355ed4a43,SystemUUID:EC277240-730F-D89C-36D2-B12A43ABB39F,BootID:33b7c61a-9c83-42db-9541-8a26846b977a,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[kopeio/etcd-manager@sha256:cb0ed7c56dadbc0f4cd515906d72b30094229d6e0a9fcb7aa44e23680bf9a3a8 kopeio/etcd-manager:3.0.20190930],SizeBytes:656348817,},ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:260130533,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:205085998,},ContainerImage{Names:[kope/dns-controller@sha256:aca3878acdac85716e1317dd2fc85b235551068d667e578fceb9b0e8c3561324 kope/dns-controller:1.15.0-alpha.1],SizeBytes:120867125,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:103791294,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:36:10.355: INFO: Logging kubelet events for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:36:10.499: INFO: Logging pods the kubelet thinks is on node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:36:10.644: INFO: kube-scheduler-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:10.644: INFO: Container kube-scheduler ready: true, restart count 0 Oct 10 09:36:10.644: INFO: etcd-manager-events-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:10.644: INFO: Container etcd-manager ready: true, restart count 0 Oct 10 09:36:10.644: INFO: kops-controller-76f5d459f8-86j85 started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:10.644: INFO: Container kops-controller ready: true, restart count 0 Oct 10 09:36:10.644: INFO: dns-controller-78ccbffc6d-5pnmw started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:10.644: INFO: Container dns-controller ready: true, restart count 0 Oct 10 09:36:10.644: INFO: etcd-manager-main-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:10.644: INFO: Container etcd-manager ready: true, restart count 0 Oct 10 09:36:10.644: INFO: kube-apiserver-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:10.644: INFO: Container kube-apiserver ready: true, restart count 3 Oct 10 09:36:10.644: INFO: kube-controller-manager-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:10.644: INFO: Container kube-controller-manager ready: true, restart count 0 Oct 10 09:36:10.644: INFO: kube-proxy-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:10.644: INFO: Container kube-proxy ready: true, restart count 3 W1010 09:36:10.788498 915 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:36:11.083: INFO: Latency metrics for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:36:11.083: INFO: Logging node info for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:36:11.227: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-42-37.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-42-37.sa-east-1.compute.internal 8fb9f863-77f2-4451-ba99-614781c1c8bc 36408 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-42-37.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node mounted_volume_expand:mounted-volume-expand-8034 node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-1205":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-4356":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-volume-expand-3381":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-volume-expand-4923":"ip-172-20-42-37.sa-east-1.compute.internal"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-020fda63f6b69c0ea,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:35:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.37,},NodeAddress{Type:ExternalIP,Address:54.233.88.138,},NodeAddress{Type:Hostname,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-88-138.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dbea17b1df4f4682b3aea8f7967a81f7,SystemUUID:EC276068-34A4-965C-3CB7-CA4BD3478D25,BootID:883b28de-249e-43a6-8e1c-705f97846842,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa k8s.gcr.io/etcd:3.3.15],SizeBytes:246640776,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:1bafcc6fb1aa990b487850adba9cadc020e42d7905aa8a30481182a477ba24b0 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.10],SizeBytes:61365829,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:fe301db49df08c384001ed752dff6d52b4305a73a7f608f21528048e8a08b51e busybox:latest],SizeBytes:1219782,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:36:11.227: INFO: Logging kubelet events for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:36:11.371: INFO: Logging pods the kubelet thinks is on node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:36:11.515: INFO: kube-proxy-ip-172-20-42-37.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:11.515: INFO: Container kube-proxy ready: true, restart count 2 W1010 09:36:11.658559 915 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:36:11.966: INFO: Latency metrics for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:36:11.966: INFO: Logging node info for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:36:12.109: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-49-15.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-49-15.sa-east-1.compute.internal 105a0721-5b17-40b8-b686-ccf439f1ca2a 36503 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-49-15.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6677":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-ephemeral-8821":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-1913":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-6893":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-8860":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-9656":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-5356":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-5574":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-6407":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-volume-expand-3873":"ip-172-20-49-15.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-3724":"csi-mock-csi-mock-volumes-3724","csi-mock-csi-mock-volumes-4205":"csi-mock-csi-mock-volumes-4205","csi-mock-csi-mock-volumes-4873":"csi-mock-csi-mock-volumes-4873","csi-mock-csi-mock-volumes-7612":"csi-mock-csi-mock-volumes-7612","csi-mock-csi-mock-volumes-8888":"csi-mock-csi-mock-volumes-8888"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-056d95303ed61d881,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:36:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:36:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:36:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:36:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.49.15,},NodeAddress{Type:ExternalIP,Address:18.228.205.178,},NodeAddress{Type:Hostname,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-228-205-178.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f468c62663d2465ca17ba5284774252e,SystemUUID:EC23BE58-6EBA-E800-9C73-DEB3BAA2D1B9,BootID:6eb82ab7-2bd7-418a-ba22-36d3a808a22b,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/google-containers/debian-base@sha256:6966a0aedd7592c18ff2dd803c08bd85780ee19f5e3a2e7cf908a4cd837afcde gcr.io/google-containers/debian-base:0.4.1],SizeBytes:42323657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[alpine@sha256:8421d9a84432575381bfabd248f1eb56f3aa21d9d7cd2511583c68c9b7511d10 alpine:3.7],SizeBytes:4206494,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-085f849e64e02110d kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0b0fa084d8405fe9e kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0caeace51988095bb],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:36:12.110: INFO: Logging kubelet events for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:36:12.254: INFO: Logging pods the kubelet thinks is on node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:36:12.399: INFO: kube-proxy-ip-172-20-49-15.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:12.399: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:36:12.399: INFO: aws-injector started at 2019-10-10 09:30:35 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:12.399: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:36:12.399: INFO: aws-injector started at 2019-10-10 09:32:03 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:12.399: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:36:12.399: INFO: aws-injector started at 2019-10-10 09:33:45 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:12.399: INFO: Container aws-injector ready: false, restart count 0 W1010 09:36:12.543043 915 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:36:12.867: INFO: Latency metrics for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:36:12.867: INFO: Logging node info for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:36:13.010: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-56-86.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-56-86.sa-east-1.compute.internal cccbef08-fa00-42b5-ae85-da8efe4ee848 36337 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-56-86.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9823":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-provisioning-5677":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-1005":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-1516":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-6492":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volume-6196":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volumemode-1556":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-1749":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-8804":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-expand-9939":"ip-172-20-56-86.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-5777":"csi-mock-csi-mock-volumes-5777","csi-mock-csi-mock-volumes-6825":"csi-mock-csi-mock-volumes-6825","csi-mock-csi-mock-volumes-7201":"csi-mock-csi-mock-volumes-7201","csi-mock-csi-mock-volumes-8231":"csi-mock-csi-mock-volumes-8231"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-0b5800b629bcb7519,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:35:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.86,},NodeAddress{Type:ExternalIP,Address:54.207.48.88,},NodeAddress{Type:Hostname,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-207-48-88.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:99be0b3f4ec34abb8f4f249d272797b5,SystemUUID:EC2EB353-C506-B251-A10A-9B28B752A967,BootID:e098fcb6-fca7-433b-9b9f-7e47386c5ca0,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 gluster/glusterdynamic-provisioner:v1.0],SizeBytes:373281573,},ContainerImage{Names:[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6],SizeBytes:373099368,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:bbc3a03235220b170ba48a157dd097dd1379299370e1ed99ce976df0355d24f0 busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-028b66335e31eaf4f kubernetes.io/aws-ebs/aws://sa-east-1c/vol-05da71c2f70c6d1e3 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0765fb05bdb37f4b5 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0f597dc8d7319d060],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:36:13.011: INFO: Logging kubelet events for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:36:13.155: INFO: Logging pods the kubelet thinks is on node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:36:13.301: INFO: exec-volume-test-aws-4jlf started at 2019-10-10 09:31:15 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:13.301: INFO: Container exec-container-aws-4jlf ready: false, restart count 0 Oct 10 09:36:13.301: INFO: aws-injector started at 2019-10-10 09:31:17 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:13.301: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:36:13.301: INFO: kube-proxy-ip-172-20-56-86.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:13.301: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:36:13.301: INFO: exec-volume-test-aws-preprovisionedpv-j99q started at 2019-10-10 09:32:17 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:13.301: INFO: Container exec-container-aws-preprovisionedpv-j99q ready: false, restart count 0 Oct 10 09:36:13.301: INFO: aws-injector started at 2019-10-10 09:28:01 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:13.301: INFO: Container aws-injector ready: false, restart count 0 W1010 09:36:13.446924 915 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:36:13.764: INFO: Latency metrics for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:36:13.764: INFO: Logging node info for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:36:13.908: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-60-88.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-60-88.sa-east-1.compute.internal f5a2e6d3-a123-4acc-a9b2-8fa0a5c1c28f 36420 0 2019-10-10 09:14:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-60-88.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4801":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-provisioning-2176":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-provisioning-8958":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-9423":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volume-expand-4947":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volume-expand-6712":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volumemode-1292":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volumemode-4728":"ip-172-20-60-88.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-3023":"csi-mock-csi-mock-volumes-3023","csi-mock-csi-mock-volumes-3750":"csi-mock-csi-mock-volumes-3750","csi-mock-csi-mock-volumes-3882":"csi-mock-csi-mock-volumes-3882","csi-mock-csi-mock-volumes-5042":"csi-mock-csi-mock-volumes-5042","csi-mock-csi-mock-volumes-6797":"csi-mock-csi-mock-volumes-6797"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-087c9d5356d3aafe3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146278400 0} {<nil>} 4049100Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041420800 0} {<nil>} 3946700Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:13 +0000 UTC,LastTransitionTime:2019-10-10 09:14:13 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:35:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.88,},NodeAddress{Type:ExternalIP,Address:18.231.36.128,},NodeAddress{Type:Hostname,Address:ip-172-20-60-88.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-60-88.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-231-36-128.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4f6cfed0b3cc440c814a893a63590a26,SystemUUID:EC2CF3F1-2D60-B6EE-FE1D-D82FEFE80523,BootID:fcb35a82-1eda-4e12-88ea-2fc1cfa0c447,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6],SizeBytes:373099368,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:618a82fa66cf0c75e4753369a6999032372be7308866fc9afb381789b1e5ad52 k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13],SizeBytes:51157394,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:12370202895b621a2ac28226292e4578598f13c1502aa4d3ee90fff4325d9275 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.4.0],SizeBytes:45853555,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-sidecar-amd64@sha256:cedc8fe2098dffc26d17f64061296b7aa54258a31513b6c52df271a98bb522b3 k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.13],SizeBytes:42852039,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64@sha256:45df3e8e0c551bd0c79cdba48ae6677f817971dcbd1eeed7fd1f9a35118410e4 k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13],SizeBytes:41372492,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0559eda2818e41891 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0fac33f38a006d601],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:36:13.908: INFO: Logging kubelet events for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:36:14.056: INFO: Logging pods the kubelet thinks is on node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:36:14.202: INFO: kube-dns-bb55d6458-cx9kh started at 2019-10-10 09:14:29 +0000 UTC (0+3 container statuses recorded) Oct 10 09:36:14.202: INFO: Container dnsmasq ready: true, restart count 0 Oct 10 09:36:14.202: INFO: Container kubedns ready: true, restart count 0 Oct 10 09:36:14.202: INFO: Container sidecar ready: true, restart count 0 Oct 10 09:36:14.202: INFO: aws-injector started at 2019-10-10 09:32:35 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:14.202: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:36:14.202: INFO: kube-proxy-ip-172-20-60-88.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:14.202: INFO: Container kube-proxy ready: true, restart count 1 Oct 10 09:36:14.202: INFO: kube-dns-autoscaler-66b775459-74nsm started at 2019-10-10 09:14:21 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:14.202: INFO: Container autoscaler ready: true, restart count 0 Oct 10 09:36:14.202: INFO: pod-projected-configmaps-b96a2f31-9ea1-4ab5-aab3-96392e782102 started at 2019-10-10 09:34:28 +0000 UTC (0+3 container statuses recorded) Oct 10 09:36:14.202: INFO: Container createcm-volume-test ready: false, restart count 0 Oct 10 09:36:14.202: INFO: Container delcm-volume-test ready: false, restart count 0 Oct 10 09:36:14.202: INFO: Container updcm-volume-test ready: false, restart count 0 Oct 10 09:36:14.202: INFO: aws-injector started at 2019-10-10 09:31:02 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:14.202: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:36:14.202: INFO: kube-dns-bb55d6458-g4ktr started at 2019-10-10 09:14:21 +0000 UTC (0+3 container statuses recorded) Oct 10 09:36:14.202: INFO: Container dnsmasq ready: true, restart count 0 Oct 10 09:36:14.202: INFO: Container kubedns ready: true, restart count 0 Oct 10 09:36:14.202: INFO: Container sidecar ready: true, restart count 0 W1010 09:36:14.347522 915 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:36:14.669: INFO: Latency metrics for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:36:14.670: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "prestop-1578" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sServices\sshould\sbe\sable\sto\schange\sthe\stype\sfrom\sExternalName\sto\sNodePort\s\[Conformance\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:691 Oct 10 09:25:33.456: Service is not reachable within 2m0s timeout on endpoint 54.207.48.88:30507 over TCP protocol Unexpected error: <*errors.errorString | 0xc0000d5090>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/service/jig.go:795from junit_24.xml
[BeforeEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:150 �[1mSTEP�[0m: Creating a kubernetes client Oct 10 09:23:06.760: INFO: >>> kubeConfig: /tmp/kops104699295/kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename services �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:91 [It] should be able to change the type from ExternalName to NodePort [Conformance] /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:691 �[1mSTEP�[0m: creating a service externalname-service with the type=ExternalName in namespace services-7193 �[1mSTEP�[0m: changing the ExternalName service to type=NodePort �[1mSTEP�[0m: creating replication controller externalname-service in namespace services-7193 I1010 09:23:07.916143 893 runners.go:189] Created replication controller with name: externalname-service, namespace: services-7193, replica count: 2 I1010 09:23:11.066670 893 runners.go:189] externalname-service Pods: 2 out of 2 created, 1 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I1010 09:23:14.066932 893 runners.go:189] externalname-service Pods: 2 out of 2 created, 2 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Oct 10 09:23:14.067: INFO: Creating new exec pod Oct 10 09:23:17.639: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 externalname-service 80' Oct 10 09:23:19.416: INFO: stderr: "+ nc -zv -t -w 2 externalname-service 80\nConnection to externalname-service 80 port [tcp/http] succeeded!\n" Oct 10 09:23:19.416: INFO: stdout: "" Oct 10 09:23:19.416: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 100.71.67.66 80' Oct 10 09:23:21.227: INFO: stderr: "+ nc -zv -t -w 2 100.71.67.66 80\nConnection to 100.71.67.66 80 port [tcp/http] succeeded!\n" Oct 10 09:23:21.227: INFO: stdout: "" Oct 10 09:23:21.227: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 172.20.56.86 30507' Oct 10 09:23:23.049: INFO: stderr: "+ nc -zv -t -w 2 172.20.56.86 30507\nConnection to 172.20.56.86 30507 port [tcp/30507] succeeded!\n" Oct 10 09:23:23.049: INFO: stdout: "" Oct 10 09:23:23.049: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 172.20.60.88 30507' Oct 10 09:23:24.892: INFO: stderr: "+ nc -zv -t -w 2 172.20.60.88 30507\nConnection to 172.20.60.88 30507 port [tcp/30507] succeeded!\n" Oct 10 09:23:24.892: INFO: stdout: "" Oct 10 09:23:24.892: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:23:28.712: INFO: rc: 1 Oct 10 09:23:28.712: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002172f00 exit status 1 <nil> <nil> true [0xc00226b3f0 0xc00226b410 0xc00226b438] [0xc00226b3f0 0xc00226b410 0xc00226b438] [0xc00226b400 0xc00226b430] [0x10f13d0 0x10f13d0] 0xc0026e8960 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:23:29.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:23:33.507: INFO: rc: 1 Oct 10 09:23:33.507: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0021737a0 exit status 1 <nil> <nil> true [0xc00226b440 0xc00226b468 0xc00226b488] [0xc00226b440 0xc00226b468 0xc00226b488] [0xc00226b458 0xc00226b480] [0x10f13d0 0x10f13d0] 0xc0026e90e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:23:33.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:23:37.618: INFO: rc: 1 Oct 10 09:23:37.618: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0023b2e70 exit status 1 <nil> <nil> true [0xc002ac02d8 0xc002ac0320 0xc002ac0388] [0xc002ac02d8 0xc002ac0320 0xc002ac0388] [0xc002ac0308 0xc002ac0358] [0x10f13d0 0x10f13d0] 0xc0021a0ea0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:23:37.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:23:41.532: INFO: rc: 1 Oct 10 09:23:41.532: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002484c30 exit status 1 <nil> <nil> true [0xc00215c158 0xc00215c190 0xc00215c1a8] [0xc00215c158 0xc00215c190 0xc00215c1a8] [0xc00215c188 0xc00215c1a0] [0x10f13d0 0x10f13d0] 0xc0020bd620 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:23:41.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:23:45.515: INFO: rc: 1 Oct 10 09:23:45.515: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001fee900 exit status 1 <nil> <nil> true [0xc002758008 0xc002758030 0xc002758058] [0xc002758008 0xc002758030 0xc002758058] [0xc002758028 0xc002758048] [0x10f13d0 0x10f13d0] 0xc0020b67e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:23:45.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:23:49.508: INFO: rc: 1 Oct 10 09:23:49.508: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002485590 exit status 1 <nil> <nil> true [0xc00215c1b0 0xc00215c1c8 0xc00215c200] [0xc00215c1b0 0xc00215c1c8 0xc00215c200] [0xc00215c1c0 0xc00215c1f8] [0x10f13d0 0x10f13d0] 0xc002608300 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:23:49.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:23:53.538: INFO: rc: 1 Oct 10 09:23:53.538: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001fef1a0 exit status 1 <nil> <nil> true [0xc002758068 0xc002758088 0xc0027580b0] [0xc002758068 0xc002758088 0xc0027580b0] [0xc002758080 0xc0027580a0] [0x10f13d0 0x10f13d0] 0xc0020b7920 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:23:53.714: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:23:57.537: INFO: rc: 1 Oct 10 09:23:57.537: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0023b39e0 exit status 1 <nil> <nil> true [0xc002ac0398 0xc002ac03f0 0xc002ac0418] [0xc002ac0398 0xc002ac03f0 0xc002ac0418] [0xc002ac03e8 0xc002ac0408] [0x10f13d0 0x10f13d0] 0xc0021a14a0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:23:57.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:24:01.478: INFO: rc: 1 Oct 10 09:24:01.478: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001cdc360 exit status 1 <nil> <nil> true [0xc002ac0430 0xc002ac0450 0xc002ac0478] [0xc002ac0430 0xc002ac0450 0xc002ac0478] [0xc002ac0440 0xc002ac0470] [0x10f13d0 0x10f13d0] 0xc0021a1a40 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:01.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:24:05.512: INFO: rc: 1 Oct 10 09:24:05.512: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002485e00 exit status 1 <nil> <nil> true [0xc00215c208 0xc00215c220 0xc00215c238] [0xc00215c208 0xc00215c220 0xc00215c238] [0xc00215c218 0xc00215c230] [0x10f13d0 0x10f13d0] 0xc002608d80 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:05.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:24:09.506: INFO: rc: 1 Oct 10 09:24:09.506: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001b7a1e0 exit status 1 <nil> <nil> true [0xc00226b490 0xc00226b4c0 0xc00226b4d8] [0xc00226b490 0xc00226b4c0 0xc00226b4d8] [0xc00226b4b0 0xc00226b4d0] [0x10f13d0 0x10f13d0] 0xc0026e9560 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:09.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:24:13.519: INFO: rc: 1 Oct 10 09:24:13.519: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001b7aa80 exit status 1 <nil> <nil> true [0xc00226b4e8 0xc00226b510 0xc00226b530] [0xc00226b4e8 0xc00226b510 0xc00226b530] [0xc00226b508 0xc00226b520] [0x10f13d0 0x10f13d0] 0xc0026e9aa0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:13.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:24:17.500: INFO: rc: 1 Oct 10 09:24:17.501: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001fefb30 exit status 1 <nil> <nil> true [0xc0027580c0 0xc0027580e8 0xc002758100] [0xc0027580c0 0xc0027580e8 0xc002758100] [0xc0027580d8 0xc0027580f8] [0x10f13d0 0x10f13d0] 0xc002255380 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:17.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:24:21.485: INFO: rc: 1 Oct 10 09:24:21.485: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0016c2480 exit status 1 <nil> <nil> true [0xc002758108 0xc002758150 0xc002758180] [0xc002758108 0xc002758150 0xc002758180] [0xc002758148 0xc002758178] [0x10f13d0 0x10f13d0] 0xc001a6c780 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:21.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:24:25.490: INFO: rc: 1 Oct 10 09:24:25.490: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00163e7b0 exit status 1 <nil> <nil> true [0xc00215c240 0xc00215c268 0xc00215c2a8] [0xc00215c240 0xc00215c268 0xc00215c2a8] [0xc00215c250 0xc00215c2a0] [0x10f13d0 0x10f13d0] 0xc002609800 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:25.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:24:29.518: INFO: rc: 1 Oct 10 09:24:29.518: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001cdcc30 exit status 1 <nil> <nil> true [0xc002ac0480 0xc002ac04a8 0xc002ac04c8] [0xc002ac0480 0xc002ac04a8 0xc002ac04c8] [0xc002ac0498 0xc002ac04c0] [0x10f13d0 0x10f13d0] 0xc0021a1f80 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:29.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:24:33.505: INFO: rc: 1 Oct 10 09:24:33.505: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001cdd500 exit status 1 <nil> <nil> true [0xc002ac04d0 0xc002ac0508 0xc002ac0528] [0xc002ac04d0 0xc002ac0508 0xc002ac0528] [0xc002ac04f0 0xc002ac0518] [0x10f13d0 0x10f13d0] 0xc002296a20 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:33.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:24:37.498: INFO: rc: 1 Oct 10 09:24:37.498: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0016c2db0 exit status 1 <nil> <nil> true [0xc002758188 0xc0027581a8 0xc0027581e8] [0xc002758188 0xc0027581a8 0xc0027581e8] [0xc0027581a0 0xc0027581d0] [0x10f13d0 0x10f13d0] 0xc001a6d3e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:37.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:24:41.482: INFO: rc: 1 Oct 10 09:24:41.482: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0016c3680 exit status 1 <nil> <nil> true [0xc0027581f0 0xc002758208 0xc002758220] [0xc0027581f0 0xc002758208 0xc002758220] [0xc002758200 0xc002758218] [0x10f13d0 0x10f13d0] 0xc0026320c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:41.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:24:45.510: INFO: rc: 1 Oct 10 09:24:45.510: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00163f380 exit status 1 <nil> <nil> true [0xc00215c2c8 0xc00215c310 0xc00215c328] [0xc00215c2c8 0xc00215c310 0xc00215c328] [0xc00215c2f8 0xc00215c320] [0x10f13d0 0x10f13d0] 0xc0024223c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:45.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:24:49.520: INFO: rc: 1 Oct 10 09:24:49.520: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0016c3f50 exit status 1 <nil> <nil> true [0xc002758240 0xc002758260 0xc002758290] [0xc002758240 0xc002758260 0xc002758290] [0xc002758258 0xc002758288] [0x10f13d0 0x10f13d0] 0xc002632cc0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:49.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:24:53.588: INFO: rc: 1 Oct 10 09:24:53.588: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001cdde30 exit status 1 <nil> <nil> true [0xc002ac0538 0xc002ac0558 0xc002ac0580] [0xc002ac0538 0xc002ac0558 0xc002ac0580] [0xc002ac0550 0xc002ac0570] [0x10f13d0 0x10f13d0] 0xc002297740 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:53.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:24:57.525: INFO: rc: 1 Oct 10 09:24:57.525: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001b7b2f0 exit status 1 <nil> <nil> true [0xc00226b540 0xc00226b560 0xc00226b588] [0xc00226b540 0xc00226b560 0xc00226b588] [0xc00226b558 0xc00226b578] [0x10f13d0 0x10f13d0] 0xc002822420 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:57.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:25:01.497: INFO: rc: 1 Oct 10 09:25:01.497: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001b7bb90 exit status 1 <nil> <nil> true [0xc00226b598 0xc00226b5b0 0xc00226b5e0] [0xc00226b598 0xc00226b5b0 0xc00226b5e0] [0xc00226b5a8 0xc00226b5d0] [0x10f13d0 0x10f13d0] 0xc002822fc0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:01.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:25:05.530: INFO: rc: 1 Oct 10 09:25:05.531: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0015768d0 exit status 1 <nil> <nil> true [0xc002ac0590 0xc002ac05a8 0xc002ac05d8] [0xc002ac0590 0xc002ac05a8 0xc002ac05d8] [0xc002ac05a0 0xc002ac05c8] [0x10f13d0 0x10f13d0] 0xc0028ee2a0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:05.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:25:09.523: INFO: rc: 1 Oct 10 09:25:09.523: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00275e750 exit status 1 <nil> <nil> true [0xc00226b5e8 0xc00226b608 0xc00226b630] [0xc00226b5e8 0xc00226b608 0xc00226b630] [0xc00226b5f8 0xc00226b628] [0x10f13d0 0x10f13d0] 0xc002823f20 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:09.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:25:13.484: INFO: rc: 1 Oct 10 09:25:13.484: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003688840 exit status 1 <nil> <nil> true [0xc001c7e030 0xc001c7e0e0 0xc001c7e230] [0xc001c7e030 0xc001c7e0e0 0xc001c7e230] [0xc001c7e070 0xc001c7e188] [0x10f13d0 0x10f13d0] 0xc002632a20 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:13.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:25:17.502: INFO: rc: 1 Oct 10 09:25:17.502: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001d70870 exit status 1 <nil> <nil> true [0xc002ac0000 0xc002ac0030 0xc002ac0058] [0xc002ac0000 0xc002ac0030 0xc002ac0058] [0xc002ac0020 0xc002ac0050] [0x10f13d0 0x10f13d0] 0xc001a6c780 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:17.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:25:21.505: INFO: rc: 1 Oct 10 09:25:21.505: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001d71110 exit status 1 <nil> <nil> true [0xc002ac0060 0xc002ac0090 0xc002ac00a8] [0xc002ac0060 0xc002ac0090 0xc002ac00a8] [0xc002ac0080 0xc002ac00a0] [0x10f13d0 0x10f13d0] 0xc001a6d260 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:21.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:25:25.538: INFO: rc: 1 Oct 10 09:25:25.538: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0036890e0 exit status 1 <nil> <nil> true [0xc001c7e270 0xc001c7e340 0xc001c7e3b0] [0xc001c7e270 0xc001c7e340 0xc001c7e3b0] [0xc001c7e330 0xc001c7e390] [0x10f13d0 0x10f13d0] 0xc0026335c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:25.713: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:25:29.649: INFO: rc: 1 Oct 10 09:25:29.649: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003689950 exit status 1 <nil> <nil> true [0xc001c7e3d0 0xc001c7e478 0xc001c7e558] [0xc001c7e3d0 0xc001c7e478 0xc001c7e558] [0xc001c7e420 0xc001c7e508] [0x10f13d0 0x10f13d0] 0xc0022543c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:29.649: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507' Oct 10 09:25:33.455: INFO: rc: 1 Oct 10 09:25:33.456: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-7193 execpodjk4rj -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 30507] [] <nil> + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001d71a10 exit status 1 <nil> <nil> true [0xc002ac00b0 0xc002ac00e0 0xc002ac00f8] [0xc002ac00b0 0xc002ac00e0 0xc002ac00f8] [0xc002ac00d0 0xc002ac00f0] [0x10f13d0 0x10f13d0] 0xc001a6dec0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 30507 nc: connect to 54.207.48.88 port 30507 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:33.456: FAIL: Service is not reachable within 2m0s timeout on endpoint 54.207.48.88:30507 over TCP protocol Unexpected error: <*errors.errorString | 0xc0000d5090>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Oct 10 09:25:33.456: INFO: Cleaning up the ExternalName to NodePort test service [AfterEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Collecting events from namespace "services-7193". �[1mSTEP�[0m: Found 14 events. Oct 10 09:25:33.775: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for execpodjk4rj: {default-scheduler } Scheduled: Successfully assigned services-7193/execpodjk4rj to ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:25:33.775: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for externalname-service-ck2p4: {default-scheduler } Scheduled: Successfully assigned services-7193/externalname-service-ck2p4 to ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:25:33.775: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for externalname-service-knwjr: {default-scheduler } Scheduled: Successfully assigned services-7193/externalname-service-knwjr to ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:25:33.775: INFO: At 2019-10-10 09:23:07 +0000 UTC - event for externalname-service: {replication-controller } SuccessfulCreate: Created pod: externalname-service-knwjr Oct 10 09:25:33.775: INFO: At 2019-10-10 09:23:07 +0000 UTC - event for externalname-service: {replication-controller } SuccessfulCreate: Created pod: externalname-service-ck2p4 Oct 10 09:25:33.775: INFO: At 2019-10-10 09:23:08 +0000 UTC - event for externalname-service-ck2p4: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:25:33.775: INFO: At 2019-10-10 09:23:08 +0000 UTC - event for externalname-service-ck2p4: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Created: Created container externalname-service Oct 10 09:25:33.775: INFO: At 2019-10-10 09:23:08 +0000 UTC - event for externalname-service-ck2p4: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Started: Started container externalname-service Oct 10 09:25:33.775: INFO: At 2019-10-10 09:23:08 +0000 UTC - event for externalname-service-knwjr: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:25:33.775: INFO: At 2019-10-10 09:23:08 +0000 UTC - event for externalname-service-knwjr: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Created: Created container externalname-service Oct 10 09:25:33.775: INFO: At 2019-10-10 09:23:09 +0000 UTC - event for externalname-service-knwjr: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Started: Started container externalname-service Oct 10 09:25:33.775: INFO: At 2019-10-10 09:23:14 +0000 UTC - event for execpodjk4rj: {kubelet ip-172-20-60-88.sa-east-1.compute.internal} Created: Created container agnhost-pause Oct 10 09:25:33.775: INFO: At 2019-10-10 09:23:14 +0000 UTC - event for execpodjk4rj: {kubelet ip-172-20-60-88.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:25:33.775: INFO: At 2019-10-10 09:23:14 +0000 UTC - event for execpodjk4rj: {kubelet ip-172-20-60-88.sa-east-1.compute.internal} Started: Started container agnhost-pause Oct 10 09:25:33.931: INFO: POD NODE PHASE GRACE CONDITIONS Oct 10 09:25:33.931: INFO: execpodjk4rj ip-172-20-60-88.sa-east-1.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:23:14 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:23:15 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:23:15 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:23:14 +0000 UTC }] Oct 10 09:25:33.931: INFO: externalname-service-ck2p4 ip-172-20-42-37.sa-east-1.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:23:07 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:23:09 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:23:09 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:23:07 +0000 UTC }] Oct 10 09:25:33.931: INFO: externalname-service-knwjr ip-172-20-49-15.sa-east-1.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:23:07 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:23:09 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:23:09 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:23:07 +0000 UTC }] Oct 10 09:25:33.931: INFO: Oct 10 09:25:34.077: INFO: Logging node info for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:25:34.226: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-37-177.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-37-177.sa-east-1.compute.internal 8ecedabe-969e-476a-8f76-1fb03eedaa56 18827 0 2019-10-10 09:12:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c4.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:master-sa-east-1c kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-37-177.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master:] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-08fb35da4b2014f59,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3949572096 0} {<nil>} 3857004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3844714496 0} {<nil>} 3754604Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:12:53 +0000 UTC,LastTransitionTime:2019-10-10 09:12:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:25:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:25:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:25:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:25:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.177,},NodeAddress{Type:ExternalIP,Address:54.233.97.36,},NodeAddress{Type:Hostname,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-97-36.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:75a86a2fc8e747568f8cd25355ed4a43,SystemUUID:EC277240-730F-D89C-36D2-B12A43ABB39F,BootID:33b7c61a-9c83-42db-9541-8a26846b977a,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[kopeio/etcd-manager@sha256:cb0ed7c56dadbc0f4cd515906d72b30094229d6e0a9fcb7aa44e23680bf9a3a8 kopeio/etcd-manager:3.0.20190930],SizeBytes:656348817,},ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:260130533,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:205085998,},ContainerImage{Names:[kope/dns-controller@sha256:aca3878acdac85716e1317dd2fc85b235551068d667e578fceb9b0e8c3561324 kope/dns-controller:1.15.0-alpha.1],SizeBytes:120867125,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:103791294,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:25:34.227: INFO: Logging kubelet events for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:25:34.370: INFO: Logging pods the kubelet thinks is on node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:25:34.525: INFO: kube-apiserver-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:34.525: INFO: Container kube-apiserver ready: true, restart count 3 Oct 10 09:25:34.525: INFO: kube-controller-manager-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:34.525: INFO: Container kube-controller-manager ready: true, restart count 0 Oct 10 09:25:34.525: INFO: kube-proxy-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:34.525: INFO: Container kube-proxy ready: true, restart count 3 Oct 10 09:25:34.525: INFO: kube-scheduler-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:34.525: INFO: Container kube-scheduler ready: true, restart count 0 Oct 10 09:25:34.525: INFO: etcd-manager-events-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:34.525: INFO: Container etcd-manager ready: true, restart count 0 Oct 10 09:25:34.525: INFO: kops-controller-76f5d459f8-86j85 started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:34.525: INFO: Container kops-controller ready: true, restart count 0 Oct 10 09:25:34.525: INFO: dns-controller-78ccbffc6d-5pnmw started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:34.525: INFO: Container dns-controller ready: true, restart count 0 Oct 10 09:25:34.525: INFO: etcd-manager-main-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:34.525: INFO: Container etcd-manager ready: true, restart count 0 W1010 09:25:34.668937 893 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:25:34.968: INFO: Latency metrics for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:25:34.968: INFO: Logging node info for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:25:35.114: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-42-37.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-42-37.sa-east-1.compute.internal 8fb9f863-77f2-4451-ba99-614781c1c8bc 17708 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-42-37.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node mounted_volume_expand:mounted-volume-expand-8034 node-role.kubernetes.io/node:] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-020fda63f6b69c0ea,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:24:40 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:24:40 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:24:40 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:24:40 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.37,},NodeAddress{Type:ExternalIP,Address:54.233.88.138,},NodeAddress{Type:Hostname,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-88-138.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dbea17b1df4f4682b3aea8f7967a81f7,SystemUUID:EC276068-34A4-965C-3CB7-CA4BD3478D25,BootID:883b28de-249e-43a6-8e1c-705f97846842,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-07729e10024634411 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0fdd29053b527a7bf],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/aws-ebs/aws://sa-east-1c/vol-07729e10024634411,DevicePath:/dev/xvdbe,},},Config:nil,},} Oct 10 09:25:35.114: INFO: Logging kubelet events for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:25:35.258: INFO: Logging pods the kubelet thinks is on node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:25:35.406: INFO: externalname-service-ck2p4 started at 2019-10-10 09:23:07 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:35.406: INFO: Container externalname-service ready: true, restart count 0 Oct 10 09:25:35.406: INFO: ss-0 started at 2019-10-10 09:23:38 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:35.406: INFO: Container webserver ready: true, restart count 0 Oct 10 09:25:35.406: INFO: hostexec-ip-172-20-42-37.sa-east-1.compute.internal-snwsw started at 2019-10-10 09:25:24 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:35.406: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:25:35.406: INFO: csi-hostpath-provisioner-0 started at 2019-10-10 09:25:33 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:35.406: INFO: Container csi-provisioner ready: false, restart count 0 Oct 10 09:25:35.406: INFO: csi-hostpath-resizer-0 started at 2019-10-10 09:25:33 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:35.406: INFO: Container csi-resizer ready: false, restart count 0 Oct 10 09:25:35.406: INFO: pod-qos-class-dee4fcb3-506d-4514-9137-56ce8a357280 started at 2019-10-10 09:25:28 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:35.406: INFO: Container nginx ready: false, restart count 0 Oct 10 09:25:35.406: INFO: affinity-nodeport-cscrr started at 2019-10-10 09:23:47 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:35.406: INFO: Container affinity-nodeport ready: true, restart count 0 Oct 10 09:25:35.406: INFO: csi-hostpathplugin-0 started at 2019-10-10 09:25:33 +0000 UTC (0+3 container statuses recorded) Oct 10 09:25:35.406: INFO: Container hostpath ready: false, restart count 0 Oct 10 09:25:35.406: INFO: Container liveness-probe ready: false, restart count 0 Oct 10 09:25:35.406: INFO: Container node-driver-registrar ready: false, restart count 0 Oct 10 09:25:35.406: INFO: run-test-2-2vkwk started at 2019-10-10 09:25:28 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:35.406: INFO: Container run-test-2 ready: false, restart count 0 Oct 10 09:25:35.406: INFO: aws-injector started at 2019-10-10 09:22:26 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:35.406: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:25:35.406: INFO: run-test-3-dxd87 started at 2019-10-10 09:25:30 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:35.406: INFO: Container run-test-3 ready: true, restart count 0 Oct 10 09:25:35.406: INFO: kube-proxy-ip-172-20-42-37.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:35.406: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:25:35.406: INFO: run-test-ww2nv started at 2019-10-10 09:25:23 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:35.406: INFO: Container run-test ready: false, restart count 0 Oct 10 09:25:35.406: INFO: csi-hostpath-attacher-0 started at 2019-10-10 09:25:32 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:35.406: INFO: Container csi-attacher ready: true, restart count 0 Oct 10 09:25:35.406: INFO: execpod-affinitywxt4q started at 2019-10-10 09:23:57 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:35.406: INFO: Container agnhost-pause ready: true, restart count 0 Oct 10 09:25:35.406: INFO: security-context-bbde7183-1f8a-4a7e-9f3b-9756ec251501 started at 2019-10-10 09:25:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:35.406: INFO: Container write-pod ready: true, restart count 0 Oct 10 09:25:35.406: INFO: csi-snapshotter-0 started at 2019-10-10 09:25:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:35.406: INFO: Container csi-snapshotter ready: false, restart count 0 W1010 09:25:35.550576 893 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:25:35.866: INFO: Latency metrics for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:25:35.866: INFO: Logging node info for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:25:36.009: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-49-15.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-49-15.sa-east-1.compute.internal 105a0721-5b17-40b8-b686-ccf439f1ca2a 19515 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-49-15.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6677":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-1913":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-6893":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-8860":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-9656":"ip-172-20-49-15.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-3724":"csi-mock-csi-mock-volumes-3724","csi-mock-csi-mock-volumes-4205":"csi-mock-csi-mock-volumes-4205","csi-mock-csi-mock-volumes-7612":"csi-mock-csi-mock-volumes-7612","csi-mock-csi-mock-volumes-8888":"csi-mock-csi-mock-volumes-8888"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-056d95303ed61d881,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:25:00 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:25:00 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:25:00 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:25:00 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.49.15,},NodeAddress{Type:ExternalIP,Address:18.228.205.178,},NodeAddress{Type:Hostname,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-228-205-178.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f468c62663d2465ca17ba5284774252e,SystemUUID:EC23BE58-6EBA-E800-9C73-DEB3BAA2D1B9,BootID:6eb82ab7-2bd7-418a-ba22-36d3a808a22b,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[gcr.io/google-containers/debian-base@sha256:6966a0aedd7592c18ff2dd803c08bd85780ee19f5e3a2e7cf908a4cd837afcde gcr.io/google-containers/debian-base:0.4.1],SizeBytes:42323657,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0271c4f9c5e0a387e kubernetes.io/aws-ebs/aws://sa-east-1c/vol-029529264f0945d2d kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0f1bd8fb9b9bee757],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0f1bd8fb9b9bee757,DevicePath:/dev/xvdcn,},AttachedVolume{Name:kubernetes.io/aws-ebs/aws://sa-east-1c/vol-029529264f0945d2d,DevicePath:/dev/xvdbz,},},Config:nil,},} Oct 10 09:25:36.009: INFO: Logging kubelet events for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:25:36.153: INFO: Logging pods the kubelet thinks is on node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:25:36.299: INFO: security-context-c24c9e4c-0050-4a83-b5e4-9ec5aa6e7b5f started at 2019-10-10 09:25:14 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:36.299: INFO: Container write-pod ready: false, restart count 0 Oct 10 09:25:36.299: INFO: ss-2 started at 2019-10-10 09:24:43 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:36.299: INFO: Container webserver ready: false, restart count 0 Oct 10 09:25:36.299: INFO: ss-1 started at 2019-10-10 09:24:11 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:36.299: INFO: Container webserver ready: true, restart count 0 Oct 10 09:25:36.299: INFO: external-provisioner-rpl86 started at 2019-10-10 09:25:25 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:36.299: INFO: Container nfs-provisioner ready: true, restart count 0 Oct 10 09:25:36.299: INFO: affinity-nodeport-zpdnf started at 2019-10-10 09:23:47 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:36.299: INFO: Container affinity-nodeport ready: true, restart count 0 Oct 10 09:25:36.299: INFO: pod-subpath-test-nfs-dynamicpv-2mnz started at 2019-10-10 09:25:33 +0000 UTC (2+1 container statuses recorded) Oct 10 09:25:36.299: INFO: Init container init-volume-nfs-dynamicpv-2mnz ready: true, restart count 0 Oct 10 09:25:36.299: INFO: Init container test-init-volume-nfs-dynamicpv-2mnz ready: true, restart count 0 Oct 10 09:25:36.299: INFO: Container test-container-subpath-nfs-dynamicpv-2mnz ready: false, restart count 0 Oct 10 09:25:36.299: INFO: externalname-service-knwjr started at 2019-10-10 09:23:07 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:36.299: INFO: Container externalname-service ready: true, restart count 0 Oct 10 09:25:36.299: INFO: kube-proxy-ip-172-20-49-15.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:36.299: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:25:36.299: INFO: exec-volume-test-aws-preprovisionedpv-v568 started at 2019-10-10 09:23:32 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:36.299: INFO: Container exec-container-aws-preprovisionedpv-v568 ready: false, restart count 0 W1010 09:25:36.442243 893 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:25:36.759: INFO: Latency metrics for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:25:36.759: INFO: Logging node info for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:25:36.902: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-56-86.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-56-86.sa-east-1.compute.internal cccbef08-fa00-42b5-ae85-da8efe4ee848 19279 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-56-86.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9823":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volume-6196":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volumemode-1556":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-1749":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-expand-9939":"ip-172-20-56-86.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-5777":"csi-mock-csi-mock-volumes-5777"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-0b5800b629bcb7519,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:25:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:25:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:25:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:25:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.86,},NodeAddress{Type:ExternalIP,Address:54.207.48.88,},NodeAddress{Type:Hostname,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-207-48-88.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:99be0b3f4ec34abb8f4f249d272797b5,SystemUUID:EC2EB353-C506-B251-A10A-9B28B752A967,BootID:e098fcb6-fca7-433b-9b9f-7e47386c5ca0,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6],SizeBytes:373099368,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:bbc3a03235220b170ba48a157dd097dd1379299370e1ed99ce976df0355d24f0 busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-01e8c74bdbcabf54c kubernetes.io/aws-ebs/aws://sa-east-1c/vol-023ab0ee87ab378fe kubernetes.io/aws-ebs/aws://sa-east-1c/vol-031cc74d06d4e0d45 kubernetes.io/csi/csi-hostpath-volume-1749^d9f83b9d-eb3f-11e9-b2cf-0abd65add406],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-1749^d9f83b9d-eb3f-11e9-b2cf-0abd65add406,DevicePath:,},},Config:nil,},} Oct 10 09:25:36.903: INFO: Logging kubelet events for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:25:37.046: INFO: Logging pods the kubelet thinks is on node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:25:37.200: INFO: hostexec-ip-172-20-56-86.sa-east-1.compute.internal-2pdvt started at 2019-10-10 09:25:21 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:37.200: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:25:37.200: INFO: csi-hostpath-attacher-0 started at 2019-10-10 09:25:06 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:37.200: INFO: Container csi-attacher ready: true, restart count 0 Oct 10 09:25:37.200: INFO: kube-proxy-ip-172-20-56-86.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:37.200: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:25:37.200: INFO: test-webserver-ad68d92b-1afe-4d38-92bd-d8ecb1a81223 started at 2019-10-10 09:23:57 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:37.200: INFO: Container test-webserver ready: true, restart count 0 Oct 10 09:25:37.200: INFO: replace-1570699500-p5p2v started at 2019-10-10 09:25:03 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:37.200: INFO: Container c ready: true, restart count 0 Oct 10 09:25:37.200: INFO: pod-subpath-test-local-preprovisionedpv-8rbv started at 2019-10-10 09:25:32 +0000 UTC (1+2 container statuses recorded) Oct 10 09:25:37.200: INFO: Init container test-init-subpath-local-preprovisionedpv-8rbv ready: true, restart count 0 Oct 10 09:25:37.200: INFO: Container test-container-subpath-local-preprovisionedpv-8rbv ready: false, restart count 0 Oct 10 09:25:37.200: INFO: Container test-container-volume-local-preprovisionedpv-8rbv ready: false, restart count 0 Oct 10 09:25:37.200: INFO: csi-hostpathplugin-0 started at 2019-10-10 09:25:06 +0000 UTC (0+3 container statuses recorded) Oct 10 09:25:37.200: INFO: Container hostpath ready: true, restart count 0 Oct 10 09:25:37.200: INFO: Container liveness-probe ready: true, restart count 0 Oct 10 09:25:37.200: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 10 09:25:37.200: INFO: csi-hostpath-provisioner-0 started at 2019-10-10 09:25:06 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:37.200: INFO: Container csi-provisioner ready: true, restart count 0 Oct 10 09:25:37.200: INFO: csi-hostpath-resizer-0 started at 2019-10-10 09:25:07 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:37.200: INFO: Container csi-resizer ready: true, restart count 0 Oct 10 09:25:37.200: INFO: csi-snapshotter-0 started at 2019-10-10 09:25:07 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:37.200: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 10 09:25:37.200: INFO: pod-subpath-test-hostpathsymlink-2hhk started at 2019-10-10 09:25:18 +0000 UTC (1+1 container statuses recorded) Oct 10 09:25:37.200: INFO: Init container init-volume-hostpathsymlink-2hhk ready: true, restart count 0 Oct 10 09:25:37.200: INFO: Container test-container-subpath-hostpathsymlink-2hhk ready: true, restart count 0 Oct 10 09:25:37.200: INFO: affinity-nodeport-wx7m8 started at 2019-10-10 09:23:47 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:37.200: INFO: Container affinity-nodeport ready: true, restart count 0 Oct 10 09:25:37.200: INFO: hostpath-injector started at 2019-10-10 09:25:10 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:37.200: INFO: Container hostpath-injector ready: true, restart count 0 Oct 10 09:25:37.200: INFO: aws-injector started at 2019-10-10 09:21:46 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:37.200: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:25:37.200: INFO: exec-volume-test-aws-nnzv started at 2019-10-10 09:24:08 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:37.200: INFO: Container exec-container-aws-nnzv ready: false, restart count 0 Oct 10 09:25:37.200: INFO: exec-volume-test-aws-preprovisionedpv-9q29 started at 2019-10-10 09:23:48 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:37.200: INFO: Container exec-container-aws-preprovisionedpv-9q29 ready: false, restart count 0 W1010 09:25:37.344027 893 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:25:37.658: INFO: Latency metrics for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:25:37.658: INFO: Logging node info for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:25:37.800: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-60-88.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-60-88.sa-east-1.compute.internal f5a2e6d3-a123-4acc-a9b2-8fa0a5c1c28f 19671 0 2019-10-10 09:14:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-60-88.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4801":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-provisioning-2176":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-provisioning-8958":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-9423":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volume-expand-4947":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volumemode-4728":"ip-172-20-60-88.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-3882":"csi-mock-csi-mock-volumes-3882"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-087c9d5356d3aafe3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146278400 0} {<nil>} 4049100Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041420800 0} {<nil>} 3946700Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:13 +0000 UTC,LastTransitionTime:2019-10-10 09:14:13 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:25:33 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:25:33 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:25:33 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:25:33 +0000 UTC,LastTransitionTime:2019-10-10 09:14:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.88,},NodeAddress{Type:ExternalIP,Address:18.231.36.128,},NodeAddress{Type:Hostname,Address:ip-172-20-60-88.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-60-88.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-231-36-128.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4f6cfed0b3cc440c814a893a63590a26,SystemUUID:EC2CF3F1-2D60-B6EE-FE1D-D82FEFE80523,BootID:fcb35a82-1eda-4e12-88ea-2fc1cfa0c447,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6],SizeBytes:373099368,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:618a82fa66cf0c75e4753369a6999032372be7308866fc9afb381789b1e5ad52 k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13],SizeBytes:51157394,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:12370202895b621a2ac28226292e4578598f13c1502aa4d3ee90fff4325d9275 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.4.0],SizeBytes:45853555,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-sidecar-amd64@sha256:cedc8fe2098dffc26d17f64061296b7aa54258a31513b6c52df271a98bb522b3 k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.13],SizeBytes:42852039,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64@sha256:45df3e8e0c551bd0c79cdba48ae6677f817971dcbd1eeed7fd1f9a35118410e4 k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13],SizeBytes:41372492,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-004155116e0252475 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0bd7bdab1ba865787 kubernetes.io/csi/csi-hostpath-provisioning-2176^e2aa2083-eb3f-11e9-80fa-0af83c1fc4fe],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-2176^e2aa2083-eb3f-11e9-80fa-0af83c1fc4fe,DevicePath:,},},Config:nil,},} Oct 10 09:25:37.800: INFO: Logging kubelet events for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:25:37.944: INFO: Logging pods the kubelet thinks is on node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:25:38.097: INFO: kube-proxy-ip-172-20-60-88.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:38.097: INFO: Container kube-proxy ready: true, restart count 1 Oct 10 09:25:38.097: INFO: kube-dns-autoscaler-66b775459-74nsm started at 2019-10-10 09:14:21 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:38.097: INFO: Container autoscaler ready: true, restart count 0 Oct 10 09:25:38.097: INFO: csi-hostpath-attacher-0 started at 2019-10-10 09:25:21 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:38.097: INFO: Container csi-attacher ready: true, restart count 0 Oct 10 09:25:38.097: INFO: csi-hostpathplugin-0 started at 2019-10-10 09:25:21 +0000 UTC (0+3 container statuses recorded) Oct 10 09:25:38.097: INFO: Container hostpath ready: true, restart count 0 Oct 10 09:25:38.097: INFO: Container liveness-probe ready: true, restart count 0 Oct 10 09:25:38.097: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 10 09:25:38.097: INFO: csi-hostpath-resizer-0 started at 2019-10-10 09:25:22 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:38.097: INFO: Container csi-resizer ready: true, restart count 0 Oct 10 09:25:38.097: INFO: exec-volume-test-aws-b7pn started at 2019-10-10 09:24:20 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:38.097: INFO: Container exec-container-aws-b7pn ready: false, restart count 0 Oct 10 09:25:38.097: INFO: csi-snapshotter-0 started at 2019-10-10 09:25:22 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:38.097: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 10 09:25:38.097: INFO: kube-dns-bb55d6458-g4ktr started at 2019-10-10 09:14:21 +0000 UTC (0+3 container statuses recorded) Oct 10 09:25:38.097: INFO: Container dnsmasq ready: true, restart count 0 Oct 10 09:25:38.097: INFO: Container kubedns ready: true, restart count 0 Oct 10 09:25:38.097: INFO: Container sidecar ready: true, restart count 0 Oct 10 09:25:38.097: INFO: kube-dns-bb55d6458-cx9kh started at 2019-10-10 09:14:29 +0000 UTC (0+3 container statuses recorded) Oct 10 09:25:38.097: INFO: Container dnsmasq ready: true, restart count 0 Oct 10 09:25:38.097: INFO: Container kubedns ready: true, restart count 0 Oct 10 09:25:38.097: INFO: Container sidecar ready: true, restart count 0 Oct 10 09:25:38.097: INFO: execpodjk4rj started at 2019-10-10 09:23:14 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:38.097: INFO: Container agnhost-pause ready: true, restart count 0 Oct 10 09:25:38.097: INFO: csi-hostpath-provisioner-0 started at 2019-10-10 09:25:21 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:38.097: INFO: Container csi-provisioner ready: true, restart count 0 Oct 10 09:25:38.097: INFO: pvc-datasource-writer-fpx8c started at 2019-10-10 09:25:23 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:38.097: INFO: Container volume-tester ready: false, restart count 0 Oct 10 09:25:38.097: INFO: aws-injector started at 2019-10-10 09:20:48 +0000 UTC (0+1 container statuses recorded) Oct 10 09:25:38.097: INFO: Container aws-injector ready: false, restart count 0 W1010 09:25:38.241091 893 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:25:38.573: INFO: Latency metrics for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:25:38.573: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "services-7193" for this suite. [AfterEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:95
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sServices\sshould\sbe\sable\sto\schange\sthe\stype\sfrom\sExternalName\sto\sNodePort\s\[Conformance\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:691 Oct 10 09:23:01.098: Service is not reachable within 2m0s timeout on endpoint 54.233.88.138:31970 over TCP protocol Unexpected error: <*errors.errorString | 0xc0000d5090>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/service/jig.go:795from junit_24.xml
[BeforeEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:150 �[1mSTEP�[0m: Creating a kubernetes client Oct 10 09:20:27.531: INFO: >>> kubeConfig: /tmp/kops104699295/kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename services �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:91 [It] should be able to change the type from ExternalName to NodePort [Conformance] /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:691 �[1mSTEP�[0m: creating a service externalname-service with the type=ExternalName in namespace services-6048 �[1mSTEP�[0m: changing the ExternalName service to type=NodePort �[1mSTEP�[0m: creating replication controller externalname-service in namespace services-6048 I1010 09:20:28.688343 893 runners.go:189] Created replication controller with name: externalname-service, namespace: services-6048, replica count: 2 I1010 09:20:31.838965 893 runners.go:189] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I1010 09:20:34.839249 893 runners.go:189] externalname-service Pods: 2 out of 2 created, 1 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I1010 09:20:37.839503 893 runners.go:189] externalname-service Pods: 2 out of 2 created, 2 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Oct 10 09:20:37.839: INFO: Creating new exec pod Oct 10 09:20:45.414: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 externalname-service 80' Oct 10 09:20:47.224: INFO: stderr: "+ nc -zv -t -w 2 externalname-service 80\nConnection to externalname-service 80 port [tcp/http] succeeded!\n" Oct 10 09:20:47.224: INFO: stdout: "" Oct 10 09:20:47.225: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 100.68.204.61 80' Oct 10 09:20:49.009: INFO: stderr: "+ nc -zv -t -w 2 100.68.204.61 80\nConnection to 100.68.204.61 80 port [tcp/http] succeeded!\n" Oct 10 09:20:49.009: INFO: stdout: "" Oct 10 09:20:49.010: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 172.20.42.37 31970' Oct 10 09:20:50.799: INFO: stderr: "+ nc -zv -t -w 2 172.20.42.37 31970\nConnection to 172.20.42.37 31970 port [tcp/31970] succeeded!\n" Oct 10 09:20:50.799: INFO: stdout: "" Oct 10 09:20:50.799: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 172.20.56.86 31970' Oct 10 09:20:52.600: INFO: stderr: "+ nc -zv -t -w 2 172.20.56.86 31970\nConnection to 172.20.56.86 31970 port [tcp/31970] succeeded!\n" Oct 10 09:20:52.600: INFO: stdout: "" Oct 10 09:20:52.600: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:20:56.444: INFO: rc: 1 Oct 10 09:20:56.444: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001649b60 exit status 1 <nil> <nil> true [0xc00215cab8 0xc00215caf8 0xc00215cb10] [0xc00215cab8 0xc00215caf8 0xc00215cb10] [0xc00215caf0 0xc00215cb08] [0x10f13d0 0x10f13d0] 0xc0023618c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:20:57.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:21:01.242: INFO: rc: 1 Oct 10 09:21:01.242: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00275f7a0 exit status 1 <nil> <nil> true [0xc002758cd8 0xc002758cf0 0xc002758d08] [0xc002758cd8 0xc002758cf0 0xc002758d08] [0xc002758ce8 0xc002758d00] [0x10f13d0 0x10f13d0] 0xc0021a10e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:21:01.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:21:05.220: INFO: rc: 1 Oct 10 09:21:05.220: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001692030 exit status 1 <nil> <nil> true [0xc002758d10 0xc002758d28 0xc002758d40] [0xc002758d10 0xc002758d28 0xc002758d40] [0xc002758d20 0xc002758d38] [0x10f13d0 0x10f13d0] 0xc0021a1680 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:21:05.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:21:09.223: INFO: rc: 1 Oct 10 09:21:09.223: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0016928a0 exit status 1 <nil> <nil> true [0xc002758d48 0xc002758d60 0xc002758d78] [0xc002758d48 0xc002758d60 0xc002758d78] [0xc002758d58 0xc002758d70] [0x10f13d0 0x10f13d0] 0xc0021a1b60 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:21:09.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:21:13.215: INFO: rc: 1 Oct 10 09:21:13.215: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001693140 exit status 1 <nil> <nil> true [0xc002758d80 0xc002758d98 0xc002758db0] [0xc002758d80 0xc002758d98 0xc002758db0] [0xc002758d90 0xc002758da8] [0x10f13d0 0x10f13d0] 0xc0026e8300 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:21:13.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:21:17.249: INFO: rc: 1 Oct 10 09:21:17.249: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0017825d0 exit status 1 <nil> <nil> true [0xc002ac0738 0xc002ac0760 0xc002ac0780] [0xc002ac0738 0xc002ac0760 0xc002ac0780] [0xc002ac0750 0xc002ac0778] [0x10f13d0 0x10f13d0] 0xc001ea1860 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:21:17.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:21:21.230: INFO: rc: 1 Oct 10 09:21:21.230: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0016939e0 exit status 1 <nil> <nil> true [0xc002758db8 0xc002758dd0 0xc002758de8] [0xc002758db8 0xc002758dd0 0xc002758de8] [0xc002758dc8 0xc002758de0] [0x10f13d0 0x10f13d0] 0xc0026e8b40 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:21:21.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:21:25.237: INFO: rc: 1 Oct 10 09:21:25.237: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00199a3f0 exit status 1 <nil> <nil> true [0xc002758df0 0xc002758e08 0xc002758e20] [0xc002758df0 0xc002758e08 0xc002758e20] [0xc002758e00 0xc002758e18] [0x10f13d0 0x10f13d0] 0xc0026e90e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:21:25.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:21:29.269: INFO: rc: 1 Oct 10 09:21:29.269: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00199ac90 exit status 1 <nil> <nil> true [0xc002758e28 0xc002758e40 0xc002758e58] [0xc002758e28 0xc002758e40 0xc002758e58] [0xc002758e38 0xc002758e50] [0x10f13d0 0x10f13d0] 0xc0026e9560 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:21:29.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:21:33.269: INFO: rc: 1 Oct 10 09:21:33.269: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00199b560 exit status 1 <nil> <nil> true [0xc002758e60 0xc002758e78 0xc002758e90] [0xc002758e60 0xc002758e78 0xc002758e90] [0xc002758e70 0xc002758e88] [0x10f13d0 0x10f13d0] 0xc0026e9aa0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:21:33.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:21:37.280: INFO: rc: 1 Oct 10 09:21:37.280: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001b928a0 exit status 1 <nil> <nil> true [0xc002a3e008 0xc002a3e058 0xc002a3e070] [0xc002a3e008 0xc002a3e058 0xc002a3e070] [0xc002a3e040 0xc002a3e068] [0x10f13d0 0x10f13d0] 0xc001cea4e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:21:37.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:21:41.308: INFO: rc: 1 Oct 10 09:21:41.308: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001b93140 exit status 1 <nil> <nil> true [0xc002a3e078 0xc002a3e0b8 0xc002a3e100] [0xc002a3e078 0xc002a3e0b8 0xc002a3e100] [0xc002a3e0a0 0xc002a3e0f0] [0x10f13d0 0x10f13d0] 0xc001ceac60 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:21:41.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:21:45.258: INFO: rc: 1 Oct 10 09:21:45.258: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00199be00 exit status 1 <nil> <nil> true [0xc002758e98 0xc002758eb0 0xc002758ec8] [0xc002758e98 0xc002758eb0 0xc002758ec8] [0xc002758ea8 0xc002758ec0] [0x10f13d0 0x10f13d0] 0xc00239c240 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:21:45.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:21:49.267: INFO: rc: 1 Oct 10 09:21:49.267: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001b939e0 exit status 1 <nil> <nil> true [0xc002a3e108 0xc002a3e148 0xc002a3e170] [0xc002a3e108 0xc002a3e148 0xc002a3e170] [0xc002a3e128 0xc002a3e168] [0x10f13d0 0x10f13d0] 0xc001ceb200 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:21:49.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:21:53.222: INFO: rc: 1 Oct 10 09:21:53.222: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0019f8480 exit status 1 <nil> <nil> true [0xc00215cb18 0xc00215cb70 0xc00215cbc0] [0xc00215cb18 0xc00215cb70 0xc00215cbc0] [0xc00215cb50 0xc00215cba8] [0x10f13d0 0x10f13d0] 0xc002361f20 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:21:53.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:21:57.236: INFO: rc: 1 Oct 10 09:21:57.236: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001f82750 exit status 1 <nil> <nil> true [0xc002758ed0 0xc002758ee8 0xc002758f00] [0xc002758ed0 0xc002758ee8 0xc002758f00] [0xc002758ee0 0xc002758ef8] [0x10f13d0 0x10f13d0] 0xc00239c540 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:21:57.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:22:01.262: INFO: rc: 1 Oct 10 09:22:01.262: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001692870 exit status 1 <nil> <nil> true [0xc00133e120 0xc00133e2c8 0xc00133e468] [0xc00133e120 0xc00133e2c8 0xc00133e468] [0xc00133e1f8 0xc00133e450] [0x10f13d0 0x10f13d0] 0xc0026e8960 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:22:01.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:22:05.280: INFO: rc: 1 Oct 10 09:22:05.280: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001648870 exit status 1 <nil> <nil> true [0xc0008074a8 0xc000da6778 0xc000da6fc0] [0xc0008074a8 0xc000da6778 0xc000da6fc0] [0xc000da6000 0xc000da6bf8] [0x10f13d0 0x10f13d0] 0xc0021a04e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:22:05.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:22:09.249: INFO: rc: 1 Oct 10 09:22:09.249: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001693170 exit status 1 <nil> <nil> true [0xc00133e4c0 0xc00133e678 0xc00133e7b8] [0xc00133e4c0 0xc00133e678 0xc00133e7b8] [0xc00133e5b8 0xc00133e730] [0x10f13d0 0x10f13d0] 0xc0026e8f60 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:22:09.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:22:13.270: INFO: rc: 1 Oct 10 09:22:13.270: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001649110 exit status 1 <nil> <nil> true [0xc000da7158 0xc000da73e0 0xc000da7be8] [0xc000da7158 0xc000da73e0 0xc000da7be8] [0xc000da7310 0xc000da77a8] [0x10f13d0 0x10f13d0] 0xc0021a0a80 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:22:13.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:22:17.286: INFO: rc: 1 Oct 10 09:22:17.286: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001693a40 exit status 1 <nil> <nil> true [0xc00133e7f8 0xc00133e968 0xc00133ea50] [0xc00133e7f8 0xc00133e968 0xc00133ea50] [0xc00133e958 0xc00133e9e8] [0x10f13d0 0x10f13d0] 0xc0026e94a0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:22:17.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:22:21.226: INFO: rc: 1 Oct 10 09:22:21.226: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002afa990 exit status 1 <nil> <nil> true [0xc00133eb50 0xc00133ed70 0xc00133eed0] [0xc00133eb50 0xc00133ed70 0xc00133eed0] [0xc00133ecf8 0xc00133eeb8] [0x10f13d0 0x10f13d0] 0xc0026e9980 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:22:21.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:22:25.276: INFO: rc: 1 Oct 10 09:22:25.276: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00275eb40 exit status 1 <nil> <nil> true [0xc002a3e008 0xc002a3e058 0xc002a3e070] [0xc002a3e008 0xc002a3e058 0xc002a3e070] [0xc002a3e040 0xc002a3e068] [0x10f13d0 0x10f13d0] 0xc002750d80 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:22:25.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:22:29.241: INFO: rc: 1 Oct 10 09:22:29.241: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002afb860 exit status 1 <nil> <nil> true [0xc00133ef28 0xc00133f198 0xc00133f338] [0xc00133ef28 0xc00133f198 0xc00133f338] [0xc00133f0f8 0xc00133f308] [0x10f13d0 0x10f13d0] 0xc00264e5a0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:22:29.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:22:33.252: INFO: rc: 1 Oct 10 09:22:33.253: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00275f3b0 exit status 1 <nil> <nil> true [0xc002a3e078 0xc002a3e0b8 0xc002a3e100] [0xc002a3e078 0xc002a3e0b8 0xc002a3e100] [0xc002a3e0a0 0xc002a3e0f0] [0x10f13d0 0x10f13d0] 0xc002751740 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:22:33.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:22:37.238: INFO: rc: 1 Oct 10 09:22:37.238: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001576180 exit status 1 <nil> <nil> true [0xc00133f348 0xc00133f4d0 0xc00133f610] [0xc00133f348 0xc00133f4d0 0xc00133f610] [0xc00133f420 0xc00133f580] [0x10f13d0 0x10f13d0] 0xc00264f980 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:22:37.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:22:41.233: INFO: rc: 1 Oct 10 09:22:41.233: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00199a8a0 exit status 1 <nil> <nil> true [0xc001c7e050 0xc001c7e158 0xc001c7e270] [0xc001c7e050 0xc001c7e158 0xc001c7e270] [0xc001c7e0e0 0xc001c7e230] [0x10f13d0 0x10f13d0] 0xc002577080 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:22:41.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:22:45.240: INFO: rc: 1 Oct 10 09:22:45.240: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00199b140 exit status 1 <nil> <nil> true [0xc001c7e2a0 0xc001c7e370 0xc001c7e3d0] [0xc001c7e2a0 0xc001c7e370 0xc001c7e3d0] [0xc001c7e340 0xc001c7e3b0] [0x10f13d0 0x10f13d0] 0xc002492480 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:22:45.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:22:49.229: INFO: rc: 1 Oct 10 09:22:49.229: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00199ba10 exit status 1 <nil> <nil> true [0xc001c7e410 0xc001c7e4c8 0xc001c7e570] [0xc001c7e410 0xc001c7e4c8 0xc001c7e570] [0xc001c7e478 0xc001c7e558] [0x10f13d0 0x10f13d0] 0xc002493860 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:22:49.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:22:53.319: INFO: rc: 1 Oct 10 09:22:53.319: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00163e390 exit status 1 <nil> <nil> true [0xc001c7e5c8 0xc001c7e628 0xc001c7e670] [0xc001c7e5c8 0xc001c7e628 0xc001c7e670] [0xc001c7e5f0 0xc001c7e658] [0x10f13d0 0x10f13d0] 0xc001cc4660 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:22:53.445: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:22:57.260: INFO: rc: 1 Oct 10 09:22:57.260: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00163ec60 exit status 1 <nil> <nil> true [0xc001c7e6a0 0xc001c7e748 0xc001c7e820] [0xc001c7e6a0 0xc001c7e748 0xc001c7e820] [0xc001c7e708 0xc001c7e7e8] [0x10f13d0 0x10f13d0] 0xc001fccfc0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:22:57.260: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970' Oct 10 09:23:01.098: INFO: rc: 1 Oct 10 09:23:01.098: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6048 execpodgttfc -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 31970] [] <nil> + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001649ad0 exit status 1 <nil> <nil> true [0xc000da7f20 0xc002758018 0xc002758038] [0xc000da7f20 0xc002758018 0xc002758038] [0xc002758008 0xc002758030] [0x10f13d0 0x10f13d0] 0xc0021a1020 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 31970 nc: connect to 54.233.88.138 port 31970 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:23:01.098: FAIL: Service is not reachable within 2m0s timeout on endpoint 54.233.88.138:31970 over TCP protocol Unexpected error: <*errors.errorString | 0xc0000d5090>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Oct 10 09:23:01.098: INFO: Cleaning up the ExternalName to NodePort test service [AfterEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Collecting events from namespace "services-6048". �[1mSTEP�[0m: Found 14 events. Oct 10 09:23:01.430: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for execpodgttfc: {default-scheduler } Scheduled: Successfully assigned services-6048/execpodgttfc to ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:23:01.430: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for externalname-service-h9pwc: {default-scheduler } Scheduled: Successfully assigned services-6048/externalname-service-h9pwc to ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:23:01.430: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for externalname-service-xcbxh: {default-scheduler } Scheduled: Successfully assigned services-6048/externalname-service-xcbxh to ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:23:01.430: INFO: At 2019-10-10 09:20:28 +0000 UTC - event for externalname-service: {replication-controller } SuccessfulCreate: Created pod: externalname-service-xcbxh Oct 10 09:23:01.430: INFO: At 2019-10-10 09:20:28 +0000 UTC - event for externalname-service: {replication-controller } SuccessfulCreate: Created pod: externalname-service-h9pwc Oct 10 09:23:01.430: INFO: At 2019-10-10 09:20:29 +0000 UTC - event for externalname-service-h9pwc: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:23:01.430: INFO: At 2019-10-10 09:20:29 +0000 UTC - event for externalname-service-h9pwc: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Created: Created container externalname-service Oct 10 09:23:01.430: INFO: At 2019-10-10 09:20:29 +0000 UTC - event for externalname-service-h9pwc: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Started: Started container externalname-service Oct 10 09:23:01.430: INFO: At 2019-10-10 09:20:29 +0000 UTC - event for externalname-service-xcbxh: {kubelet ip-172-20-56-86.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:23:01.430: INFO: At 2019-10-10 09:20:29 +0000 UTC - event for externalname-service-xcbxh: {kubelet ip-172-20-56-86.sa-east-1.compute.internal} Created: Created container externalname-service Oct 10 09:23:01.430: INFO: At 2019-10-10 09:20:29 +0000 UTC - event for externalname-service-xcbxh: {kubelet ip-172-20-56-86.sa-east-1.compute.internal} Started: Started container externalname-service Oct 10 09:23:01.430: INFO: At 2019-10-10 09:20:38 +0000 UTC - event for execpodgttfc: {kubelet ip-172-20-60-88.sa-east-1.compute.internal} Created: Created container agnhost-pause Oct 10 09:23:01.430: INFO: At 2019-10-10 09:20:38 +0000 UTC - event for execpodgttfc: {kubelet ip-172-20-60-88.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:23:01.430: INFO: At 2019-10-10 09:20:38 +0000 UTC - event for execpodgttfc: {kubelet ip-172-20-60-88.sa-east-1.compute.internal} Started: Started container agnhost-pause Oct 10 09:23:01.574: INFO: POD NODE PHASE GRACE CONDITIONS Oct 10 09:23:01.574: INFO: execpodgttfc ip-172-20-60-88.sa-east-1.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:20:37 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:20:39 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:20:39 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:20:37 +0000 UTC }] Oct 10 09:23:01.574: INFO: externalname-service-h9pwc ip-172-20-42-37.sa-east-1.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:20:28 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:20:30 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:20:30 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:20:28 +0000 UTC }] Oct 10 09:23:01.574: INFO: externalname-service-xcbxh ip-172-20-56-86.sa-east-1.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:20:28 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:20:30 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:20:30 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:20:28 +0000 UTC }] Oct 10 09:23:01.574: INFO: Oct 10 09:23:01.718: INFO: Logging node info for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:23:01.861: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-37-177.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-37-177.sa-east-1.compute.internal 8ecedabe-969e-476a-8f76-1fb03eedaa56 12263 0 2019-10-10 09:12:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c4.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:master-sa-east-1c kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-37-177.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master:] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-08fb35da4b2014f59,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3949572096 0} {<nil>} 3857004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3844714496 0} {<nil>} 3754604Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:12:53 +0000 UTC,LastTransitionTime:2019-10-10 09:12:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:22:05 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:22:05 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:22:05 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:22:05 +0000 UTC,LastTransitionTime:2019-10-10 09:12:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.177,},NodeAddress{Type:ExternalIP,Address:54.233.97.36,},NodeAddress{Type:Hostname,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-97-36.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:75a86a2fc8e747568f8cd25355ed4a43,SystemUUID:EC277240-730F-D89C-36D2-B12A43ABB39F,BootID:33b7c61a-9c83-42db-9541-8a26846b977a,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[kopeio/etcd-manager@sha256:cb0ed7c56dadbc0f4cd515906d72b30094229d6e0a9fcb7aa44e23680bf9a3a8 kopeio/etcd-manager:3.0.20190930],SizeBytes:656348817,},ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:260130533,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:205085998,},ContainerImage{Names:[kope/dns-controller@sha256:aca3878acdac85716e1317dd2fc85b235551068d667e578fceb9b0e8c3561324 kope/dns-controller:1.15.0-alpha.1],SizeBytes:120867125,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:103791294,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:23:01.862: INFO: Logging kubelet events for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:23:02.006: INFO: Logging pods the kubelet thinks is on node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:23:02.174: INFO: etcd-manager-main-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:02.174: INFO: Container etcd-manager ready: true, restart count 0 Oct 10 09:23:02.174: INFO: kube-apiserver-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:02.174: INFO: Container kube-apiserver ready: true, restart count 3 Oct 10 09:23:02.174: INFO: kube-controller-manager-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:02.174: INFO: Container kube-controller-manager ready: true, restart count 0 Oct 10 09:23:02.174: INFO: kube-proxy-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:02.174: INFO: Container kube-proxy ready: true, restart count 3 Oct 10 09:23:02.174: INFO: kube-scheduler-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:02.174: INFO: Container kube-scheduler ready: true, restart count 0 Oct 10 09:23:02.174: INFO: etcd-manager-events-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:02.174: INFO: Container etcd-manager ready: true, restart count 0 Oct 10 09:23:02.174: INFO: kops-controller-76f5d459f8-86j85 started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:02.174: INFO: Container kops-controller ready: true, restart count 0 Oct 10 09:23:02.174: INFO: dns-controller-78ccbffc6d-5pnmw started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:02.174: INFO: Container dns-controller ready: true, restart count 0 W1010 09:23:02.320767 893 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:23:02.619: INFO: Latency metrics for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:23:02.619: INFO: Logging node info for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:23:02.761: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-42-37.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-42-37.sa-east-1.compute.internal 8fb9f863-77f2-4451-ba99-614781c1c8bc 13468 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-42-37.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node mounted_volume_expand:mounted-volume-expand-8034 node-role.kubernetes.io/node:] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-020fda63f6b69c0ea,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:22:40 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:22:40 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:22:40 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:22:40 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.37,},NodeAddress{Type:ExternalIP,Address:54.233.88.138,},NodeAddress{Type:Hostname,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-88-138.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dbea17b1df4f4682b3aea8f7967a81f7,SystemUUID:EC276068-34A4-965C-3CB7-CA4BD3478D25,BootID:883b28de-249e-43a6-8e1c-705f97846842,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0fdd29053b527a7bf],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:23:02.762: INFO: Logging kubelet events for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:23:02.905: INFO: Logging pods the kubelet thinks is on node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:23:03.052: INFO: private started at 2019-10-10 09:22:00 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:03.052: INFO: Container cntr ready: true, restart count 0 Oct 10 09:23:03.052: INFO: hostexec-ip-172-20-42-37.sa-east-1.compute.internal-4t6kb started at 2019-10-10 09:22:38 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:03.052: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:23:03.052: INFO: externalname-service-h9pwc started at 2019-10-10 09:20:28 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:03.052: INFO: Container externalname-service ready: true, restart count 0 Oct 10 09:23:03.052: INFO: aws-injector started at 2019-10-10 09:22:26 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:03.052: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:23:03.052: INFO: nfs-client started at 2019-10-10 09:22:58 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:03.052: INFO: Container nfs-client ready: true, restart count 0 Oct 10 09:23:03.052: INFO: master started at 2019-10-10 09:21:53 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:03.052: INFO: Container cntr ready: true, restart count 0 Oct 10 09:23:03.052: INFO: busybox-host-aliases5c6fc059-68fe-4969-a26c-184d689d4487 started at 2019-10-10 09:22:58 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:03.052: INFO: Container busybox-host-aliases5c6fc059-68fe-4969-a26c-184d689d4487 ready: true, restart count 0 Oct 10 09:23:03.052: INFO: hostexec-ip-172-20-42-37.sa-east-1.compute.internal-fkr8s started at 2019-10-10 09:23:02 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:03.052: INFO: Container agnhost ready: false, restart count 0 Oct 10 09:23:03.052: INFO: kube-proxy-ip-172-20-42-37.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:03.053: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:23:03.053: INFO: sample-webhook-deployment-86d95b659d-cj4bv started at 2019-10-10 09:22:58 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:03.053: INFO: Container sample-webhook ready: true, restart count 0 Oct 10 09:23:03.053: INFO: default started at 2019-10-10 09:22:07 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:03.053: INFO: Container cntr ready: true, restart count 0 Oct 10 09:23:03.053: INFO: slave started at 2019-10-10 09:21:55 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:03.053: INFO: Container cntr ready: true, restart count 0 Oct 10 09:23:03.053: INFO: adopt-release-zc8hw started at 2019-10-10 09:22:39 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:03.053: INFO: Container c ready: true, restart count 0 Oct 10 09:23:03.053: INFO: busybox-eb3dfd57-1d5e-42c6-97cb-c209fa24db7a started at 2019-10-10 09:19:24 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:03.053: INFO: Container busybox ready: true, restart count 0 W1010 09:23:03.222152 893 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:23:03.596: INFO: Latency metrics for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:23:03.596: INFO: Logging node info for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:23:03.750: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-49-15.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-49-15.sa-east-1.compute.internal 105a0721-5b17-40b8-b686-ccf439f1ca2a 12817 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-49-15.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6677":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-6893":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-8860":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-9656":"ip-172-20-49-15.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-3724":"csi-mock-csi-mock-volumes-3724","csi-mock-csi-mock-volumes-7612":"csi-mock-csi-mock-volumes-7612","csi-mock-csi-mock-volumes-8888":"csi-mock-csi-mock-volumes-8888"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-056d95303ed61d881,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:22:20 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:22:20 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:22:20 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:22:20 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.49.15,},NodeAddress{Type:ExternalIP,Address:18.228.205.178,},NodeAddress{Type:Hostname,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-228-205-178.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f468c62663d2465ca17ba5284774252e,SystemUUID:EC23BE58-6EBA-E800-9C73-DEB3BAA2D1B9,BootID:6eb82ab7-2bd7-418a-ba22-36d3a808a22b,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0a7e954fc99cef255],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:23:03.752: INFO: Logging kubelet events for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:23:03.938: INFO: Logging pods the kubelet thinks is on node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:23:04.092: INFO: adopt-release-j5kmd started at 2019-10-10 09:22:45 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:04.093: INFO: Container c ready: true, restart count 0 Oct 10 09:23:04.093: INFO: hostexec-ip-172-20-49-15.sa-east-1.compute.internal-pbddl started at 2019-10-10 09:22:58 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:04.093: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:23:04.093: INFO: redis-master-qzdsm started at 2019-10-10 09:23:03 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:04.093: INFO: Container redis-master ready: false, restart count 0 Oct 10 09:23:04.093: INFO: sample-crd-conversion-webhook-deployment-64d485d9bb-58thk started at 2019-10-10 09:22:58 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:04.093: INFO: Container sample-crd-conversion-webhook ready: true, restart count 0 Oct 10 09:23:04.093: INFO: exec-volume-test-aws-preprovisionedpv-8sww started at 2019-10-10 09:18:17 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:04.093: INFO: Container exec-container-aws-preprovisionedpv-8sww ready: false, restart count 0 Oct 10 09:23:04.093: INFO: httpd started at 2019-10-10 09:22:47 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:04.093: INFO: Container httpd ready: true, restart count 0 Oct 10 09:23:04.093: INFO: failure-4 started at 2019-10-10 09:22:57 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:04.093: INFO: Container failure-4 ready: false, restart count 0 Oct 10 09:23:04.093: INFO: pod-0 started at 2019-10-10 09:22:55 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:04.093: INFO: Container busybox ready: true, restart count 0 Oct 10 09:23:04.093: INFO: local-client started at 2019-10-10 09:22:58 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:04.093: INFO: Container local-client ready: true, restart count 0 Oct 10 09:23:04.093: INFO: kube-proxy-ip-172-20-49-15.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:04.093: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:23:04.093: INFO: httpd started at 2019-10-10 09:22:30 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:04.093: INFO: Container httpd ready: true, restart count 0 Oct 10 09:23:04.093: INFO: hostexec-ip-172-20-49-15.sa-east-1.compute.internal-7fnjw started at 2019-10-10 09:22:18 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:04.093: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:23:04.093: INFO: adopt-release-lz55v started at 2019-10-10 09:22:39 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:04.093: INFO: Container c ready: true, restart count 0 Oct 10 09:23:04.093: INFO: success started at 2019-10-10 09:22:45 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:04.093: INFO: Container success ready: false, restart count 0 W1010 09:23:04.265523 893 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:23:04.580: INFO: Latency metrics for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:23:04.580: INFO: Logging node info for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:23:04.724: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-56-86.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-56-86.sa-east-1.compute.internal cccbef08-fa00-42b5-ae85-da8efe4ee848 13475 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-56-86.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9823":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volume-6196":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volumemode-1556":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-expand-9939":"ip-172-20-56-86.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-5777":"csi-mock-csi-mock-volumes-5777"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-0b5800b629bcb7519,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:22:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:22:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:22:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:22:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.86,},NodeAddress{Type:ExternalIP,Address:54.207.48.88,},NodeAddress{Type:Hostname,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-207-48-88.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:99be0b3f4ec34abb8f4f249d272797b5,SystemUUID:EC2EB353-C506-B251-A10A-9B28B752A967,BootID:e098fcb6-fca7-433b-9b9f-7e47386c5ca0,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6],SizeBytes:373099368,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:bbc3a03235220b170ba48a157dd097dd1379299370e1ed99ce976df0355d24f0 busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-023ab0ee87ab378fe kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0fca74ba579ef659f],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:23:04.725: INFO: Logging kubelet events for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:23:04.869: INFO: Logging pods the kubelet thinks is on node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:23:05.016: INFO: kube-proxy-ip-172-20-56-86.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.016: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:23:05.016: INFO: exec-volume-test-aws-zb5j started at 2019-10-10 09:18:56 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.016: INFO: Container exec-container-aws-zb5j ready: false, restart count 0 Oct 10 09:23:05.016: INFO: externalname-service-xcbxh started at 2019-10-10 09:20:28 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.016: INFO: Container externalname-service ready: true, restart count 0 Oct 10 09:23:05.016: INFO: csi-hostpath-provisioner-0 started at 2019-10-10 09:22:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.016: INFO: Container csi-provisioner ready: true, restart count 0 Oct 10 09:23:05.016: INFO: hostexec-ip-172-20-56-86.sa-east-1.compute.internal-7k8l6 started at 2019-10-10 09:22:59 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.016: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:23:05.016: INFO: csi-hostpathplugin-0 started at 2019-10-10 09:22:29 +0000 UTC (0+3 container statuses recorded) Oct 10 09:23:05.017: INFO: Container hostpath ready: true, restart count 0 Oct 10 09:23:05.017: INFO: Container liveness-probe ready: true, restart count 0 Oct 10 09:23:05.017: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 10 09:23:05.017: INFO: inline-volume-tester-844tc started at 2019-10-10 09:22:30 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.017: INFO: Container csi-volume-tester ready: true, restart count 0 Oct 10 09:23:05.017: INFO: nfs-server started at 2019-10-10 09:22:17 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.017: INFO: Container nfs-server ready: true, restart count 0 Oct 10 09:23:05.017: INFO: csi-hostpath-resizer-0 started at 2019-10-10 09:22:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.017: INFO: Container csi-resizer ready: true, restart count 0 Oct 10 09:23:05.017: INFO: aws-injector started at 2019-10-10 09:21:46 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.017: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:23:05.017: INFO: csi-hostpath-attacher-0 started at 2019-10-10 09:22:28 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.017: INFO: Container csi-attacher ready: true, restart count 0 Oct 10 09:23:05.017: INFO: csi-snapshotter-0 started at 2019-10-10 09:22:30 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.017: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 10 09:23:05.017: INFO: ss2-0 started at 2019-10-10 09:22:25 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.017: INFO: Container webserver ready: false, restart count 0 W1010 09:23:05.160928 893 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:23:05.501: INFO: Latency metrics for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:23:05.501: INFO: Logging node info for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:23:05.649: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-60-88.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-60-88.sa-east-1.compute.internal f5a2e6d3-a123-4acc-a9b2-8fa0a5c1c28f 13538 0 2019-10-10 09:14:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-60-88.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-8958":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-9423":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volume-expand-4947":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volumemode-4728":"ip-172-20-60-88.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-3882":"csi-mock-csi-mock-volumes-3882"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-087c9d5356d3aafe3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146278400 0} {<nil>} 4049100Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041420800 0} {<nil>} 3946700Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:13 +0000 UTC,LastTransitionTime:2019-10-10 09:14:13 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:22:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:22:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:22:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:22:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.88,},NodeAddress{Type:ExternalIP,Address:18.231.36.128,},NodeAddress{Type:Hostname,Address:ip-172-20-60-88.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-60-88.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-231-36-128.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4f6cfed0b3cc440c814a893a63590a26,SystemUUID:EC2CF3F1-2D60-B6EE-FE1D-D82FEFE80523,BootID:fcb35a82-1eda-4e12-88ea-2fc1cfa0c447,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6],SizeBytes:373099368,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:618a82fa66cf0c75e4753369a6999032372be7308866fc9afb381789b1e5ad52 k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13],SizeBytes:51157394,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:12370202895b621a2ac28226292e4578598f13c1502aa4d3ee90fff4325d9275 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.4.0],SizeBytes:45853555,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-sidecar-amd64@sha256:cedc8fe2098dffc26d17f64061296b7aa54258a31513b6c52df271a98bb522b3 k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.13],SizeBytes:42852039,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64@sha256:45df3e8e0c551bd0c79cdba48ae6677f817971dcbd1eeed7fd1f9a35118410e4 k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13],SizeBytes:41372492,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-004155116e0252475],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:23:05.650: INFO: Logging kubelet events for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:23:05.815: INFO: Logging pods the kubelet thinks is on node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:23:05.976: INFO: hostexec-ip-172-20-60-88.sa-east-1.compute.internal-8jt6w started at 2019-10-10 09:22:53 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.977: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:23:05.977: INFO: pod-subpath-test-downwardapi-zhj4 started at 2019-10-10 09:22:50 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.977: INFO: Container test-container-subpath-downwardapi-zhj4 ready: true, restart count 0 Oct 10 09:23:05.977: INFO: kube-dns-bb55d6458-g4ktr started at 2019-10-10 09:14:21 +0000 UTC (0+3 container statuses recorded) Oct 10 09:23:05.977: INFO: Container dnsmasq ready: true, restart count 0 Oct 10 09:23:05.977: INFO: Container kubedns ready: true, restart count 0 Oct 10 09:23:05.977: INFO: Container sidecar ready: true, restart count 0 Oct 10 09:23:05.977: INFO: hostexec-ip-172-20-60-88.sa-east-1.compute.internal-5d7cm started at 2019-10-10 09:22:45 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.977: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:23:05.977: INFO: kube-dns-bb55d6458-cx9kh started at 2019-10-10 09:14:29 +0000 UTC (0+3 container statuses recorded) Oct 10 09:23:05.977: INFO: Container dnsmasq ready: true, restart count 0 Oct 10 09:23:05.977: INFO: Container kubedns ready: true, restart count 0 Oct 10 09:23:05.977: INFO: Container sidecar ready: true, restart count 0 Oct 10 09:23:05.977: INFO: external-provisioner-r57j9 started at 2019-10-10 09:22:14 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.977: INFO: Container nfs-provisioner ready: true, restart count 0 Oct 10 09:23:05.977: INFO: aws-injector started at 2019-10-10 09:20:48 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.977: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:23:05.977: INFO: execpodgttfc started at 2019-10-10 09:20:37 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.977: INFO: Container agnhost-pause ready: true, restart count 0 Oct 10 09:23:05.977: INFO: failure-1 started at 2019-10-10 09:22:48 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.977: INFO: Container failure-1 ready: false, restart count 0 Oct 10 09:23:05.977: INFO: hostexec-ip-172-20-60-88.sa-east-1.compute.internal-7fjzv started at 2019-10-10 09:22:59 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.977: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:23:05.977: INFO: kube-proxy-ip-172-20-60-88.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.977: INFO: Container kube-proxy ready: true, restart count 1 Oct 10 09:23:05.977: INFO: kube-dns-autoscaler-66b775459-74nsm started at 2019-10-10 09:14:21 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.977: INFO: Container autoscaler ready: true, restart count 0 Oct 10 09:23:05.977: INFO: failure-2-bs7tk started at 2019-10-10 09:22:50 +0000 UTC (0+1 container statuses recorded) Oct 10 09:23:05.977: INFO: Container failure-2 ready: true, restart count 1 W1010 09:23:06.120584 893 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:23:06.468: INFO: Latency metrics for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:23:06.468: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "services-6048" for this suite. [AfterEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:95
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sServices\sshould\sbe\sable\sto\sswitch\ssession\saffinity\sfor\sNodePort\sservice\s\[LinuxOnly\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1779 Oct 10 09:35:56.165: Service is not reachable within 2m0s timeout on endpoint 54.233.88.138:32094 over TCP protocol Unexpected error: <*errors.errorString | 0xc0000a10a0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/service/jig.go:795from junit_20.xml
[BeforeEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:150 �[1mSTEP�[0m: Creating a kubernetes client Oct 10 09:33:32.369: INFO: >>> kubeConfig: /tmp/kops104699295/kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename services �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:91 [It] should be able to switch session affinity for NodePort service [LinuxOnly] /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1779 �[1mSTEP�[0m: creating service in namespace services-1570 �[1mSTEP�[0m: creating service affinity-nodeport-transition in namespace services-1570 �[1mSTEP�[0m: creating replication controller affinity-nodeport-transition in namespace services-1570 I1010 09:33:33.332162 872 runners.go:189] Created replication controller with name: affinity-nodeport-transition, namespace: services-1570, replica count: 3 I1010 09:33:36.482684 872 runners.go:189] affinity-nodeport-transition Pods: 3 out of 3 created, 3 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Oct 10 09:33:36.913: INFO: Creating new exec pod Oct 10 09:33:40.486: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 affinity-nodeport-transition 80' Oct 10 09:33:42.256: INFO: stderr: "+ nc -zv -t -w 2 affinity-nodeport-transition 80\nConnection to affinity-nodeport-transition 80 port [tcp/http] succeeded!\n" Oct 10 09:33:42.256: INFO: stdout: "" Oct 10 09:33:42.257: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 100.65.25.173 80' Oct 10 09:33:44.050: INFO: stderr: "+ nc -zv -t -w 2 100.65.25.173 80\nConnection to 100.65.25.173 80 port [tcp/http] succeeded!\n" Oct 10 09:33:44.050: INFO: stdout: "" Oct 10 09:33:44.050: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 172.20.42.37 32094' Oct 10 09:33:45.832: INFO: stderr: "+ nc -zv -t -w 2 172.20.42.37 32094\nConnection to 172.20.42.37 32094 port [tcp/32094] succeeded!\n" Oct 10 09:33:45.832: INFO: stdout: "" Oct 10 09:33:45.832: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 172.20.60.88 32094' Oct 10 09:33:47.651: INFO: stderr: "+ nc -zv -t -w 2 172.20.60.88 32094\nConnection to 172.20.60.88 32094 port [tcp/32094] succeeded!\n" Oct 10 09:33:47.651: INFO: stdout: "" Oct 10 09:33:47.651: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:33:51.547: INFO: rc: 1 Oct 10 09:33:51.547: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00228cba0 exit status 1 <nil> <nil> true [0xc0025710d0 0xc0025710e8 0xc002571118] [0xc0025710d0 0xc0025710e8 0xc002571118] [0xc0025710e0 0xc002571100] [0x10f13d0 0x10f13d0] 0xc004419560 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:33:52.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:33:56.309: INFO: rc: 1 Oct 10 09:33:56.309: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0020dccc0 exit status 1 <nil> <nil> true [0xc001ba4dc0 0xc001ba4ea0 0xc001ba4f70] [0xc001ba4dc0 0xc001ba4ea0 0xc001ba4f70] [0xc001ba4e08 0xc001ba4f30] [0x10f13d0 0x10f13d0] 0xc0022c4b40 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:33:56.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:34:00.311: INFO: rc: 1 Oct 10 09:34:00.311: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0020dd560 exit status 1 <nil> <nil> true [0xc001ba5000 0xc001ba5070 0xc001ba5100] [0xc001ba5000 0xc001ba5070 0xc001ba5100] [0xc001ba5068 0xc001ba50e8] [0x10f13d0 0x10f13d0] 0xc0022c5200 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:34:00.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:34:04.337: INFO: rc: 1 Oct 10 09:34:04.337: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0020dde00 exit status 1 <nil> <nil> true [0xc001ba5120 0xc001ba51c0 0xc001ba5288] [0xc001ba5120 0xc001ba51c0 0xc001ba5288] [0xc001ba5158 0xc001ba5240] [0x10f13d0 0x10f13d0] 0xc0022c5800 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:34:04.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:34:08.416: INFO: rc: 1 Oct 10 09:34:08.416: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00228d470 exit status 1 <nil> <nil> true [0xc002571120 0xc002571138 0xc002571158] [0xc002571120 0xc002571138 0xc002571158] [0xc002571130 0xc002571150] [0x10f13d0 0x10f13d0] 0xc0044198c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:34:08.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:34:12.333: INFO: rc: 1 Oct 10 09:34:12.333: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00228dce0 exit status 1 <nil> <nil> true [0xc002571160 0xc002571178 0xc002571190] [0xc002571160 0xc002571178 0xc002571190] [0xc002571170 0xc002571188] [0x10f13d0 0x10f13d0] 0xc004419bc0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:34:12.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:34:16.367: INFO: rc: 1 Oct 10 09:34:16.368: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00224c6f0 exit status 1 <nil> <nil> true [0xc001ba52f0 0xc001ba53a0 0xc001ba5490] [0xc001ba52f0 0xc001ba53a0 0xc001ba5490] [0xc001ba5338 0xc001ba5470] [0x10f13d0 0x10f13d0] 0xc00097a060 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:34:16.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:34:20.369: INFO: rc: 1 Oct 10 09:34:20.369: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00228a5a0 exit status 1 <nil> <nil> true [0xc002571198 0xc0025711b0 0xc0025711c8] [0xc002571198 0xc0025711b0 0xc0025711c8] [0xc0025711a8 0xc0025711c0] [0x10f13d0 0x10f13d0] 0xc004419f20 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:34:20.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:34:24.409: INFO: rc: 1 Oct 10 09:34:24.409: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00228ae10 exit status 1 <nil> <nil> true [0xc0025711d0 0xc0025711e8 0xc002571200] [0xc0025711d0 0xc0025711e8 0xc002571200] [0xc0025711e0 0xc0025711f8] [0x10f13d0 0x10f13d0] 0xc002e5c060 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:34:24.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:34:28.376: INFO: rc: 1 Oct 10 09:34:28.376: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00228b6b0 exit status 1 <nil> <nil> true [0xc002571208 0xc002571220 0xc002571238] [0xc002571208 0xc002571220 0xc002571238] [0xc002571218 0xc002571230] [0x10f13d0 0x10f13d0] 0xc002e5c420 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:34:28.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:34:32.333: INFO: rc: 1 Oct 10 09:34:32.333: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0022ca390 exit status 1 <nil> <nil> true [0xc0022849e0 0xc002284a00 0xc002284a70] [0xc0022849e0 0xc002284a00 0xc002284a70] [0xc0022849f8 0xc002284a58] [0x10f13d0 0x10f13d0] 0xc002460180 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:34:32.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:34:36.343: INFO: rc: 1 Oct 10 09:34:36.343: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00228bf50 exit status 1 <nil> <nil> true [0xc002571240 0xc002571258 0xc002571270] [0xc002571240 0xc002571258 0xc002571270] [0xc002571250 0xc002571268] [0x10f13d0 0x10f13d0] 0xc002e5c960 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:34:36.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:34:40.489: INFO: rc: 1 Oct 10 09:34:40.489: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00224cf90 exit status 1 <nil> <nil> true [0xc001ba54c0 0xc001ba5750 0xc001ba5888] [0xc001ba54c0 0xc001ba5750 0xc001ba5888] [0xc001ba5628 0xc001ba5880] [0x10f13d0 0x10f13d0] 0xc00097a540 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:34:40.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:34:44.322: INFO: rc: 1 Oct 10 09:34:44.322: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00224d830 exit status 1 <nil> <nil> true [0xc001ba5900 0xc001ba5960 0xc001ba59e0] [0xc001ba5900 0xc001ba5960 0xc001ba59e0] [0xc001ba5950 0xc001ba59a8] [0x10f13d0 0x10f13d0] 0xc00097aa80 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:34:44.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:34:48.404: INFO: rc: 1 Oct 10 09:34:48.404: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0023280f0 exit status 1 <nil> <nil> true [0xc001ba59e8 0xc001ba5a48 0xc001ba5b70] [0xc001ba59e8 0xc001ba5a48 0xc001ba5b70] [0xc001ba5a00 0xc001ba5af8] [0x10f13d0 0x10f13d0] 0xc00097ad80 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:34:48.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:34:52.376: INFO: rc: 1 Oct 10 09:34:52.377: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002338810 exit status 1 <nil> <nil> true [0xc002571278 0xc002571290 0xc0025712a8] [0xc002571278 0xc002571290 0xc0025712a8] [0xc002571288 0xc0025712a0] [0x10f13d0 0x10f13d0] 0xc002e5cc60 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:34:52.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:34:56.325: INFO: rc: 1 Oct 10 09:34:56.326: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0023390b0 exit status 1 <nil> <nil> true [0xc0025712b0 0xc0025712c8 0xc0025712e0] [0xc0025712b0 0xc0025712c8 0xc0025712e0] [0xc0025712c0 0xc0025712d8] [0x10f13d0 0x10f13d0] 0xc002e5cf60 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:34:56.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:35:00.344: INFO: rc: 1 Oct 10 09:35:00.344: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002339950 exit status 1 <nil> <nil> true [0xc0025712e8 0xc002571300 0xc002571318] [0xc0025712e8 0xc002571300 0xc002571318] [0xc0025712f8 0xc002571310] [0x10f13d0 0x10f13d0] 0xc002e5d260 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:35:00.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:35:04.441: INFO: rc: 1 Oct 10 09:35:04.441: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0022cac60 exit status 1 <nil> <nil> true [0xc002284a88 0xc002284b08 0xc002284b60] [0xc002284a88 0xc002284b08 0xc002284b60] [0xc002284af8 0xc002284b40] [0x10f13d0 0x10f13d0] 0xc002bce240 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:35:04.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:35:08.352: INFO: rc: 1 Oct 10 09:35:08.352: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0022cb4d0 exit status 1 <nil> <nil> true [0xc002284ba8 0xc002284c78 0xc002284d40] [0xc002284ba8 0xc002284c78 0xc002284d40] [0xc002284c58 0xc002284cf0] [0x10f13d0 0x10f13d0] 0xc002bce8a0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:35:08.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:35:12.355: INFO: rc: 1 Oct 10 09:35:12.355: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00240a240 exit status 1 <nil> <nil> true [0xc002571320 0xc002571338 0xc002571350] [0xc002571320 0xc002571338 0xc002571350] [0xc002571330 0xc002571348] [0x10f13d0 0x10f13d0] 0xc002e5d5c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:35:12.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:35:16.330: INFO: rc: 1 Oct 10 09:35:16.330: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002290870 exit status 1 <nil> <nil> true [0xc001f90008 0xc001f90050 0xc001f900f8] [0xc001f90008 0xc001f90050 0xc001f900f8] [0xc001f90038 0xc001f900f0] [0x10f13d0 0x10f13d0] 0xc002a3a540 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:35:16.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:35:20.329: INFO: rc: 1 Oct 10 09:35:20.329: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00240ab10 exit status 1 <nil> <nil> true [0xc002571358 0xc002571370 0xc002571388] [0xc002571358 0xc002571370 0xc002571388] [0xc002571368 0xc002571380] [0x10f13d0 0x10f13d0] 0xc002e5dbc0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:35:20.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:35:24.348: INFO: rc: 1 Oct 10 09:35:24.348: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002291110 exit status 1 <nil> <nil> true [0xc001f90118 0xc001f90198 0xc001f90258] [0xc001f90118 0xc001f90198 0xc001f90258] [0xc001f90190 0xc001f901e8] [0x10f13d0 0x10f13d0] 0xc002a3ab40 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:35:24.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:35:28.356: INFO: rc: 1 Oct 10 09:35:28.356: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0022919b0 exit status 1 <nil> <nil> true [0xc001f90268 0xc001f902f8 0xc001f903a8] [0xc001f90268 0xc001f902f8 0xc001f903a8] [0xc001f902a0 0xc001f90358] [0x10f13d0 0x10f13d0] 0xc002a3b140 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:35:28.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:35:32.323: INFO: rc: 1 Oct 10 09:35:32.323: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0022cbd40 exit status 1 <nil> <nil> true [0xc002284d70 0xc002284dd0 0xc002284e10] [0xc002284d70 0xc002284dd0 0xc002284e10] [0xc002284db8 0xc002284e00] [0x10f13d0 0x10f13d0] 0xc002bcefc0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:35:32.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:35:36.327: INFO: rc: 1 Oct 10 09:35:36.327: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0019d4990 exit status 1 <nil> <nil> true [0xc00303c008 0xc00303c020 0xc00303c038] [0xc00303c008 0xc00303c020 0xc00303c038] [0xc00303c018 0xc00303c030] [0x10f13d0 0x10f13d0] 0xc0022c4480 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:35:36.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:35:40.336: INFO: rc: 1 Oct 10 09:35:40.336: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0019d5230 exit status 1 <nil> <nil> true [0xc00303c040 0xc00303c060 0xc00303c078] [0xc00303c040 0xc00303c060 0xc00303c078] [0xc00303c058 0xc00303c070] [0x10f13d0 0x10f13d0] 0xc0022c4c00 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:35:40.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:35:44.328: INFO: rc: 1 Oct 10 09:35:44.328: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0066618c0 exit status 1 <nil> <nil> true [0xc0032c4008 0xc0032c4048 0xc0032c4060] [0xc0032c4008 0xc0032c4048 0xc0032c4060] [0xc0032c4040 0xc0032c4058] [0x10f13d0 0x10f13d0] 0xc002ffcf60 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:35:44.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:35:48.419: INFO: rc: 1 Oct 10 09:35:48.419: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0019d5b00 exit status 1 <nil> <nil> true [0xc00303c080 0xc00303c098 0xc00303c0b8] [0xc00303c080 0xc00303c098 0xc00303c0b8] [0xc00303c090 0xc00303c0a8] [0x10f13d0 0x10f13d0] 0xc0022c5200 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:35:48.548: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:35:52.329: INFO: rc: 1 Oct 10 09:35:52.329: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc004c103c0 exit status 1 <nil> <nil> true [0xc00303c0d0 0xc00303c100 0xc00303c118] [0xc00303c0d0 0xc00303c100 0xc00303c118] [0xc00303c0f0 0xc00303c110] [0x10f13d0 0x10f13d0] 0xc0022c5800 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:35:52.329: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094' Oct 10 09:35:56.165: INFO: rc: 1 Oct 10 09:35:56.165: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-1570 execpod-affinityjxvsq -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32094] [] <nil> + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc004c10c60 exit status 1 <nil> <nil> true [0xc00303c140 0xc00303c198 0xc00303c1e0] [0xc00303c140 0xc00303c198 0xc00303c1e0] [0xc00303c180 0xc00303c1c8] [0x10f13d0 0x10f13d0] 0xc001c4de00 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32094 nc: connect to 54.233.88.138 port 32094 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:35:56.165: FAIL: Service is not reachable within 2m0s timeout on endpoint 54.233.88.138:32094 over TCP protocol Unexpected error: <*errors.errorString | 0xc0000a10a0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Oct 10 09:35:56.165: INFO: Cleaning up the exec pod �[1mSTEP�[0m: deleting ReplicationController affinity-nodeport-transition in namespace services-1570, will wait for the garbage collector to delete the pods Oct 10 09:35:56.749: INFO: Deleting ReplicationController affinity-nodeport-transition took: 143.950397ms Oct 10 09:35:56.849: INFO: Terminating ReplicationController affinity-nodeport-transition pods took: 100.27913ms [AfterEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Collecting events from namespace "services-1570". �[1mSTEP�[0m: Found 24 events. Oct 10 09:36:07.252: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-transition-8tpj5: {default-scheduler } Scheduled: Successfully assigned services-1570/affinity-nodeport-transition-8tpj5 to ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:36:07.252: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-transition-hd92w: {default-scheduler } Scheduled: Successfully assigned services-1570/affinity-nodeport-transition-hd92w to ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:36:07.252: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-transition-pkt6h: {default-scheduler } Scheduled: Successfully assigned services-1570/affinity-nodeport-transition-pkt6h to ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:36:07.252: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for execpod-affinityjxvsq: {default-scheduler } Scheduled: Successfully assigned services-1570/execpod-affinityjxvsq to ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:36:07.252: INFO: At 2019-10-10 09:33:33 +0000 UTC - event for affinity-nodeport-transition: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-transition-8tpj5 Oct 10 09:36:07.252: INFO: At 2019-10-10 09:33:33 +0000 UTC - event for affinity-nodeport-transition: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-transition-pkt6h Oct 10 09:36:07.252: INFO: At 2019-10-10 09:33:33 +0000 UTC - event for affinity-nodeport-transition: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-transition-hd92w Oct 10 09:36:07.252: INFO: At 2019-10-10 09:33:34 +0000 UTC - event for affinity-nodeport-transition-8tpj5: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Started: Started container affinity-nodeport-transition Oct 10 09:36:07.252: INFO: At 2019-10-10 09:33:34 +0000 UTC - event for affinity-nodeport-transition-8tpj5: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Created: Created container affinity-nodeport-transition Oct 10 09:36:07.252: INFO: At 2019-10-10 09:33:34 +0000 UTC - event for affinity-nodeport-transition-8tpj5: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:36:07.252: INFO: At 2019-10-10 09:33:34 +0000 UTC - event for affinity-nodeport-transition-hd92w: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:36:07.252: INFO: At 2019-10-10 09:33:34 +0000 UTC - event for affinity-nodeport-transition-hd92w: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Started: Started container affinity-nodeport-transition Oct 10 09:36:07.252: INFO: At 2019-10-10 09:33:34 +0000 UTC - event for affinity-nodeport-transition-hd92w: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Created: Created container affinity-nodeport-transition Oct 10 09:36:07.252: INFO: At 2019-10-10 09:33:34 +0000 UTC - event for affinity-nodeport-transition-pkt6h: {kubelet ip-172-20-60-88.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:36:07.252: INFO: At 2019-10-10 09:33:34 +0000 UTC - event for affinity-nodeport-transition-pkt6h: {kubelet ip-172-20-60-88.sa-east-1.compute.internal} Started: Started container affinity-nodeport-transition Oct 10 09:36:07.252: INFO: At 2019-10-10 09:33:34 +0000 UTC - event for affinity-nodeport-transition-pkt6h: {kubelet ip-172-20-60-88.sa-east-1.compute.internal} Created: Created container affinity-nodeport-transition Oct 10 09:36:07.252: INFO: At 2019-10-10 09:33:37 +0000 UTC - event for execpod-affinityjxvsq: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Started: Started container agnhost-pause Oct 10 09:36:07.252: INFO: At 2019-10-10 09:33:37 +0000 UTC - event for execpod-affinityjxvsq: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:36:07.252: INFO: At 2019-10-10 09:33:37 +0000 UTC - event for execpod-affinityjxvsq: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Created: Created container agnhost-pause Oct 10 09:36:07.252: INFO: At 2019-10-10 09:35:56 +0000 UTC - event for affinity-nodeport-transition: {endpoint-controller } FailedToUpdateEndpoint: Failed to update endpoint services-1570/affinity-nodeport-transition: Operation cannot be fulfilled on endpoints "affinity-nodeport-transition": the object has been modified; please apply your changes to the latest version and try again Oct 10 09:36:07.252: INFO: At 2019-10-10 09:35:56 +0000 UTC - event for affinity-nodeport-transition-8tpj5: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Killing: Stopping container affinity-nodeport-transition Oct 10 09:36:07.252: INFO: At 2019-10-10 09:35:56 +0000 UTC - event for affinity-nodeport-transition-hd92w: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Killing: Stopping container affinity-nodeport-transition Oct 10 09:36:07.252: INFO: At 2019-10-10 09:35:56 +0000 UTC - event for affinity-nodeport-transition-pkt6h: {kubelet ip-172-20-60-88.sa-east-1.compute.internal} Killing: Stopping container affinity-nodeport-transition Oct 10 09:36:07.252: INFO: At 2019-10-10 09:35:56 +0000 UTC - event for execpod-affinityjxvsq: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Killing: Stopping container agnhost-pause Oct 10 09:36:07.394: INFO: POD NODE PHASE GRACE CONDITIONS Oct 10 09:36:07.395: INFO: Oct 10 09:36:07.538: INFO: Logging node info for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:36:07.680: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-37-177.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-37-177.sa-east-1.compute.internal 8ecedabe-969e-476a-8f76-1fb03eedaa56 36482 0 2019-10-10 09:12:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c4.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:master-sa-east-1c kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-37-177.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master:] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-08fb35da4b2014f59,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3949572096 0} {<nil>} 3857004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3844714496 0} {<nil>} 3754604Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:12:53 +0000 UTC,LastTransitionTime:2019-10-10 09:12:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:36:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:36:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:36:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:36:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.177,},NodeAddress{Type:ExternalIP,Address:54.233.97.36,},NodeAddress{Type:Hostname,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-97-36.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:75a86a2fc8e747568f8cd25355ed4a43,SystemUUID:EC277240-730F-D89C-36D2-B12A43ABB39F,BootID:33b7c61a-9c83-42db-9541-8a26846b977a,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[kopeio/etcd-manager@sha256:cb0ed7c56dadbc0f4cd515906d72b30094229d6e0a9fcb7aa44e23680bf9a3a8 kopeio/etcd-manager:3.0.20190930],SizeBytes:656348817,},ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:260130533,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:205085998,},ContainerImage{Names:[kope/dns-controller@sha256:aca3878acdac85716e1317dd2fc85b235551068d667e578fceb9b0e8c3561324 kope/dns-controller:1.15.0-alpha.1],SizeBytes:120867125,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:103791294,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:36:07.681: INFO: Logging kubelet events for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:36:07.825: INFO: Logging pods the kubelet thinks is on node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:36:07.970: INFO: kube-controller-manager-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:07.970: INFO: Container kube-controller-manager ready: true, restart count 0 Oct 10 09:36:07.970: INFO: kube-proxy-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:07.970: INFO: Container kube-proxy ready: true, restart count 3 Oct 10 09:36:07.970: INFO: kube-scheduler-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:07.970: INFO: Container kube-scheduler ready: true, restart count 0 Oct 10 09:36:07.970: INFO: etcd-manager-events-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:07.970: INFO: Container etcd-manager ready: true, restart count 0 Oct 10 09:36:07.970: INFO: kops-controller-76f5d459f8-86j85 started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:07.970: INFO: Container kops-controller ready: true, restart count 0 Oct 10 09:36:07.970: INFO: dns-controller-78ccbffc6d-5pnmw started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:07.970: INFO: Container dns-controller ready: true, restart count 0 Oct 10 09:36:07.970: INFO: etcd-manager-main-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:07.970: INFO: Container etcd-manager ready: true, restart count 0 Oct 10 09:36:07.970: INFO: kube-apiserver-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:07.970: INFO: Container kube-apiserver ready: true, restart count 3 W1010 09:36:08.114699 872 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:36:08.415: INFO: Latency metrics for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:36:08.415: INFO: Logging node info for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:36:08.558: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-42-37.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-42-37.sa-east-1.compute.internal 8fb9f863-77f2-4451-ba99-614781c1c8bc 36408 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-42-37.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node mounted_volume_expand:mounted-volume-expand-8034 node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-1205":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-4356":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-volume-expand-3381":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-volume-expand-4923":"ip-172-20-42-37.sa-east-1.compute.internal"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-020fda63f6b69c0ea,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:35:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.37,},NodeAddress{Type:ExternalIP,Address:54.233.88.138,},NodeAddress{Type:Hostname,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-88-138.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dbea17b1df4f4682b3aea8f7967a81f7,SystemUUID:EC276068-34A4-965C-3CB7-CA4BD3478D25,BootID:883b28de-249e-43a6-8e1c-705f97846842,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa k8s.gcr.io/etcd:3.3.15],SizeBytes:246640776,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:1bafcc6fb1aa990b487850adba9cadc020e42d7905aa8a30481182a477ba24b0 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.10],SizeBytes:61365829,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:4206620,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:fe301db49df08c384001ed752dff6d52b4305a73a7f608f21528048e8a08b51e busybox:latest],SizeBytes:1219782,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:36:08.558: INFO: Logging kubelet events for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:36:08.702: INFO: Logging pods the kubelet thinks is on node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:36:08.846: INFO: kube-proxy-ip-172-20-42-37.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:08.846: INFO: Container kube-proxy ready: true, restart count 2 W1010 09:36:08.992293 872 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:36:09.301: INFO: Latency metrics for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:36:09.301: INFO: Logging node info for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:36:09.444: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-49-15.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-49-15.sa-east-1.compute.internal 105a0721-5b17-40b8-b686-ccf439f1ca2a 36208 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-49-15.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6677":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-ephemeral-8821":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-1913":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-6893":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-8860":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-9656":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-5356":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-5574":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-6407":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-volume-expand-3873":"ip-172-20-49-15.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-3724":"csi-mock-csi-mock-volumes-3724","csi-mock-csi-mock-volumes-4205":"csi-mock-csi-mock-volumes-4205","csi-mock-csi-mock-volumes-4873":"csi-mock-csi-mock-volumes-4873","csi-mock-csi-mock-volumes-7612":"csi-mock-csi-mock-volumes-7612","csi-mock-csi-mock-volumes-8888":"csi-mock-csi-mock-volumes-8888"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-056d95303ed61d881,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:35:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.49.15,},NodeAddress{Type:ExternalIP,Address:18.228.205.178,},NodeAddress{Type:Hostname,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-228-205-178.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f468c62663d2465ca17ba5284774252e,SystemUUID:EC23BE58-6EBA-E800-9C73-DEB3BAA2D1B9,BootID:6eb82ab7-2bd7-418a-ba22-36d3a808a22b,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/google-containers/debian-base@sha256:6966a0aedd7592c18ff2dd803c08bd85780ee19f5e3a2e7cf908a4cd837afcde gcr.io/google-containers/debian-base:0.4.1],SizeBytes:42323657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[alpine@sha256:8421d9a84432575381bfabd248f1eb56f3aa21d9d7cd2511583c68c9b7511d10 alpine:3.7],SizeBytes:4206494,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-085f849e64e02110d kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0b0fa084d8405fe9e kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0caeace51988095bb],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:36:09.445: INFO: Logging kubelet events for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:36:09.589: INFO: Logging pods the kubelet thinks is on node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:36:09.733: INFO: aws-injector started at 2019-10-10 09:30:35 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:09.733: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:36:09.733: INFO: aws-injector started at 2019-10-10 09:32:03 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:09.733: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:36:09.733: INFO: aws-injector started at 2019-10-10 09:33:45 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:09.733: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:36:09.733: INFO: kube-proxy-ip-172-20-49-15.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:09.733: INFO: Container kube-proxy ready: true, restart count 2 W1010 09:36:09.877293 872 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:36:10.191: INFO: Latency metrics for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:36:10.191: INFO: Logging node info for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:36:10.334: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-56-86.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-56-86.sa-east-1.compute.internal cccbef08-fa00-42b5-ae85-da8efe4ee848 36337 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-56-86.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9823":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-provisioning-5677":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-1005":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-1516":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-6492":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volume-6196":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volumemode-1556":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-1749":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-8804":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-expand-9939":"ip-172-20-56-86.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-5777":"csi-mock-csi-mock-volumes-5777","csi-mock-csi-mock-volumes-6825":"csi-mock-csi-mock-volumes-6825","csi-mock-csi-mock-volumes-7201":"csi-mock-csi-mock-volumes-7201","csi-mock-csi-mock-volumes-8231":"csi-mock-csi-mock-volumes-8231"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-0b5800b629bcb7519,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:35:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.86,},NodeAddress{Type:ExternalIP,Address:54.207.48.88,},NodeAddress{Type:Hostname,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-207-48-88.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:99be0b3f4ec34abb8f4f249d272797b5,SystemUUID:EC2EB353-C506-B251-A10A-9B28B752A967,BootID:e098fcb6-fca7-433b-9b9f-7e47386c5ca0,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 gluster/glusterdynamic-provisioner:v1.0],SizeBytes:373281573,},ContainerImage{Names:[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6],SizeBytes:373099368,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:bbc3a03235220b170ba48a157dd097dd1379299370e1ed99ce976df0355d24f0 busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-028b66335e31eaf4f kubernetes.io/aws-ebs/aws://sa-east-1c/vol-05da71c2f70c6d1e3 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0765fb05bdb37f4b5 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0f597dc8d7319d060],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:36:10.335: INFO: Logging kubelet events for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:36:10.479: INFO: Logging pods the kubelet thinks is on node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:36:10.624: INFO: aws-injector started at 2019-10-10 09:28:01 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:10.624: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:36:10.624: INFO: exec-volume-test-aws-4jlf started at 2019-10-10 09:31:15 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:10.624: INFO: Container exec-container-aws-4jlf ready: false, restart count 0 Oct 10 09:36:10.624: INFO: kube-proxy-ip-172-20-56-86.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:10.624: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:36:10.624: INFO: aws-injector started at 2019-10-10 09:31:17 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:10.624: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:36:10.624: INFO: exec-volume-test-aws-preprovisionedpv-j99q started at 2019-10-10 09:32:17 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:10.624: INFO: Container exec-container-aws-preprovisionedpv-j99q ready: false, restart count 0 W1010 09:36:10.768152 872 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:36:11.079: INFO: Latency metrics for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:36:11.079: INFO: Logging node info for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:36:11.221: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-60-88.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-60-88.sa-east-1.compute.internal f5a2e6d3-a123-4acc-a9b2-8fa0a5c1c28f 36420 0 2019-10-10 09:14:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-60-88.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4801":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-provisioning-2176":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-provisioning-8958":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-9423":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volume-expand-4947":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volume-expand-6712":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volumemode-1292":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volumemode-4728":"ip-172-20-60-88.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-3023":"csi-mock-csi-mock-volumes-3023","csi-mock-csi-mock-volumes-3750":"csi-mock-csi-mock-volumes-3750","csi-mock-csi-mock-volumes-3882":"csi-mock-csi-mock-volumes-3882","csi-mock-csi-mock-volumes-5042":"csi-mock-csi-mock-volumes-5042","csi-mock-csi-mock-volumes-6797":"csi-mock-csi-mock-volumes-6797"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-087c9d5356d3aafe3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146278400 0} {<nil>} 4049100Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041420800 0} {<nil>} 3946700Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:13 +0000 UTC,LastTransitionTime:2019-10-10 09:14:13 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:35:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:35:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.88,},NodeAddress{Type:ExternalIP,Address:18.231.36.128,},NodeAddress{Type:Hostname,Address:ip-172-20-60-88.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-60-88.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-231-36-128.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4f6cfed0b3cc440c814a893a63590a26,SystemUUID:EC2CF3F1-2D60-B6EE-FE1D-D82FEFE80523,BootID:fcb35a82-1eda-4e12-88ea-2fc1cfa0c447,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6],SizeBytes:373099368,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:618a82fa66cf0c75e4753369a6999032372be7308866fc9afb381789b1e5ad52 k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13],SizeBytes:51157394,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:12370202895b621a2ac28226292e4578598f13c1502aa4d3ee90fff4325d9275 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.4.0],SizeBytes:45853555,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-sidecar-amd64@sha256:cedc8fe2098dffc26d17f64061296b7aa54258a31513b6c52df271a98bb522b3 k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.13],SizeBytes:42852039,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64@sha256:45df3e8e0c551bd0c79cdba48ae6677f817971dcbd1eeed7fd1f9a35118410e4 k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13],SizeBytes:41372492,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0559eda2818e41891 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0fac33f38a006d601],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:36:11.222: INFO: Logging kubelet events for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:36:11.366: INFO: Logging pods the kubelet thinks is on node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:36:11.511: INFO: aws-injector started at 2019-10-10 09:32:35 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:11.511: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:36:11.511: INFO: kube-proxy-ip-172-20-60-88.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:11.511: INFO: Container kube-proxy ready: true, restart count 1 Oct 10 09:36:11.511: INFO: kube-dns-autoscaler-66b775459-74nsm started at 2019-10-10 09:14:21 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:11.511: INFO: Container autoscaler ready: true, restart count 0 Oct 10 09:36:11.511: INFO: pod-projected-configmaps-b96a2f31-9ea1-4ab5-aab3-96392e782102 started at 2019-10-10 09:34:28 +0000 UTC (0+3 container statuses recorded) Oct 10 09:36:11.511: INFO: Container createcm-volume-test ready: false, restart count 0 Oct 10 09:36:11.511: INFO: Container delcm-volume-test ready: false, restart count 0 Oct 10 09:36:11.511: INFO: Container updcm-volume-test ready: false, restart count 0 Oct 10 09:36:11.511: INFO: aws-injector started at 2019-10-10 09:31:02 +0000 UTC (0+1 container statuses recorded) Oct 10 09:36:11.511: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:36:11.511: INFO: kube-dns-bb55d6458-g4ktr started at 2019-10-10 09:14:21 +0000 UTC (0+3 container statuses recorded) Oct 10 09:36:11.511: INFO: Container dnsmasq ready: true, restart count 0 Oct 10 09:36:11.511: INFO: Container kubedns ready: true, restart count 0 Oct 10 09:36:11.511: INFO: Container sidecar ready: true, restart count 0 Oct 10 09:36:11.511: INFO: kube-dns-bb55d6458-cx9kh started at 2019-10-10 09:14:29 +0000 UTC (0+3 container statuses recorded) Oct 10 09:36:11.511: INFO: Container dnsmasq ready: true, restart count 0 Oct 10 09:36:11.511: INFO: Container kubedns ready: true, restart count 0 Oct 10 09:36:11.511: INFO: Container sidecar ready: true, restart count 0 W1010 09:36:11.654772 872 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:36:11.974: INFO: Latency metrics for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:36:11.974: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "services-1570" for this suite. [AfterEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:95
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sServices\sshould\sbe\sable\sto\sswitch\ssession\saffinity\sfor\sNodePort\sservice\s\[LinuxOnly\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1779 Oct 10 09:33:15.848: Service is not reachable within 2m0s timeout on endpoint 18.228.205.178:30943 over TCP protocol Unexpected error: <*errors.errorString | 0xc0000a10a0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/service/jig.go:795from junit_20.xml
[BeforeEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:150 �[1mSTEP�[0m: Creating a kubernetes client Oct 10 09:30:50.979: INFO: >>> kubeConfig: /tmp/kops104699295/kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename services �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:91 [It] should be able to switch session affinity for NodePort service [LinuxOnly] /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1779 �[1mSTEP�[0m: creating service in namespace services-3707 �[1mSTEP�[0m: creating service affinity-nodeport-transition in namespace services-3707 �[1mSTEP�[0m: creating replication controller affinity-nodeport-transition in namespace services-3707 I1010 09:30:51.853250 872 runners.go:189] Created replication controller with name: affinity-nodeport-transition, namespace: services-3707, replica count: 3 I1010 09:30:55.003853 872 runners.go:189] affinity-nodeport-transition Pods: 3 out of 3 created, 3 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Oct 10 09:30:55.433: INFO: Creating new exec pod Oct 10 09:30:59.006: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 affinity-nodeport-transition 80' Oct 10 09:31:00.784: INFO: stderr: "+ nc -zv -t -w 2 affinity-nodeport-transition 80\nConnection to affinity-nodeport-transition 80 port [tcp/http] succeeded!\n" Oct 10 09:31:00.784: INFO: stdout: "" Oct 10 09:31:00.785: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 100.66.55.21 80' Oct 10 09:31:02.633: INFO: stderr: "+ nc -zv -t -w 2 100.66.55.21 80\nConnection to 100.66.55.21 80 port [tcp/http] succeeded!\n" Oct 10 09:31:02.633: INFO: stdout: "" Oct 10 09:31:02.633: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 172.20.49.15 30943' Oct 10 09:31:04.442: INFO: stderr: "+ nc -zv -t -w 2 172.20.49.15 30943\nConnection to 172.20.49.15 30943 port [tcp/30943] succeeded!\n" Oct 10 09:31:04.443: INFO: stdout: "" Oct 10 09:31:04.443: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 172.20.60.88 30943' Oct 10 09:31:06.294: INFO: stderr: "+ nc -zv -t -w 2 172.20.60.88 30943\nConnection to 172.20.60.88 30943 port [tcp/30943] succeeded!\n" Oct 10 09:31:06.294: INFO: stdout: "" Oct 10 09:31:06.294: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:31:10.139: INFO: rc: 1 Oct 10 09:31:10.139: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0029f8030 exit status 1 <nil> <nil> true [0xc0032c5420 0xc0032c5438 0xc0032c5450] [0xc0032c5420 0xc0032c5438 0xc0032c5450] [0xc0032c5430 0xc0032c5448] [0x10f13d0 0x10f13d0] 0xc002ae1320 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:11.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:31:15.011: INFO: rc: 1 Oct 10 09:31:15.011: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003a96840 exit status 1 <nil> <nil> true [0xc001602000 0xc0016022d8 0xc001602600] [0xc001602000 0xc0016022d8 0xc001602600] [0xc001602140 0xc0016024f0] [0x10f13d0 0x10f13d0] 0xc002ffc4e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:15.140: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:31:18.950: INFO: rc: 1 Oct 10 09:31:18.950: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002f84870 exit status 1 <nil> <nil> true [0xc000a26bb0 0xc000a27888 0xc00030be58] [0xc000a26bb0 0xc000a27888 0xc00030be58] [0xc000a277f8 0xc00030bc40] [0x10f13d0 0x10f13d0] 0xc00306e2a0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:19.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:31:23.042: INFO: rc: 1 Oct 10 09:31:23.042: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001bda8a0 exit status 1 <nil> <nil> true [0xc001ba4198 0xc001ba43d8 0xc001ba4490] [0xc001ba4198 0xc001ba43d8 0xc001ba4490] [0xc001ba4300 0xc001ba4480] [0x10f13d0 0x10f13d0] 0xc0067ae360 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:23.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:31:26.994: INFO: rc: 1 Oct 10 09:31:26.994: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003a970b0 exit status 1 <nil> <nil> true [0xc0016026b0 0xc001602d08 0xc001602fe0] [0xc0016026b0 0xc001602d08 0xc001602fe0] [0xc001602c28 0xc001602f30] [0x10f13d0 0x10f13d0] 0xc002ffc7e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:27.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:31:31.000: INFO: rc: 1 Oct 10 09:31:31.000: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002f85140 exit status 1 <nil> <nil> true [0xc00030bff8 0xc002284070 0xc0022840b0] [0xc00030bff8 0xc002284070 0xc0022840b0] [0xc002284038 0xc002284090] [0x10f13d0 0x10f13d0] 0xc00306e8a0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:31.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:31:34.939: INFO: rc: 1 Oct 10 09:31:34.939: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002f85a40 exit status 1 <nil> <nil> true [0xc0022840c8 0xc002284100 0xc002284180] [0xc0022840c8 0xc002284100 0xc002284180] [0xc0022840e0 0xc002284158] [0x10f13d0 0x10f13d0] 0xc00306ed20 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:35.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:31:38.968: INFO: rc: 1 Oct 10 09:31:38.968: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003a97a10 exit status 1 <nil> <nil> true [0xc001603020 0xc001603478 0xc001603588] [0xc001603020 0xc001603478 0xc001603588] [0xc0016033e8 0xc001603558] [0x10f13d0 0x10f13d0] 0xc002ffcae0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:39.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:31:42.998: INFO: rc: 1 Oct 10 09:31:42.998: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001b2c5d0 exit status 1 <nil> <nil> true [0xc0016035e0 0xc001603890 0xc0016039f8] [0xc0016035e0 0xc001603890 0xc0016039f8] [0xc0016037c0 0xc0016039b8] [0x10f13d0 0x10f13d0] 0xc002ffce40 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:43.141: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:31:46.987: INFO: rc: 1 Oct 10 09:31:46.988: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001b2cf00 exit status 1 <nil> <nil> true [0xc001603a18 0xc001603bd0 0xc001603d10] [0xc001603a18 0xc001603bd0 0xc001603d10] [0xc001603b00 0xc001603cc0] [0x10f13d0 0x10f13d0] 0xc002ffd140 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:47.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:31:50.968: INFO: rc: 1 Oct 10 09:31:50.968: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001bdb1a0 exit status 1 <nil> <nil> true [0xc001ba44b8 0xc001ba4548 0xc001ba45a8] [0xc001ba44b8 0xc001ba4548 0xc001ba45a8] [0xc001ba4520 0xc001ba45a0] [0x10f13d0 0x10f13d0] 0xc0067ae660 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:51.140: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:31:54.973: INFO: rc: 1 Oct 10 09:31:54.973: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001b2d950 exit status 1 <nil> <nil> true [0xc001603d90 0xc001603f00 0xc00303c008] [0xc001603d90 0xc001603f00 0xc00303c008] [0xc001603eb0 0xc00303c000] [0x10f13d0 0x10f13d0] 0xc002ffd440 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:55.140: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:31:59.142: INFO: rc: 1 Oct 10 09:31:59.142: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001bdba70 exit status 1 <nil> <nil> true [0xc001ba45b0 0xc001ba4628 0xc001ba4698] [0xc001ba45b0 0xc001ba4628 0xc001ba4698] [0xc001ba4600 0xc001ba4668] [0x10f13d0 0x10f13d0] 0xc0067ae960 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:00.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:32:04.004: INFO: rc: 1 Oct 10 09:32:04.004: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0019d43c0 exit status 1 <nil> <nil> true [0xc001ba46b8 0xc001ba4738 0xc001ba47a8] [0xc001ba46b8 0xc001ba4738 0xc001ba47a8] [0xc001ba4730 0xc001ba4790] [0x10f13d0 0x10f13d0] 0xc0067aec60 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:04.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:32:07.996: INFO: rc: 1 Oct 10 09:32:07.996: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0019d4cc0 exit status 1 <nil> <nil> true [0xc001ba47b8 0xc001ba4818 0xc001ba48b8] [0xc001ba47b8 0xc001ba4818 0xc001ba48b8] [0xc001ba47e8 0xc001ba4838] [0x10f13d0 0x10f13d0] 0xc0067aefc0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:08.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:32:11.946: INFO: rc: 1 Oct 10 09:32:11.947: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc004c10840 exit status 1 <nil> <nil> true [0xc002570000 0xc002570050 0xc002570090] [0xc002570000 0xc002570050 0xc002570090] [0xc002570038 0xc002570078] [0x10f13d0 0x10f13d0] 0xc004418240 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:12.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:32:15.989: INFO: rc: 1 Oct 10 09:32:15.989: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0019d5560 exit status 1 <nil> <nil> true [0xc001ba4948 0xc001ba49e0 0xc001ba4aa0] [0xc001ba4948 0xc001ba49e0 0xc001ba4aa0] [0xc001ba49c0 0xc001ba4a38] [0x10f13d0 0x10f13d0] 0xc0067af2c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:16.140: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:32:20.100: INFO: rc: 1 Oct 10 09:32:20.100: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc004c11170 exit status 1 <nil> <nil> true [0xc002570098 0xc0025700b0 0xc0025700c8] [0xc002570098 0xc0025700b0 0xc0025700c8] [0xc0025700a8 0xc0025700c0] [0x10f13d0 0x10f13d0] 0xc004418540 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:20.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:32:23.975: INFO: rc: 1 Oct 10 09:32:23.975: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc004c119e0 exit status 1 <nil> <nil> true [0xc0025700d0 0xc002570100 0xc002570128] [0xc0025700d0 0xc002570100 0xc002570128] [0xc0025700f0 0xc002570120] [0x10f13d0 0x10f13d0] 0xc004418a20 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:24.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:32:27.913: INFO: rc: 1 Oct 10 09:32:27.913: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc005b8c5a0 exit status 1 <nil> <nil> true [0xc00303c010 0xc00303c028 0xc00303c040] [0xc00303c010 0xc00303c028 0xc00303c040] [0xc00303c020 0xc00303c038] [0x10f13d0 0x10f13d0] 0xc002ffd800 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:28.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:32:31.919: INFO: rc: 1 Oct 10 09:32:31.919: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc006661380 exit status 1 <nil> <nil> true [0xc002284198 0xc0022841f0 0xc002284250] [0xc002284198 0xc0022841f0 0xc002284250] [0xc0022841c0 0xc002284228] [0x10f13d0 0x10f13d0] 0xc00097a060 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:32.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:32:35.947: INFO: rc: 1 Oct 10 09:32:35.947: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc005b8d7d0 exit status 1 <nil> <nil> true [0xc00303c050 0xc00303c070 0xc00303c088] [0xc00303c050 0xc00303c070 0xc00303c088] [0xc00303c068 0xc00303c080] [0x10f13d0 0x10f13d0] 0xc002ffdb00 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:36.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:32:40.115: INFO: rc: 1 Oct 10 09:32:40.115: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc006661c20 exit status 1 <nil> <nil> true [0xc002284280 0xc0022842a0 0xc0022842f0] [0xc002284280 0xc0022842a0 0xc0022842f0] [0xc002284298 0xc0022842c8] [0x10f13d0 0x10f13d0] 0xc00097a4e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:40.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:32:43.984: INFO: rc: 1 Oct 10 09:32:43.984: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc005db0390 exit status 1 <nil> <nil> true [0xc002570130 0xc002570150 0xc002570190] [0xc002570130 0xc002570150 0xc002570190] [0xc002570140 0xc002570180] [0x10f13d0 0x10f13d0] 0xc004418d20 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:44.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:32:47.999: INFO: rc: 1 Oct 10 09:32:47.999: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0019d5e60 exit status 1 <nil> <nil> true [0xc001ba4af8 0xc001ba4be0 0xc001ba4c88] [0xc001ba4af8 0xc001ba4be0 0xc001ba4c88] [0xc001ba4bc0 0xc001ba4c58] [0x10f13d0 0x10f13d0] 0xc0067af5c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:48.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:32:51.961: INFO: rc: 1 Oct 10 09:32:51.961: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0019a8630 exit status 1 <nil> <nil> true [0xc002284310 0xc002284348 0xc002284380] [0xc002284310 0xc002284348 0xc002284380] [0xc002284338 0xc002284370] [0x10f13d0 0x10f13d0] 0xc00097a7e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:52.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:32:55.974: INFO: rc: 1 Oct 10 09:32:55.974: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc005db0c30 exit status 1 <nil> <nil> true [0xc002570198 0xc0025701e8 0xc002570218] [0xc002570198 0xc0025701e8 0xc002570218] [0xc0025701d0 0xc002570208] [0x10f13d0 0x10f13d0] 0xc004419020 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:56.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:32:59.969: INFO: rc: 1 Oct 10 09:32:59.970: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0028d0780 exit status 1 <nil> <nil> true [0xc001ba4ca0 0xc001ba4de8 0xc001ba4ee0] [0xc001ba4ca0 0xc001ba4de8 0xc001ba4ee0] [0xc001ba4dc0 0xc001ba4ea0] [0x10f13d0 0x10f13d0] 0xc0067af8c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:33:00.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:33:03.913: INFO: rc: 1 Oct 10 09:33:03.913: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0019a8ed0 exit status 1 <nil> <nil> true [0xc0022843a0 0xc0022843f8 0xc002284430] [0xc0022843a0 0xc0022843f8 0xc002284430] [0xc0022843c8 0xc002284420] [0x10f13d0 0x10f13d0] 0xc00097ac60 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:33:04.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:33:08.045: INFO: rc: 1 Oct 10 09:33:08.045: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc005db1830 exit status 1 <nil> <nil> true [0xc002570238 0xc002570280 0xc0025702a0] [0xc002570238 0xc002570280 0xc0025702a0] [0xc002570278 0xc002570290] [0x10f13d0 0x10f13d0] 0xc004419380 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:33:08.139: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:33:11.997: INFO: rc: 1 Oct 10 09:33:11.997: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0066618f0 exit status 1 <nil> <nil> true [0xc00030be58 0xc000a27488 0xc000a27ec8] [0xc00030be58 0xc000a27488 0xc000a27ec8] [0xc000a26bb0 0xc000a27888] [0x10f13d0 0x10f13d0] 0xc00306e2a0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:33:11.997: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943' Oct 10 09:33:15.847: INFO: rc: 1 Oct 10 09:33:15.848: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3707 execpod-affinitygnj62 -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 30943] [] <nil> + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc004c101e0 exit status 1 <nil> <nil> true [0xc001602000 0xc0016022d8 0xc001602600] [0xc001602000 0xc0016022d8 0xc001602600] [0xc001602140 0xc0016024f0] [0x10f13d0 0x10f13d0] 0xc00306e8a0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 30943 nc: connect to 18.228.205.178 port 30943 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:33:15.848: FAIL: Service is not reachable within 2m0s timeout on endpoint 18.228.205.178:30943 over TCP protocol Unexpected error: <*errors.errorString | 0xc0000a10a0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Oct 10 09:33:15.848: INFO: Cleaning up the exec pod �[1mSTEP�[0m: deleting ReplicationController affinity-nodeport-transition in namespace services-3707, will wait for the garbage collector to delete the pods Oct 10 09:33:16.434: INFO: Deleting ReplicationController affinity-nodeport-transition took: 144.215874ms Oct 10 09:33:16.534: INFO: Terminating ReplicationController affinity-nodeport-transition pods took: 100.347572ms [AfterEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Collecting events from namespace "services-3707". �[1mSTEP�[0m: Found 23 events. Oct 10 09:33:27.335: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-transition-56hp6: {default-scheduler } Scheduled: Successfully assigned services-3707/affinity-nodeport-transition-56hp6 to ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:33:27.335: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-transition-jxwx6: {default-scheduler } Scheduled: Successfully assigned services-3707/affinity-nodeport-transition-jxwx6 to ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:33:27.335: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-transition-nw2dh: {default-scheduler } Scheduled: Successfully assigned services-3707/affinity-nodeport-transition-nw2dh to ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:33:27.335: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for execpod-affinitygnj62: {default-scheduler } Scheduled: Successfully assigned services-3707/execpod-affinitygnj62 to ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:33:27.335: INFO: At 2019-10-10 09:30:51 +0000 UTC - event for affinity-nodeport-transition: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-transition-56hp6 Oct 10 09:33:27.335: INFO: At 2019-10-10 09:30:51 +0000 UTC - event for affinity-nodeport-transition: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-transition-nw2dh Oct 10 09:33:27.335: INFO: At 2019-10-10 09:30:51 +0000 UTC - event for affinity-nodeport-transition: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-transition-jxwx6 Oct 10 09:33:27.335: INFO: At 2019-10-10 09:30:52 +0000 UTC - event for affinity-nodeport-transition-56hp6: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Started: Started container affinity-nodeport-transition Oct 10 09:33:27.335: INFO: At 2019-10-10 09:30:52 +0000 UTC - event for affinity-nodeport-transition-56hp6: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Created: Created container affinity-nodeport-transition Oct 10 09:33:27.335: INFO: At 2019-10-10 09:30:52 +0000 UTC - event for affinity-nodeport-transition-56hp6: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:33:27.335: INFO: At 2019-10-10 09:30:52 +0000 UTC - event for affinity-nodeport-transition-jxwx6: {kubelet ip-172-20-60-88.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:33:27.335: INFO: At 2019-10-10 09:30:52 +0000 UTC - event for affinity-nodeport-transition-jxwx6: {kubelet ip-172-20-60-88.sa-east-1.compute.internal} Started: Started container affinity-nodeport-transition Oct 10 09:33:27.335: INFO: At 2019-10-10 09:30:52 +0000 UTC - event for affinity-nodeport-transition-jxwx6: {kubelet ip-172-20-60-88.sa-east-1.compute.internal} Created: Created container affinity-nodeport-transition Oct 10 09:33:27.335: INFO: At 2019-10-10 09:30:52 +0000 UTC - event for affinity-nodeport-transition-nw2dh: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Created: Created container affinity-nodeport-transition Oct 10 09:33:27.335: INFO: At 2019-10-10 09:30:52 +0000 UTC - event for affinity-nodeport-transition-nw2dh: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Started: Started container affinity-nodeport-transition Oct 10 09:33:27.335: INFO: At 2019-10-10 09:30:52 +0000 UTC - event for affinity-nodeport-transition-nw2dh: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:33:27.335: INFO: At 2019-10-10 09:30:56 +0000 UTC - event for execpod-affinitygnj62: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:33:27.335: INFO: At 2019-10-10 09:30:56 +0000 UTC - event for execpod-affinitygnj62: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Created: Created container agnhost-pause Oct 10 09:33:27.335: INFO: At 2019-10-10 09:30:56 +0000 UTC - event for execpod-affinitygnj62: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Started: Started container agnhost-pause Oct 10 09:33:27.335: INFO: At 2019-10-10 09:33:15 +0000 UTC - event for execpod-affinitygnj62: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Killing: Stopping container agnhost-pause Oct 10 09:33:27.335: INFO: At 2019-10-10 09:33:16 +0000 UTC - event for affinity-nodeport-transition-56hp6: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Killing: Stopping container affinity-nodeport-transition Oct 10 09:33:27.335: INFO: At 2019-10-10 09:33:16 +0000 UTC - event for affinity-nodeport-transition-jxwx6: {kubelet ip-172-20-60-88.sa-east-1.compute.internal} Killing: Stopping container affinity-nodeport-transition Oct 10 09:33:27.335: INFO: At 2019-10-10 09:33:16 +0000 UTC - event for affinity-nodeport-transition-nw2dh: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Killing: Stopping container affinity-nodeport-transition Oct 10 09:33:27.477: INFO: POD NODE PHASE GRACE CONDITIONS Oct 10 09:33:27.477: INFO: Oct 10 09:33:27.620: INFO: Logging node info for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:33:27.762: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-37-177.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-37-177.sa-east-1.compute.internal 8ecedabe-969e-476a-8f76-1fb03eedaa56 32754 0 2019-10-10 09:12:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c4.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:master-sa-east-1c kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-37-177.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master:] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-08fb35da4b2014f59,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3949572096 0} {<nil>} 3857004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3844714496 0} {<nil>} 3754604Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:12:53 +0000 UTC,LastTransitionTime:2019-10-10 09:12:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:33:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:33:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:33:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:33:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.177,},NodeAddress{Type:ExternalIP,Address:54.233.97.36,},NodeAddress{Type:Hostname,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-97-36.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:75a86a2fc8e747568f8cd25355ed4a43,SystemUUID:EC277240-730F-D89C-36D2-B12A43ABB39F,BootID:33b7c61a-9c83-42db-9541-8a26846b977a,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[kopeio/etcd-manager@sha256:cb0ed7c56dadbc0f4cd515906d72b30094229d6e0a9fcb7aa44e23680bf9a3a8 kopeio/etcd-manager:3.0.20190930],SizeBytes:656348817,},ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:260130533,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:205085998,},ContainerImage{Names:[kope/dns-controller@sha256:aca3878acdac85716e1317dd2fc85b235551068d667e578fceb9b0e8c3561324 kope/dns-controller:1.15.0-alpha.1],SizeBytes:120867125,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:103791294,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:33:27.763: INFO: Logging kubelet events for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:33:27.907: INFO: Logging pods the kubelet thinks is on node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:33:28.056: INFO: kops-controller-76f5d459f8-86j85 started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:28.056: INFO: Container kops-controller ready: true, restart count 0 Oct 10 09:33:28.056: INFO: dns-controller-78ccbffc6d-5pnmw started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:28.056: INFO: Container dns-controller ready: true, restart count 0 Oct 10 09:33:28.056: INFO: etcd-manager-main-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:28.056: INFO: Container etcd-manager ready: true, restart count 0 Oct 10 09:33:28.056: INFO: kube-apiserver-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:28.056: INFO: Container kube-apiserver ready: true, restart count 3 Oct 10 09:33:28.056: INFO: kube-controller-manager-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:28.056: INFO: Container kube-controller-manager ready: true, restart count 0 Oct 10 09:33:28.056: INFO: kube-proxy-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:28.056: INFO: Container kube-proxy ready: true, restart count 3 Oct 10 09:33:28.056: INFO: kube-scheduler-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:28.056: INFO: Container kube-scheduler ready: true, restart count 0 Oct 10 09:33:28.056: INFO: etcd-manager-events-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:28.056: INFO: Container etcd-manager ready: true, restart count 0 W1010 09:33:28.200012 872 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:33:28.501: INFO: Latency metrics for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:33:28.501: INFO: Logging node info for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:33:28.643: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-42-37.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-42-37.sa-east-1.compute.internal 8fb9f863-77f2-4451-ba99-614781c1c8bc 32321 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-42-37.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node mounted_volume_expand:mounted-volume-expand-8034 node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-1205":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-4356":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-volume-expand-3381":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-volume-expand-4923":"ip-172-20-42-37.sa-east-1.compute.internal"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-020fda63f6b69c0ea,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:51 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:51 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:51 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:32:51 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.37,},NodeAddress{Type:ExternalIP,Address:54.233.88.138,},NodeAddress{Type:Hostname,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-88-138.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dbea17b1df4f4682b3aea8f7967a81f7,SystemUUID:EC276068-34A4-965C-3CB7-CA4BD3478D25,BootID:883b28de-249e-43a6-8e1c-705f97846842,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa k8s.gcr.io/etcd:3.3.15],SizeBytes:246640776,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:1bafcc6fb1aa990b487850adba9cadc020e42d7905aa8a30481182a477ba24b0 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.10],SizeBytes:61365829,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-01bd3e8125169a372 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0982651b46866db00],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:33:28.644: INFO: Logging kubelet events for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:33:28.788: INFO: Logging pods the kubelet thinks is on node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:33:28.934: INFO: e2e-net-client started at 2019-10-10 09:33:22 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:28.934: INFO: Container e2e-net-client ready: true, restart count 0 Oct 10 09:33:28.934: INFO: hostexec-ip-172-20-42-37.sa-east-1.compute.internal-rrwmb started at 2019-10-10 09:33:01 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:28.934: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:33:28.934: INFO: security-context-de99ddc7-c293-47cf-94a9-cdb5ecbd863b started at 2019-10-10 09:33:08 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:28.934: INFO: Container write-pod ready: false, restart count 0 Oct 10 09:33:28.934: INFO: pfpod started at 2019-10-10 09:33:11 +0000 UTC (0+2 container statuses recorded) Oct 10 09:33:28.934: INFO: Container portforwardtester ready: false, restart count 0 Oct 10 09:33:28.934: INFO: Container readiness ready: false, restart count 0 Oct 10 09:33:28.934: INFO: exec-volume-test-aws-gd9n started at 2019-10-10 09:29:35 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:28.934: INFO: Container exec-container-aws-gd9n ready: false, restart count 0 Oct 10 09:33:28.934: INFO: security-context-6c1aff86-4b73-424e-8391-f7966d5c5852 started at 2019-10-10 09:33:18 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:28.934: INFO: Container write-pod ready: false, restart count 0 Oct 10 09:33:28.934: INFO: concurrent-1570699980-8t6cc started at 2019-10-10 09:33:04 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:28.934: INFO: Container c ready: false, restart count 0 Oct 10 09:33:28.934: INFO: exec-volume-test-aws-preprovisionedpv-v2hv started at 2019-10-10 09:28:47 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:28.934: INFO: Container exec-container-aws-preprovisionedpv-v2hv ready: false, restart count 0 Oct 10 09:33:28.934: INFO: kube-proxy-ip-172-20-42-37.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:28.934: INFO: Container kube-proxy ready: true, restart count 2 W1010 09:33:29.078306 872 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:33:29.388: INFO: Latency metrics for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:33:29.388: INFO: Logging node info for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:33:29.535: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-49-15.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-49-15.sa-east-1.compute.internal 105a0721-5b17-40b8-b686-ccf439f1ca2a 32091 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-49-15.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6677":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-ephemeral-8821":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-1913":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-6893":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-8860":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-9656":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-5356":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-5574":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-6407":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-volume-expand-3873":"ip-172-20-49-15.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-3724":"csi-mock-csi-mock-volumes-3724","csi-mock-csi-mock-volumes-4205":"csi-mock-csi-mock-volumes-4205","csi-mock-csi-mock-volumes-4873":"csi-mock-csi-mock-volumes-4873","csi-mock-csi-mock-volumes-7612":"csi-mock-csi-mock-volumes-7612","csi-mock-csi-mock-volumes-8888":"csi-mock-csi-mock-volumes-8888"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-056d95303ed61d881,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:32:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.49.15,},NodeAddress{Type:ExternalIP,Address:18.228.205.178,},NodeAddress{Type:Hostname,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-228-205-178.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f468c62663d2465ca17ba5284774252e,SystemUUID:EC23BE58-6EBA-E800-9C73-DEB3BAA2D1B9,BootID:6eb82ab7-2bd7-418a-ba22-36d3a808a22b,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/google-containers/debian-base@sha256:6966a0aedd7592c18ff2dd803c08bd85780ee19f5e3a2e7cf908a4cd837afcde gcr.io/google-containers/debian-base:0.4.1],SizeBytes:42323657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0af4a01f4f7f011af kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0b0fa084d8405fe9e kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0caeace51988095bb],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0af4a01f4f7f011af,DevicePath:/dev/xvdcf,},},Config:nil,},} Oct 10 09:33:29.536: INFO: Logging kubelet events for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:33:29.680: INFO: Logging pods the kubelet thinks is on node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:33:29.828: INFO: security-context-82f55ada-3bac-4f92-b4e2-dcfcc8038868 started at 2019-10-10 09:32:24 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:29.828: INFO: Container write-pod ready: true, restart count 0 Oct 10 09:33:29.828: INFO: aws-injector started at 2019-10-10 09:30:35 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:29.828: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:33:29.828: INFO: aws-injector started at 2019-10-10 09:32:03 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:29.828: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:33:29.828: INFO: liveness-4311afc1-047e-4c80-bcf2-fc64d3506dc4 started at 2019-10-10 09:31:52 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:29.828: INFO: Container liveness ready: true, restart count 0 Oct 10 09:33:29.828: INFO: external-provisioner-vj956 started at 2019-10-10 09:32:57 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:29.828: INFO: Container nfs-provisioner ready: true, restart count 0 Oct 10 09:33:29.828: INFO: kube-proxy-ip-172-20-49-15.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:29.828: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:33:29.828: INFO: security-context-6330213f-f3e8-444c-84b3-3515323990ed started at 2019-10-10 09:33:17 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:29.828: INFO: Container write-pod ready: true, restart count 0 Oct 10 09:33:29.828: INFO: concurrent-1570699920-tl2zg started at 2019-10-10 09:32:04 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:29.828: INFO: Container c ready: true, restart count 0 W1010 09:33:29.973282 872 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:33:30.284: INFO: Latency metrics for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:33:30.284: INFO: Logging node info for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:33:30.427: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-56-86.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-56-86.sa-east-1.compute.internal cccbef08-fa00-42b5-ae85-da8efe4ee848 33029 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-56-86.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9823":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-provisioning-5677":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-1516":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-6492":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volume-6196":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volumemode-1556":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-1749":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-expand-9939":"ip-172-20-56-86.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-5777":"csi-mock-csi-mock-volumes-5777","csi-mock-csi-mock-volumes-6825":"csi-mock-csi-mock-volumes-6825","csi-mock-csi-mock-volumes-7201":"csi-mock-csi-mock-volumes-7201","csi-mock-csi-mock-volumes-8231":"csi-mock-csi-mock-volumes-8231"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-0b5800b629bcb7519,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:33:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:33:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:33:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:33:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.86,},NodeAddress{Type:ExternalIP,Address:54.207.48.88,},NodeAddress{Type:Hostname,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-207-48-88.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:99be0b3f4ec34abb8f4f249d272797b5,SystemUUID:EC2EB353-C506-B251-A10A-9B28B752A967,BootID:e098fcb6-fca7-433b-9b9f-7e47386c5ca0,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 gluster/glusterdynamic-provisioner:v1.0],SizeBytes:373281573,},ContainerImage{Names:[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6],SizeBytes:373099368,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:bbc3a03235220b170ba48a157dd097dd1379299370e1ed99ce976df0355d24f0 busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-028b66335e31eaf4f kubernetes.io/aws-ebs/aws://sa-east-1c/vol-05da71c2f70c6d1e3 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0765fb05bdb37f4b5 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0f597dc8d7319d060],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:33:30.427: INFO: Logging kubelet events for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:33:30.572: INFO: Logging pods the kubelet thinks is on node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:33:30.718: INFO: hostexec-ip-172-20-56-86.sa-east-1.compute.internal-98l5z started at 2019-10-10 09:32:48 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:30.718: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:33:30.718: INFO: csi-mockplugin-0 started at 2019-10-10 09:33:02 +0000 UTC (0+3 container statuses recorded) Oct 10 09:33:30.718: INFO: Container csi-provisioner ready: true, restart count 0 Oct 10 09:33:30.718: INFO: Container driver-registrar ready: true, restart count 0 Oct 10 09:33:30.718: INFO: Container mock ready: true, restart count 0 Oct 10 09:33:30.718: INFO: aws-injector started at 2019-10-10 09:28:01 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:30.718: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:33:30.718: INFO: nfs-server started at 2019-10-10 09:33:00 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:30.718: INFO: Container nfs-server ready: true, restart count 0 Oct 10 09:33:30.718: INFO: local-client started at 2019-10-10 09:33:28 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:30.718: INFO: Container local-client ready: true, restart count 0 Oct 10 09:33:30.718: INFO: exec-volume-test-aws-4jlf started at 2019-10-10 09:31:15 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:30.718: INFO: Container exec-container-aws-4jlf ready: false, restart count 0 Oct 10 09:33:30.718: INFO: busybox-scheduling-b1e74f5d-4396-4093-9697-b12b963092ed started at 2019-10-10 09:33:00 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:30.718: INFO: Container busybox-scheduling-b1e74f5d-4396-4093-9697-b12b963092ed ready: true, restart count 0 Oct 10 09:33:30.718: INFO: csi-mockplugin-attacher-0 started at 2019-10-10 09:33:02 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:30.718: INFO: Container csi-attacher ready: true, restart count 0 Oct 10 09:33:30.718: INFO: kube-proxy-ip-172-20-56-86.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:30.718: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:33:30.718: INFO: aws-injector started at 2019-10-10 09:31:17 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:30.718: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:33:30.718: INFO: exec-volume-test-aws-preprovisionedpv-j99q started at 2019-10-10 09:32:17 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:30.718: INFO: Container exec-container-aws-preprovisionedpv-j99q ready: false, restart count 0 W1010 09:33:30.863387 872 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:33:31.177: INFO: Latency metrics for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:33:31.177: INFO: Logging node info for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:33:31.320: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-60-88.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-60-88.sa-east-1.compute.internal f5a2e6d3-a123-4acc-a9b2-8fa0a5c1c28f 33183 0 2019-10-10 09:14:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-60-88.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4801":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-provisioning-2176":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-provisioning-8958":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-9423":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volume-expand-4947":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volume-expand-6712":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volumemode-1292":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volumemode-4728":"ip-172-20-60-88.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-3023":"csi-mock-csi-mock-volumes-3023","csi-mock-csi-mock-volumes-3750":"csi-mock-csi-mock-volumes-3750","csi-mock-csi-mock-volumes-3882":"csi-mock-csi-mock-volumes-3882","csi-mock-csi-mock-volumes-5042":"csi-mock-csi-mock-volumes-5042","csi-mock-csi-mock-volumes-6797":"csi-mock-csi-mock-volumes-6797"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-087c9d5356d3aafe3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146278400 0} {<nil>} 4049100Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041420800 0} {<nil>} 3946700Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:13 +0000 UTC,LastTransitionTime:2019-10-10 09:14:13 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:32:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.88,},NodeAddress{Type:ExternalIP,Address:18.231.36.128,},NodeAddress{Type:Hostname,Address:ip-172-20-60-88.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-60-88.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-231-36-128.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4f6cfed0b3cc440c814a893a63590a26,SystemUUID:EC2CF3F1-2D60-B6EE-FE1D-D82FEFE80523,BootID:fcb35a82-1eda-4e12-88ea-2fc1cfa0c447,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6],SizeBytes:373099368,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:618a82fa66cf0c75e4753369a6999032372be7308866fc9afb381789b1e5ad52 k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13],SizeBytes:51157394,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:12370202895b621a2ac28226292e4578598f13c1502aa4d3ee90fff4325d9275 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.4.0],SizeBytes:45853555,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-sidecar-amd64@sha256:cedc8fe2098dffc26d17f64061296b7aa54258a31513b6c52df271a98bb522b3 k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.13],SizeBytes:42852039,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64@sha256:45df3e8e0c551bd0c79cdba48ae6677f817971dcbd1eeed7fd1f9a35118410e4 k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13],SizeBytes:41372492,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0559eda2818e41891 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0fac33f38a006d601],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:33:31.321: INFO: Logging kubelet events for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:33:31.465: INFO: Logging pods the kubelet thinks is on node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:33:31.612: INFO: aws-injector started at 2019-10-10 09:31:02 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:31.612: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:33:31.612: INFO: kube-dns-bb55d6458-g4ktr started at 2019-10-10 09:14:21 +0000 UTC (0+3 container statuses recorded) Oct 10 09:33:31.612: INFO: Container dnsmasq ready: true, restart count 0 Oct 10 09:33:31.612: INFO: Container kubedns ready: true, restart count 0 Oct 10 09:33:31.612: INFO: Container sidecar ready: true, restart count 0 Oct 10 09:33:31.612: INFO: test-webserver-b5500d93-d5c7-42df-b520-f4efb65e0c14 started at 2019-10-10 09:33:06 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:31.612: INFO: Container test-webserver ready: false, restart count 0 Oct 10 09:33:31.612: INFO: kube-dns-bb55d6458-cx9kh started at 2019-10-10 09:14:29 +0000 UTC (0+3 container statuses recorded) Oct 10 09:33:31.612: INFO: Container dnsmasq ready: true, restart count 0 Oct 10 09:33:31.612: INFO: Container kubedns ready: true, restart count 0 Oct 10 09:33:31.612: INFO: Container sidecar ready: true, restart count 0 Oct 10 09:33:31.612: INFO: send-events-b72a92c2-d05b-4d51-ba91-01a8cf2cbe82 started at 2019-10-10 09:32:57 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:31.612: INFO: Container p ready: true, restart count 0 Oct 10 09:33:31.612: INFO: busybox-3066a0bd-5e3d-4052-8e17-71b9787d6a4d started at 2019-10-10 09:33:06 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:31.612: INFO: Container busybox ready: true, restart count 0 Oct 10 09:33:31.612: INFO: security-context-36127b4e-a0b0-4781-98c5-ad60272aae2e started at 2019-10-10 09:33:19 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:31.612: INFO: Container write-pod ready: false, restart count 0 Oct 10 09:33:31.612: INFO: aws-injector started at 2019-10-10 09:32:35 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:31.612: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:33:31.612: INFO: kube-proxy-ip-172-20-60-88.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:31.612: INFO: Container kube-proxy ready: true, restart count 1 Oct 10 09:33:31.612: INFO: kube-dns-autoscaler-66b775459-74nsm started at 2019-10-10 09:14:21 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:31.612: INFO: Container autoscaler ready: true, restart count 0 Oct 10 09:33:31.612: INFO: e2e-net-server started at 2019-10-10 09:33:16 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:31.612: INFO: Container e2e-net-server ready: true, restart count 0 W1010 09:33:31.756427 872 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:33:32.074: INFO: Latency metrics for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:33:32.074: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "services-3707" for this suite. [AfterEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:95
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sServices\sshould\sbe\sable\sto\supdate\sservice\stype\sto\sNodePort\slistening\son\ssame\sport\snumber\sbut\sdifferent\sprotocols$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:940 Oct 10 09:33:04.659: Service is not reachable within 2m0s timeout on endpoint 18.228.205.178:31217 over TCP protocol Unexpected error: <*errors.errorString | 0xc0000d5080>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/service/jig.go:795from junit_01.xml
[BeforeEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:150 �[1mSTEP�[0m: Creating a kubernetes client Oct 10 09:30:41.044: INFO: >>> kubeConfig: /tmp/kops104699295/kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename services �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:91 [It] should be able to update service type to NodePort listening on same port number but different protocols /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:940 �[1mSTEP�[0m: creating a TCP service nodeport-update-service with type=ClusterIP in namespace services-3555 Oct 10 09:30:41.764: INFO: Service Port TCP: 80 �[1mSTEP�[0m: changing the TCP service to type=NodePort �[1mSTEP�[0m: creating replication controller nodeport-update-service in namespace services-3555 I1010 09:30:42.196441 1021 runners.go:189] Created replication controller with name: nodeport-update-service, namespace: services-3555, replica count: 2 I1010 09:30:45.347741 1021 runners.go:189] nodeport-update-service Pods: 2 out of 2 created, 2 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Oct 10 09:30:45.347: INFO: Creating new exec pod Oct 10 09:30:48.921: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 nodeport-update-service 80' Oct 10 09:30:50.702: INFO: stderr: "+ nc -zv -t -w 2 nodeport-update-service 80\nConnection to nodeport-update-service 80 port [tcp/http] succeeded!\n" Oct 10 09:30:50.702: INFO: stdout: "" Oct 10 09:30:50.702: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 100.71.105.235 80' Oct 10 09:30:52.539: INFO: stderr: "+ nc -zv -t -w 2 100.71.105.235 80\nConnection to 100.71.105.235 80 port [tcp/http] succeeded!\n" Oct 10 09:30:52.539: INFO: stdout: "" Oct 10 09:30:52.539: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 172.20.49.15 31217' Oct 10 09:30:54.325: INFO: stderr: "+ nc -zv -t -w 2 172.20.49.15 31217\nConnection to 172.20.49.15 31217 port [tcp/31217] succeeded!\n" Oct 10 09:30:54.325: INFO: stdout: "" Oct 10 09:30:54.325: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 172.20.42.37 31217' Oct 10 09:30:56.186: INFO: stderr: "+ nc -zv -t -w 2 172.20.42.37 31217\nConnection to 172.20.42.37 31217 port [tcp/31217] succeeded!\n" Oct 10 09:30:56.186: INFO: stdout: "" Oct 10 09:30:56.186: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:30:59.999: INFO: rc: 1 Oct 10 09:30:59.999: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00365a150 exit status 1 <nil> <nil> true [0xc0031923a0 0xc0031923e0 0xc0031923f8] [0xc0031923a0 0xc0031923e0 0xc0031923f8] [0xc0031923c0 0xc0031923f0] [0x10f13d0 0x10f13d0] 0xc0022a0a80 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:01.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:31:04.787: INFO: rc: 1 Oct 10 09:31:04.787: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0037d7110 exit status 1 <nil> <nil> true [0xc0033a40b8 0xc0033a40d0 0xc0033a40e8] [0xc0033a40b8 0xc0033a40d0 0xc0033a40e8] [0xc0033a40c8 0xc0033a40e0] [0x10f13d0 0x10f13d0] 0xc002aeba40 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:05.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:31:08.872: INFO: rc: 1 Oct 10 09:31:08.872: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0037d7980 exit status 1 <nil> <nil> true [0xc0033a40f0 0xc0033a4108 0xc0033a4120] [0xc0033a40f0 0xc0033a4108 0xc0033a4120] [0xc0033a4100 0xc0033a4118] [0x10f13d0 0x10f13d0] 0xc002aebd40 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:09.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:31:12.868: INFO: rc: 1 Oct 10 09:31:12.868: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003502240 exit status 1 <nil> <nil> true [0xc0033a4128 0xc0033a4140 0xc0033a4158] [0xc0033a4128 0xc0033a4140 0xc0033a4158] [0xc0033a4138 0xc0033a4150] [0x10f13d0 0x10f13d0] 0xc0024280c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:13.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:31:16.790: INFO: rc: 1 Oct 10 09:31:16.790: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0034e4720 exit status 1 <nil> <nil> true [0xc003d7f588 0xc003d7f5a0 0xc003d7f5b8] [0xc003d7f588 0xc003d7f5a0 0xc003d7f5b8] [0xc003d7f598 0xc003d7f5b0] [0x10f13d0 0x10f13d0] 0xc0034e06c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:17.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:31:20.810: INFO: rc: 1 Oct 10 09:31:20.810: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003730c30 exit status 1 <nil> <nil> true [0xc0021acf68 0xc0021ad058 0xc0021ad0b8] [0xc0021acf68 0xc0021ad058 0xc0021ad0b8] [0xc0021ad030 0xc0021ad088] [0x10f13d0 0x10f13d0] 0xc00362c0c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:21.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:31:24.873: INFO: rc: 1 Oct 10 09:31:24.873: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0034e4ff0 exit status 1 <nil> <nil> true [0xc003d7f5c0 0xc003d7f5d8 0xc003d7f5f0] [0xc003d7f5c0 0xc003d7f5d8 0xc003d7f5f0] [0xc003d7f5d0 0xc003d7f5e8] [0x10f13d0 0x10f13d0] 0xc0034e0c00 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:25.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:31:28.800: INFO: rc: 1 Oct 10 09:31:28.800: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003502de0 exit status 1 <nil> <nil> true [0xc0033a4160 0xc0033a4178 0xc0033a4190] [0xc0033a4160 0xc0033a4178 0xc0033a4190] [0xc0033a4170 0xc0033a4188] [0x10f13d0 0x10f13d0] 0xc0024283c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:29.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:31:32.814: INFO: rc: 1 Oct 10 09:31:32.814: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0034e5890 exit status 1 <nil> <nil> true [0xc003d7f5f8 0xc003d7f610 0xc003d7f628] [0xc003d7f5f8 0xc003d7f610 0xc003d7f628] [0xc003d7f608 0xc003d7f620] [0x10f13d0 0x10f13d0] 0xc0034e0f60 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:33.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:31:36.889: INFO: rc: 1 Oct 10 09:31:36.889: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003562150 exit status 1 <nil> <nil> true [0xc003d7f630 0xc003d7f648 0xc003d7f660] [0xc003d7f630 0xc003d7f648 0xc003d7f660] [0xc003d7f640 0xc003d7f658] [0x10f13d0 0x10f13d0] 0xc0034e1260 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:37.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:31:40.782: INFO: rc: 1 Oct 10 09:31:40.782: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003562a80 exit status 1 <nil> <nil> true [0xc003d7f668 0xc003d7f680 0xc003d7f698] [0xc003d7f668 0xc003d7f680 0xc003d7f698] [0xc003d7f678 0xc003d7f690] [0x10f13d0 0x10f13d0] 0xc0034e1560 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:41.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:31:44.870: INFO: rc: 1 Oct 10 09:31:44.870: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003563320 exit status 1 <nil> <nil> true [0xc003d7f6a0 0xc003d7f6b8 0xc003d7f6d0] [0xc003d7f6a0 0xc003d7f6b8 0xc003d7f6d0] [0xc003d7f6b0 0xc003d7f6c8] [0x10f13d0 0x10f13d0] 0xc0034e1860 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:45.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:31:48.862: INFO: rc: 1 Oct 10 09:31:48.862: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003563b90 exit status 1 <nil> <nil> true [0xc003d7f6d8 0xc003d7f6f0 0xc003d7f708] [0xc003d7f6d8 0xc003d7f6f0 0xc003d7f708] [0xc003d7f6e8 0xc003d7f700] [0x10f13d0 0x10f13d0] 0xc0034e1b60 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:49.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:31:52.848: INFO: rc: 1 Oct 10 09:31:52.848: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00365ac30 exit status 1 <nil> <nil> true [0xc003192400 0xc003192418 0xc003192430] [0xc003192400 0xc003192418 0xc003192430] [0xc003192410 0xc003192428] [0x10f13d0 0x10f13d0] 0xc0022a0d80 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:53.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:31:56.824: INFO: rc: 1 Oct 10 09:31:56.824: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003731530 exit status 1 <nil> <nil> true [0xc0021ad0e8 0xc0021ad268 0xc0021ad328] [0xc0021ad0e8 0xc0021ad268 0xc0021ad328] [0xc0021ad220 0xc0021ad2f0] [0x10f13d0 0x10f13d0] 0xc00362c420 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:31:57.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:32:00.874: INFO: rc: 1 Oct 10 09:32:00.874: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00365b560 exit status 1 <nil> <nil> true [0xc003192438 0xc003192458 0xc003192470] [0xc003192438 0xc003192458 0xc003192470] [0xc003192450 0xc003192468] [0x10f13d0 0x10f13d0] 0xc0022a1080 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:01.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:32:04.867: INFO: rc: 1 Oct 10 09:32:04.867: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003503950 exit status 1 <nil> <nil> true [0xc0033a4198 0xc0033a41b0 0xc0033a41c8] [0xc0033a4198 0xc0033a41b0 0xc0033a41c8] [0xc0033a41a8 0xc0033a41c0] [0x10f13d0 0x10f13d0] 0xc0024286c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:05.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:32:08.853: INFO: rc: 1 Oct 10 09:32:08.853: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003224090 exit status 1 <nil> <nil> true [0xc003192478 0xc003192490 0xc0031924a8] [0xc003192478 0xc003192490 0xc0031924a8] [0xc003192488 0xc0031924a0] [0x10f13d0 0x10f13d0] 0xc0022a1380 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:09.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:32:12.841: INFO: rc: 1 Oct 10 09:32:12.841: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003224900 exit status 1 <nil> <nil> true [0xc0031924b0 0xc0031924c8 0xc0031924e0] [0xc0031924b0 0xc0031924c8 0xc0031924e0] [0xc0031924c0 0xc0031924d8] [0x10f13d0 0x10f13d0] 0xc0022a1680 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:13.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:32:16.827: INFO: rc: 1 Oct 10 09:32:16.827: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0032251a0 exit status 1 <nil> <nil> true [0xc0031924e8 0xc003192500 0xc003192518] [0xc0031924e8 0xc003192500 0xc003192518] [0xc0031924f8 0xc003192510] [0x10f13d0 0x10f13d0] 0xc0022a19e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:17.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:32:20.852: INFO: rc: 1 Oct 10 09:32:20.852: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003225a40 exit status 1 <nil> <nil> true [0xc003192520 0xc003192538 0xc003192550] [0xc003192520 0xc003192538 0xc003192550] [0xc003192530 0xc003192548] [0x10f13d0 0x10f13d0] 0xc0022a1ce0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:21.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:32:24.832: INFO: rc: 1 Oct 10 09:32:24.832: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002e00420 exit status 1 <nil> <nil> true [0xc003d7f710 0xc003d7f728 0xc003d7f740] [0xc003d7f710 0xc003d7f728 0xc003d7f740] [0xc003d7f720 0xc003d7f738] [0x10f13d0 0x10f13d0] 0xc0034e1ec0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:25.003: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:32:28.803: INFO: rc: 1 Oct 10 09:32:28.803: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002e00f30 exit status 1 <nil> <nil> true [0xc003d7f748 0xc003d7f760 0xc003d7f778] [0xc003d7f748 0xc003d7f760 0xc003d7f778] [0xc003d7f758 0xc003d7f770] [0x10f13d0 0x10f13d0] 0xc00213a480 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:29.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:32:32.792: INFO: rc: 1 Oct 10 09:32:32.792: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0012d4270 exit status 1 <nil> <nil> true [0xc0033a41d0 0xc0033a41e8 0xc0033a4200] [0xc0033a41d0 0xc0033a41e8 0xc0033a4200] [0xc0033a41e0 0xc0033a41f8] [0x10f13d0 0x10f13d0] 0xc0024289c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:33.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:32:36.882: INFO: rc: 1 Oct 10 09:32:36.882: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0012d4f30 exit status 1 <nil> <nil> true [0xc0033a4208 0xc0033a4220 0xc0033a4238] [0xc0033a4208 0xc0033a4220 0xc0033a4238] [0xc0033a4218 0xc0033a4230] [0x10f13d0 0x10f13d0] 0xc002428cc0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:37.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:32:40.890: INFO: rc: 1 Oct 10 09:32:40.890: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0012d57a0 exit status 1 <nil> <nil> true [0xc0033a4240 0xc0033a4258 0xc0033a4270] [0xc0033a4240 0xc0033a4258 0xc0033a4270] [0xc0033a4250 0xc0033a4268] [0x10f13d0 0x10f13d0] 0xc002429140 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:41.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:32:44.822: INFO: rc: 1 Oct 10 09:32:44.822: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0025a2a50 exit status 1 <nil> <nil> true [0xc003192070 0xc0031920b8 0xc0031920d0] [0xc003192070 0xc0031920b8 0xc0031920d0] [0xc0031920b0 0xc0031920c8] [0x10f13d0 0x10f13d0] 0xc002428240 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:45.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:32:48.783: INFO: rc: 1 Oct 10 09:32:48.783: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00277e8a0 exit status 1 <nil> <nil> true [0xc0021ac000 0xc0021ac038 0xc0021ac058] [0xc0021ac000 0xc0021ac038 0xc0021ac058] [0xc0021ac028 0xc0021ac050] [0x10f13d0 0x10f13d0] 0xc0034e0240 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:49.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:32:52.802: INFO: rc: 1 Oct 10 09:32:52.802: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0029694d0 exit status 1 <nil> <nil> true [0xc0024e4020 0xc0024e4068 0xc0024e40e0] [0xc0024e4020 0xc0024e4068 0xc0024e40e0] [0xc0024e4058 0xc0024e40d8] [0x10f13d0 0x10f13d0] 0xc0024533e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:53.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:32:56.841: INFO: rc: 1 Oct 10 09:32:56.841: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0012d4cf0 exit status 1 <nil> <nil> true [0xc0033a4008 0xc0033a4028 0xc0033a4048] [0xc0033a4008 0xc0033a4028 0xc0033a4048] [0xc0033a4018 0xc0033a4040] [0x10f13d0 0x10f13d0] 0xc002aea240 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:32:57.000: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:33:00.874: INFO: rc: 1 Oct 10 09:33:00.874: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002969d70 exit status 1 <nil> <nil> true [0xc0024e40e8 0xc0024e41b0 0xc0024e4250] [0xc0024e40e8 0xc0024e41b0 0xc0024e4250] [0xc0024e4168 0xc0024e4218] [0x10f13d0 0x10f13d0] 0xc0024536e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:33:00.874: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217' Oct 10 09:33:04.659: INFO: rc: 1 Oct 10 09:33:04.659: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-3555 execpod4md4b -- /bin/sh -x -c nc -zv -t -w 2 18.228.205.178 31217] [] <nil> + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00277f200 exit status 1 <nil> <nil> true [0xc0021ac088 0xc0021ac0f8 0xc0021ac130] [0xc0021ac088 0xc0021ac0f8 0xc0021ac130] [0xc0021ac0c8 0xc0021ac120] [0x10f13d0 0x10f13d0] 0xc0034e0540 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.228.205.178 31217 nc: connect to 18.228.205.178 port 31217 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:33:04.659: FAIL: Service is not reachable within 2m0s timeout on endpoint 18.228.205.178:31217 over TCP protocol Unexpected error: <*errors.errorString | 0xc0000d5080>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Oct 10 09:33:04.659: INFO: Cleaning up the updating NodePorts test service [AfterEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Collecting events from namespace "services-3555". �[1mSTEP�[0m: Found 14 events. Oct 10 09:33:04.973: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for execpod4md4b: {default-scheduler } Scheduled: Successfully assigned services-3555/execpod4md4b to ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:33:04.973: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for nodeport-update-service-txm84: {default-scheduler } Scheduled: Successfully assigned services-3555/nodeport-update-service-txm84 to ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:33:04.973: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for nodeport-update-service-vfslb: {default-scheduler } Scheduled: Successfully assigned services-3555/nodeport-update-service-vfslb to ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:33:04.973: INFO: At 2019-10-10 09:30:42 +0000 UTC - event for nodeport-update-service: {replication-controller } SuccessfulCreate: Created pod: nodeport-update-service-txm84 Oct 10 09:33:04.973: INFO: At 2019-10-10 09:30:42 +0000 UTC - event for nodeport-update-service: {replication-controller } SuccessfulCreate: Created pod: nodeport-update-service-vfslb Oct 10 09:33:04.973: INFO: At 2019-10-10 09:30:42 +0000 UTC - event for nodeport-update-service-txm84: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:33:04.973: INFO: At 2019-10-10 09:30:42 +0000 UTC - event for nodeport-update-service-txm84: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Created: Created container nodeport-update-service Oct 10 09:33:04.973: INFO: At 2019-10-10 09:30:42 +0000 UTC - event for nodeport-update-service-txm84: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Started: Started container nodeport-update-service Oct 10 09:33:04.973: INFO: At 2019-10-10 09:30:42 +0000 UTC - event for nodeport-update-service-vfslb: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:33:04.973: INFO: At 2019-10-10 09:30:42 +0000 UTC - event for nodeport-update-service-vfslb: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Created: Created container nodeport-update-service Oct 10 09:33:04.973: INFO: At 2019-10-10 09:30:43 +0000 UTC - event for nodeport-update-service-vfslb: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Started: Started container nodeport-update-service Oct 10 09:33:04.973: INFO: At 2019-10-10 09:30:46 +0000 UTC - event for execpod4md4b: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Created: Created container agnhost-pause Oct 10 09:33:04.973: INFO: At 2019-10-10 09:30:46 +0000 UTC - event for execpod4md4b: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:33:04.973: INFO: At 2019-10-10 09:30:46 +0000 UTC - event for execpod4md4b: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Started: Started container agnhost-pause Oct 10 09:33:05.118: INFO: POD NODE PHASE GRACE CONDITIONS Oct 10 09:33:05.118: INFO: execpod4md4b ip-172-20-49-15.sa-east-1.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:30:45 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:30:47 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:30:47 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:30:45 +0000 UTC }] Oct 10 09:33:05.118: INFO: nodeport-update-service-txm84 ip-172-20-49-15.sa-east-1.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:30:42 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:30:43 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:30:43 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:30:42 +0000 UTC }] Oct 10 09:33:05.118: INFO: nodeport-update-service-vfslb ip-172-20-42-37.sa-east-1.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:30:42 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:30:44 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:30:44 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:30:42 +0000 UTC }] Oct 10 09:33:05.118: INFO: Oct 10 09:33:05.261: INFO: Logging node info for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:33:05.403: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-37-177.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-37-177.sa-east-1.compute.internal 8ecedabe-969e-476a-8f76-1fb03eedaa56 31306 0 2019-10-10 09:12:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c4.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:master-sa-east-1c kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-37-177.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master:] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-08fb35da4b2014f59,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3949572096 0} {<nil>} 3857004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3844714496 0} {<nil>} 3754604Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:12:53 +0000 UTC,LastTransitionTime:2019-10-10 09:12:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:32:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.177,},NodeAddress{Type:ExternalIP,Address:54.233.97.36,},NodeAddress{Type:Hostname,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-97-36.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:75a86a2fc8e747568f8cd25355ed4a43,SystemUUID:EC277240-730F-D89C-36D2-B12A43ABB39F,BootID:33b7c61a-9c83-42db-9541-8a26846b977a,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[kopeio/etcd-manager@sha256:cb0ed7c56dadbc0f4cd515906d72b30094229d6e0a9fcb7aa44e23680bf9a3a8 kopeio/etcd-manager:3.0.20190930],SizeBytes:656348817,},ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:260130533,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:205085998,},ContainerImage{Names:[kope/dns-controller@sha256:aca3878acdac85716e1317dd2fc85b235551068d667e578fceb9b0e8c3561324 kope/dns-controller:1.15.0-alpha.1],SizeBytes:120867125,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:103791294,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:33:05.404: INFO: Logging kubelet events for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:33:05.563: INFO: Logging pods the kubelet thinks is on node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:33:05.713: INFO: etcd-manager-events-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:05.713: INFO: Container etcd-manager ready: true, restart count 0 Oct 10 09:33:05.713: INFO: kops-controller-76f5d459f8-86j85 started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:05.713: INFO: Container kops-controller ready: true, restart count 0 Oct 10 09:33:05.713: INFO: dns-controller-78ccbffc6d-5pnmw started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:05.713: INFO: Container dns-controller ready: true, restart count 0 Oct 10 09:33:05.713: INFO: etcd-manager-main-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:05.713: INFO: Container etcd-manager ready: true, restart count 0 Oct 10 09:33:05.713: INFO: kube-apiserver-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:05.713: INFO: Container kube-apiserver ready: true, restart count 3 Oct 10 09:33:05.713: INFO: kube-controller-manager-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:05.713: INFO: Container kube-controller-manager ready: true, restart count 0 Oct 10 09:33:05.713: INFO: kube-proxy-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:05.713: INFO: Container kube-proxy ready: true, restart count 3 Oct 10 09:33:05.713: INFO: kube-scheduler-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:05.713: INFO: Container kube-scheduler ready: true, restart count 0 W1010 09:33:05.856860 1021 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:33:06.158: INFO: Latency metrics for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:33:06.158: INFO: Logging node info for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:33:06.301: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-42-37.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-42-37.sa-east-1.compute.internal 8fb9f863-77f2-4451-ba99-614781c1c8bc 32321 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-42-37.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node mounted_volume_expand:mounted-volume-expand-8034 node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-1205":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-4356":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-volume-expand-3381":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-volume-expand-4923":"ip-172-20-42-37.sa-east-1.compute.internal"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-020fda63f6b69c0ea,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:51 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:51 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:51 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:32:51 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.37,},NodeAddress{Type:ExternalIP,Address:54.233.88.138,},NodeAddress{Type:Hostname,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-88-138.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dbea17b1df4f4682b3aea8f7967a81f7,SystemUUID:EC276068-34A4-965C-3CB7-CA4BD3478D25,BootID:883b28de-249e-43a6-8e1c-705f97846842,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa k8s.gcr.io/etcd:3.3.15],SizeBytes:246640776,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:1bafcc6fb1aa990b487850adba9cadc020e42d7905aa8a30481182a477ba24b0 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.10],SizeBytes:61365829,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-01bd3e8125169a372 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0982651b46866db00],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:33:06.301: INFO: Logging kubelet events for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:33:06.445: INFO: Logging pods the kubelet thinks is on node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:33:06.601: INFO: affinity-nodeport-transition-56hp6 started at 2019-10-10 09:30:51 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:06.601: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Oct 10 09:33:06.601: INFO: exec-volume-test-aws-gd9n started at 2019-10-10 09:29:35 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:06.601: INFO: Container exec-container-aws-gd9n ready: false, restart count 0 Oct 10 09:33:06.602: INFO: execpod-affinitygnj62 started at 2019-10-10 09:30:55 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:06.602: INFO: Container agnhost-pause ready: true, restart count 0 Oct 10 09:33:06.602: INFO: dns-test-0780b009-677a-4795-918c-87e1420d3176 started at 2019-10-10 09:33:04 +0000 UTC (0+3 container statuses recorded) Oct 10 09:33:06.602: INFO: Container jessie-querier ready: true, restart count 0 Oct 10 09:33:06.602: INFO: Container querier ready: true, restart count 0 Oct 10 09:33:06.602: INFO: Container webserver ready: true, restart count 0 Oct 10 09:33:06.602: INFO: concurrent-1570699980-8t6cc started at 2019-10-10 09:33:04 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:06.602: INFO: Container c ready: false, restart count 0 Oct 10 09:33:06.602: INFO: exec-volume-test-aws-preprovisionedpv-v2hv started at 2019-10-10 09:28:47 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:06.602: INFO: Container exec-container-aws-preprovisionedpv-v2hv ready: false, restart count 0 Oct 10 09:33:06.602: INFO: kube-proxy-ip-172-20-42-37.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:06.602: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:33:06.602: INFO: nodeport-update-service-vfslb started at 2019-10-10 09:30:42 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:06.602: INFO: Container nodeport-update-service ready: true, restart count 0 Oct 10 09:33:06.602: INFO: hostexec-ip-172-20-42-37.sa-east-1.compute.internal-rrwmb started at 2019-10-10 09:33:01 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:06.602: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:33:06.602: INFO: nfs-server started at 2019-10-10 09:33:05 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:06.602: INFO: Container nfs-server ready: false, restart count 0 W1010 09:33:06.745160 1021 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:33:07.058: INFO: Latency metrics for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:33:07.058: INFO: Logging node info for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:33:07.200: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-49-15.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-49-15.sa-east-1.compute.internal 105a0721-5b17-40b8-b686-ccf439f1ca2a 32091 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-49-15.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6677":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-ephemeral-8821":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-1913":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-6893":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-8860":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-9656":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-5356":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-5574":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-6407":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-volume-expand-3873":"ip-172-20-49-15.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-3724":"csi-mock-csi-mock-volumes-3724","csi-mock-csi-mock-volumes-4205":"csi-mock-csi-mock-volumes-4205","csi-mock-csi-mock-volumes-4873":"csi-mock-csi-mock-volumes-4873","csi-mock-csi-mock-volumes-7612":"csi-mock-csi-mock-volumes-7612","csi-mock-csi-mock-volumes-8888":"csi-mock-csi-mock-volumes-8888"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-056d95303ed61d881,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:32:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.49.15,},NodeAddress{Type:ExternalIP,Address:18.228.205.178,},NodeAddress{Type:Hostname,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-228-205-178.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f468c62663d2465ca17ba5284774252e,SystemUUID:EC23BE58-6EBA-E800-9C73-DEB3BAA2D1B9,BootID:6eb82ab7-2bd7-418a-ba22-36d3a808a22b,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/google-containers/debian-base@sha256:6966a0aedd7592c18ff2dd803c08bd85780ee19f5e3a2e7cf908a4cd837afcde gcr.io/google-containers/debian-base:0.4.1],SizeBytes:42323657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0af4a01f4f7f011af kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0b0fa084d8405fe9e kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0caeace51988095bb],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0af4a01f4f7f011af,DevicePath:/dev/xvdcf,},},Config:nil,},} Oct 10 09:33:07.201: INFO: Logging kubelet events for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:33:07.345: INFO: Logging pods the kubelet thinks is on node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:33:07.491: INFO: execpod4md4b started at 2019-10-10 09:30:45 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:07.492: INFO: Container agnhost-pause ready: true, restart count 0 Oct 10 09:33:07.492: INFO: kube-proxy-ip-172-20-49-15.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:07.492: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:33:07.492: INFO: nodeport-update-service-txm84 started at 2019-10-10 09:30:42 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:07.492: INFO: Container nodeport-update-service ready: true, restart count 0 Oct 10 09:33:07.492: INFO: concurrent-1570699920-tl2zg started at 2019-10-10 09:32:04 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:07.492: INFO: Container c ready: true, restart count 0 Oct 10 09:33:07.492: INFO: pod-adoption-release-t5thb started at 2019-10-10 09:33:04 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:07.492: INFO: Container pod-adoption-release ready: true, restart count 0 Oct 10 09:33:07.492: INFO: security-context-82f55ada-3bac-4f92-b4e2-dcfcc8038868 started at 2019-10-10 09:32:24 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:07.492: INFO: Container write-pod ready: true, restart count 0 Oct 10 09:33:07.492: INFO: pod-adoption-release started at 2019-10-10 09:33:01 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:07.492: INFO: Container pod-adoption-release ready: true, restart count 0 Oct 10 09:33:07.492: INFO: affinity-nodeport-transition-nw2dh started at 2019-10-10 09:30:51 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:07.492: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Oct 10 09:33:07.492: INFO: aws-injector started at 2019-10-10 09:30:35 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:07.492: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:33:07.492: INFO: aws-injector started at 2019-10-10 09:32:03 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:07.492: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:33:07.492: INFO: liveness-4311afc1-047e-4c80-bcf2-fc64d3506dc4 started at 2019-10-10 09:31:52 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:07.492: INFO: Container liveness ready: true, restart count 0 Oct 10 09:33:07.492: INFO: external-provisioner-vj956 started at 2019-10-10 09:32:57 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:07.492: INFO: Container nfs-provisioner ready: true, restart count 0 W1010 09:33:07.635622 1021 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:33:07.955: INFO: Latency metrics for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:33:07.955: INFO: Logging node info for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:33:08.098: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-56-86.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-56-86.sa-east-1.compute.internal cccbef08-fa00-42b5-ae85-da8efe4ee848 32109 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-56-86.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9823":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-provisioning-5677":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-1516":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-6492":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volume-6196":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volumemode-1556":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-1749":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-expand-9939":"ip-172-20-56-86.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-5777":"csi-mock-csi-mock-volumes-5777","csi-mock-csi-mock-volumes-6825":"csi-mock-csi-mock-volumes-6825","csi-mock-csi-mock-volumes-7201":"csi-mock-csi-mock-volumes-7201"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-0b5800b629bcb7519,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:32:41 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.86,},NodeAddress{Type:ExternalIP,Address:54.207.48.88,},NodeAddress{Type:Hostname,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-207-48-88.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:99be0b3f4ec34abb8f4f249d272797b5,SystemUUID:EC2EB353-C506-B251-A10A-9B28B752A967,BootID:e098fcb6-fca7-433b-9b9f-7e47386c5ca0,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 gluster/glusterdynamic-provisioner:v1.0],SizeBytes:373281573,},ContainerImage{Names:[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6],SizeBytes:373099368,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:bbc3a03235220b170ba48a157dd097dd1379299370e1ed99ce976df0355d24f0 busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-028b66335e31eaf4f kubernetes.io/aws-ebs/aws://sa-east-1c/vol-05da71c2f70c6d1e3 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0765fb05bdb37f4b5 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0f597dc8d7319d060],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:33:08.098: INFO: Logging kubelet events for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:33:08.242: INFO: Logging pods the kubelet thinks is on node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:33:08.398: INFO: exec-volume-test-aws-preprovisionedpv-j99q started at 2019-10-10 09:32:17 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:08.398: INFO: Container exec-container-aws-preprovisionedpv-j99q ready: false, restart count 0 Oct 10 09:33:08.398: INFO: pod-prestop-hook-fe8f1708-1303-4f99-97e5-780e64206501 started at 2019-10-10 09:32:53 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:08.398: INFO: Container nginx ready: true, restart count 0 Oct 10 09:33:08.399: INFO: hostexec-ip-172-20-56-86.sa-east-1.compute.internal-98l5z started at 2019-10-10 09:32:48 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:08.399: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:33:08.399: INFO: csi-mockplugin-0 started at 2019-10-10 09:33:02 +0000 UTC (0+3 container statuses recorded) Oct 10 09:33:08.399: INFO: Container csi-provisioner ready: false, restart count 0 Oct 10 09:33:08.399: INFO: Container driver-registrar ready: false, restart count 0 Oct 10 09:33:08.399: INFO: Container mock ready: false, restart count 0 Oct 10 09:33:08.399: INFO: aws-injector started at 2019-10-10 09:28:01 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:08.399: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:33:08.399: INFO: nfs-server started at 2019-10-10 09:33:00 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:08.399: INFO: Container nfs-server ready: true, restart count 0 Oct 10 09:33:08.399: INFO: exec-volume-test-aws-4jlf started at 2019-10-10 09:31:15 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:08.399: INFO: Container exec-container-aws-4jlf ready: false, restart count 0 Oct 10 09:33:08.399: INFO: busybox-scheduling-b1e74f5d-4396-4093-9697-b12b963092ed started at 2019-10-10 09:33:00 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:08.399: INFO: Container busybox-scheduling-b1e74f5d-4396-4093-9697-b12b963092ed ready: true, restart count 0 Oct 10 09:33:08.399: INFO: local-injector started at 2019-10-10 09:33:01 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:08.399: INFO: Container local-injector ready: true, restart count 0 Oct 10 09:33:08.399: INFO: csi-mockplugin-attacher-0 started at 2019-10-10 09:33:02 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:08.399: INFO: Container csi-attacher ready: true, restart count 0 Oct 10 09:33:08.399: INFO: kube-proxy-ip-172-20-56-86.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:08.399: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:33:08.399: INFO: aws-injector started at 2019-10-10 09:31:17 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:08.399: INFO: Container aws-injector ready: false, restart count 0 W1010 09:33:08.542281 1021 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:33:08.874: INFO: Latency metrics for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:33:08.874: INFO: Logging node info for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:33:09.018: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-60-88.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-60-88.sa-east-1.compute.internal f5a2e6d3-a123-4acc-a9b2-8fa0a5c1c28f 32151 0 2019-10-10 09:14:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-60-88.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4801":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-provisioning-2176":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-provisioning-8958":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-9423":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volume-expand-4947":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volume-expand-6712":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volumemode-1292":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volumemode-4728":"ip-172-20-60-88.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-3023":"csi-mock-csi-mock-volumes-3023","csi-mock-csi-mock-volumes-3750":"csi-mock-csi-mock-volumes-3750","csi-mock-csi-mock-volumes-3882":"csi-mock-csi-mock-volumes-3882","csi-mock-csi-mock-volumes-5042":"csi-mock-csi-mock-volumes-5042","csi-mock-csi-mock-volumes-6797":"csi-mock-csi-mock-volumes-6797"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-087c9d5356d3aafe3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146278400 0} {<nil>} 4049100Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041420800 0} {<nil>} 3946700Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:13 +0000 UTC,LastTransitionTime:2019-10-10 09:14:13 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:32:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:32:44 +0000 UTC,LastTransitionTime:2019-10-10 09:14:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.88,},NodeAddress{Type:ExternalIP,Address:18.231.36.128,},NodeAddress{Type:Hostname,Address:ip-172-20-60-88.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-60-88.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-231-36-128.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4f6cfed0b3cc440c814a893a63590a26,SystemUUID:EC2CF3F1-2D60-B6EE-FE1D-D82FEFE80523,BootID:fcb35a82-1eda-4e12-88ea-2fc1cfa0c447,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6],SizeBytes:373099368,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:618a82fa66cf0c75e4753369a6999032372be7308866fc9afb381789b1e5ad52 k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13],SizeBytes:51157394,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:12370202895b621a2ac28226292e4578598f13c1502aa4d3ee90fff4325d9275 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.4.0],SizeBytes:45853555,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-sidecar-amd64@sha256:cedc8fe2098dffc26d17f64061296b7aa54258a31513b6c52df271a98bb522b3 k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.13],SizeBytes:42852039,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64@sha256:45df3e8e0c551bd0c79cdba48ae6677f817971dcbd1eeed7fd1f9a35118410e4 k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13],SizeBytes:41372492,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0559eda2818e41891 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0fac33f38a006d601],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:33:09.018: INFO: Logging kubelet events for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:33:09.163: INFO: Logging pods the kubelet thinks is on node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:33:09.309: INFO: kube-proxy-ip-172-20-60-88.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:09.309: INFO: Container kube-proxy ready: true, restart count 1 Oct 10 09:33:09.309: INFO: kube-dns-autoscaler-66b775459-74nsm started at 2019-10-10 09:14:21 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:09.309: INFO: Container autoscaler ready: true, restart count 0 Oct 10 09:33:09.309: INFO: aws-injector started at 2019-10-10 09:31:02 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:09.309: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:33:09.309: INFO: kube-dns-bb55d6458-g4ktr started at 2019-10-10 09:14:21 +0000 UTC (0+3 container statuses recorded) Oct 10 09:33:09.309: INFO: Container dnsmasq ready: true, restart count 0 Oct 10 09:33:09.309: INFO: Container kubedns ready: true, restart count 0 Oct 10 09:33:09.309: INFO: Container sidecar ready: true, restart count 0 Oct 10 09:33:09.309: INFO: hostexec-ip-172-20-60-88.sa-east-1.compute.internal-2h6xp started at 2019-10-10 09:32:40 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:09.309: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:33:09.309: INFO: test-webserver-b5500d93-d5c7-42df-b520-f4efb65e0c14 started at 2019-10-10 09:33:06 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:09.309: INFO: Container test-webserver ready: false, restart count 0 Oct 10 09:33:09.309: INFO: kube-dns-bb55d6458-cx9kh started at 2019-10-10 09:14:29 +0000 UTC (0+3 container statuses recorded) Oct 10 09:33:09.309: INFO: Container dnsmasq ready: true, restart count 0 Oct 10 09:33:09.309: INFO: Container kubedns ready: true, restart count 0 Oct 10 09:33:09.309: INFO: Container sidecar ready: true, restart count 0 Oct 10 09:33:09.309: INFO: send-events-b72a92c2-d05b-4d51-ba91-01a8cf2cbe82 started at 2019-10-10 09:32:57 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:09.309: INFO: Container p ready: true, restart count 0 Oct 10 09:33:09.309: INFO: busybox-3066a0bd-5e3d-4052-8e17-71b9787d6a4d started at 2019-10-10 09:33:06 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:09.309: INFO: Container busybox ready: true, restart count 0 Oct 10 09:33:09.309: INFO: affinity-nodeport-transition-jxwx6 started at 2019-10-10 09:30:51 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:09.309: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Oct 10 09:33:09.309: INFO: aws-injector started at 2019-10-10 09:32:35 +0000 UTC (0+1 container statuses recorded) Oct 10 09:33:09.309: INFO: Container aws-injector ready: false, restart count 0 W1010 09:33:09.452872 1021 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:33:09.786: INFO: Latency metrics for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:33:09.786: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "services-3555" for this suite. [AfterEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:95
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sServices\sshould\sbe\sable\sto\supdate\sservice\stype\sto\sNodePort\slistening\son\ssame\sport\snumber\sbut\sdifferent\sprotocols$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:940 Oct 10 09:30:35.524: Service is not reachable within 2m0s timeout on endpoint 54.233.88.138:32412 over TCP protocol Unexpected error: <*errors.errorString | 0xc0000d5080>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/service/jig.go:795from junit_01.xml
[BeforeEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:150 �[1mSTEP�[0m: Creating a kubernetes client Oct 10 09:28:08.046: INFO: >>> kubeConfig: /tmp/kops104699295/kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename services �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:91 [It] should be able to update service type to NodePort listening on same port number but different protocols /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:940 �[1mSTEP�[0m: creating a TCP service nodeport-update-service with type=ClusterIP in namespace services-8757 Oct 10 09:28:08.767: INFO: Service Port TCP: 80 �[1mSTEP�[0m: changing the TCP service to type=NodePort �[1mSTEP�[0m: creating replication controller nodeport-update-service in namespace services-8757 I1010 09:28:09.199752 1021 runners.go:189] Created replication controller with name: nodeport-update-service, namespace: services-8757, replica count: 2 I1010 09:28:12.350216 1021 runners.go:189] nodeport-update-service Pods: 2 out of 2 created, 1 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I1010 09:28:15.350484 1021 runners.go:189] nodeport-update-service Pods: 2 out of 2 created, 2 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Oct 10 09:28:15.350: INFO: Creating new exec pod Oct 10 09:28:18.928: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 nodeport-update-service 80' Oct 10 09:28:20.705: INFO: stderr: "+ nc -zv -t -w 2 nodeport-update-service 80\nConnection to nodeport-update-service 80 port [tcp/http] succeeded!\n" Oct 10 09:28:20.705: INFO: stdout: "" Oct 10 09:28:20.706: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 100.64.30.226 80' Oct 10 09:28:22.502: INFO: stderr: "+ nc -zv -t -w 2 100.64.30.226 80\nConnection to 100.64.30.226 80 port [tcp/http] succeeded!\n" Oct 10 09:28:22.502: INFO: stdout: "" Oct 10 09:28:22.502: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 172.20.42.37 32412' Oct 10 09:28:24.280: INFO: stderr: "+ nc -zv -t -w 2 172.20.42.37 32412\nConnection to 172.20.42.37 32412 port [tcp/32412] succeeded!\n" Oct 10 09:28:24.280: INFO: stdout: "" Oct 10 09:28:24.281: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 172.20.49.15 32412' Oct 10 09:28:26.122: INFO: stderr: "+ nc -zv -t -w 2 172.20.49.15 32412\nConnection to 172.20.49.15 32412 port [tcp/32412] succeeded!\n" Oct 10 09:28:26.122: INFO: stdout: "" Oct 10 09:28:26.122: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:28:29.930: INFO: rc: 1 Oct 10 09:28:29.931: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00315d3e0 exit status 1 <nil> <nil> true [0xc003192338 0xc003192360 0xc003192390] [0xc003192338 0xc003192360 0xc003192390] [0xc003192350 0xc003192380] [0x10f13d0 0x10f13d0] 0xc0034e15c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:30.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:28:34.727: INFO: rc: 1 Oct 10 09:28:34.727: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00315dd70 exit status 1 <nil> <nil> true [0xc0031923a0 0xc0031923e0 0xc0031923f8] [0xc0031923a0 0xc0031923e0 0xc0031923f8] [0xc0031923c0 0xc0031923f0] [0x10f13d0 0x10f13d0] 0xc0034e1980 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:34.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:28:38.762: INFO: rc: 1 Oct 10 09:28:38.762: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002ba6630 exit status 1 <nil> <nil> true [0xc003192400 0xc003192418 0xc003192430] [0xc003192400 0xc003192418 0xc003192430] [0xc003192410 0xc003192428] [0x10f13d0 0x10f13d0] 0xc0034e1c80 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:38.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:28:42.736: INFO: rc: 1 Oct 10 09:28:42.736: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002ba6f00 exit status 1 <nil> <nil> true [0xc003192438 0xc003192458 0xc003192470] [0xc003192438 0xc003192458 0xc003192470] [0xc003192450 0xc003192468] [0x10f13d0 0x10f13d0] 0xc0022a0060 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:42.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:28:46.726: INFO: rc: 1 Oct 10 09:28:46.727: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002ba77d0 exit status 1 <nil> <nil> true [0xc003192478 0xc003192490 0xc0031924a8] [0xc003192478 0xc003192490 0xc0031924a8] [0xc003192488 0xc0031924a0] [0x10f13d0 0x10f13d0] 0xc0022a0360 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:46.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:28:50.728: INFO: rc: 1 Oct 10 09:28:50.728: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002d9dce0 exit status 1 <nil> <nil> true [0xc00167d590 0xc00167d658 0xc00167d740] [0xc00167d590 0xc00167d658 0xc00167d740] [0xc00167d5f8 0xc00167d6f0] [0x10f13d0 0x10f13d0] 0xc002452600 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:50.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:28:54.724: INFO: rc: 1 Oct 10 09:28:54.724: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002a88090 exit status 1 <nil> <nil> true [0xc0031924b0 0xc0031924c8 0xc0031924e0] [0xc0031924b0 0xc0031924c8 0xc0031924e0] [0xc0031924c0 0xc0031924d8] [0x10f13d0 0x10f13d0] 0xc0022a0660 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:54.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:28:58.758: INFO: rc: 1 Oct 10 09:28:58.758: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002a88900 exit status 1 <nil> <nil> true [0xc0031924e8 0xc003192500 0xc003192518] [0xc0031924e8 0xc003192500 0xc003192518] [0xc0031924f8 0xc003192510] [0x10f13d0 0x10f13d0] 0xc0022a0960 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:58.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:29:02.722: INFO: rc: 1 Oct 10 09:29:02.722: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0029697a0 exit status 1 <nil> <nil> true [0xc00167d770 0xc00167d8c8 0xc00167d978] [0xc00167d770 0xc00167d8c8 0xc00167d978] [0xc00167d808 0xc00167d938] [0x10f13d0 0x10f13d0] 0xc002452900 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:29:02.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:29:06.742: INFO: rc: 1 Oct 10 09:29:06.742: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0027b4060 exit status 1 <nil> <nil> true [0xc00167d9b8 0xc00167dad8 0xc00167db38] [0xc00167d9b8 0xc00167dad8 0xc00167db38] [0xc00167da00 0xc00167db00] [0x10f13d0 0x10f13d0] 0xc002452c60 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:29:06.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:29:10.776: INFO: rc: 1 Oct 10 09:29:10.776: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002e00b40 exit status 1 <nil> <nil> true [0xc0024e4020 0xc0024e4068 0xc0024e40e0] [0xc0024e4020 0xc0024e4068 0xc0024e40e0] [0xc0024e4058 0xc0024e40d8] [0x10f13d0 0x10f13d0] 0xc0028e0240 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:29:10.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:29:14.945: INFO: rc: 1 Oct 10 09:29:14.945: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00256b950 exit status 1 <nil> <nil> true [0xc00197f170 0xc00197f210 0xc00197f2f0] [0xc00197f170 0xc00197f210 0xc00197f2f0] [0xc00197f1f0 0xc00197f290] [0x10f13d0 0x10f13d0] 0xc0035b75c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:29:15.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:29:19.891: INFO: rc: 1 Oct 10 09:29:19.892: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00277e420 exit status 1 <nil> <nil> true [0xc00167db58 0xc00167dc18 0xc00167dc78] [0xc00167db58 0xc00167dc18 0xc00167dc78] [0xc00167dbd8 0xc00167dc60] [0x10f13d0 0x10f13d0] 0xc002452fc0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:29:19.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:29:23.701: INFO: rc: 1 Oct 10 09:29:23.702: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002e013b0 exit status 1 <nil> <nil> true [0xc0024e40e8 0xc0024e41b0 0xc0024e4250] [0xc0024e40e8 0xc0024e41b0 0xc0024e4250] [0xc0024e4168 0xc0024e4218] [0x10f13d0 0x10f13d0] 0xc0028e0540 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:29:23.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:29:27.744: INFO: rc: 1 Oct 10 09:29:27.744: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0025a23f0 exit status 1 <nil> <nil> true [0xc00197f368 0xc00197f428 0xc00197f518] [0xc00197f368 0xc00197f428 0xc00197f518] [0xc00197f3c0 0xc00197f4e0] [0x10f13d0 0x10f13d0] 0xc0035b78c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:29:27.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:29:31.751: INFO: rc: 1 Oct 10 09:29:31.751: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002e01c50 exit status 1 <nil> <nil> true [0xc0024e4288 0xc0024e42c8 0xc0024e4318] [0xc0024e4288 0xc0024e42c8 0xc0024e4318] [0xc0024e4298 0xc0024e4310] [0x10f13d0 0x10f13d0] 0xc0028e18c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:29:31.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:29:35.704: INFO: rc: 1 Oct 10 09:29:35.705: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0025a2d80 exit status 1 <nil> <nil> true [0xc00197f548 0xc00197f600 0xc00197f748] [0xc00197f548 0xc00197f600 0xc00197f748] [0xc00197f5c8 0xc00197f6c8] [0x10f13d0 0x10f13d0] 0xc0035b7bc0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:29:35.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:29:39.745: INFO: rc: 1 Oct 10 09:29:39.745: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00277ede0 exit status 1 <nil> <nil> true [0xc00167dca0 0xc00167ddf0 0xc00167dfa8] [0xc00167dca0 0xc00167ddf0 0xc00167dfa8] [0xc00167dda8 0xc00167df58] [0x10f13d0 0x10f13d0] 0xc0024532c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:29:39.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:29:43.728: INFO: rc: 1 Oct 10 09:29:43.729: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00277f650 exit status 1 <nil> <nil> true [0xc00167dfc8 0xc0021ac000 0xc0021ac038] [0xc00167dfc8 0xc0021ac000 0xc0021ac038] [0xc00167dff0 0xc0021ac028] [0x10f13d0 0x10f13d0] 0xc0024535c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:29:43.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:29:47.761: INFO: rc: 1 Oct 10 09:29:47.761: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0025a37a0 exit status 1 <nil> <nil> true [0xc00197f768 0xc00197f848 0xc00197f938] [0xc00197f768 0xc00197f848 0xc00197f938] [0xc00197f7f0 0xc00197f8e0] [0x10f13d0 0x10f13d0] 0xc0024280c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:29:47.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:29:51.735: INFO: rc: 1 Oct 10 09:29:51.735: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00277fec0 exit status 1 <nil> <nil> true [0xc0021ac048 0xc0021ac060 0xc0021ac0c8] [0xc0021ac048 0xc0021ac060 0xc0021ac0c8] [0xc0021ac058 0xc0021ac0b8] [0x10f13d0 0x10f13d0] 0xc002453980 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:29:51.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:29:55.700: INFO: rc: 1 Oct 10 09:29:55.701: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001472780 exit status 1 <nil> <nil> true [0xc0021ac0f8 0xc0021ac130 0xc0021ac198] [0xc0021ac0f8 0xc0021ac130 0xc0021ac198] [0xc0021ac120 0xc0021ac188] [0x10f13d0 0x10f13d0] 0xc002453ce0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:29:55.932: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:29:59.772: INFO: rc: 1 Oct 10 09:29:59.772: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0012d40c0 exit status 1 <nil> <nil> true [0xc00197f958 0xc00197fa78 0xc00197fb10] [0xc00197f958 0xc00197fa78 0xc00197fb10] [0xc00197fa10 0xc00197fad0] [0x10f13d0 0x10f13d0] 0xc0024283c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:29:59.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:30:03.712: INFO: rc: 1 Oct 10 09:30:03.712: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0025a2ab0 exit status 1 <nil> <nil> true [0xc000a10090 0xc000a10b58 0xc000a11320] [0xc000a10090 0xc000a10b58 0xc000a11320] [0xc000a106e8 0xc000a110c0] [0x10f13d0 0x10f13d0] 0xc002aeb440 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:30:03.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:30:07.756: INFO: rc: 1 Oct 10 09:30:07.756: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0029694d0 exit status 1 <nil> <nil> true [0xc0000eb0d0 0xc0000eb8d8 0xc0000ebbe0] [0xc0000eb0d0 0xc0000eb8d8 0xc0000ebbe0] [0xc0000eb680 0xc0000ebb28] [0x10f13d0 0x10f13d0] 0xc0024284e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:30:07.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:30:11.720: INFO: rc: 1 Oct 10 09:30:11.720: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00277e930 exit status 1 <nil> <nil> true [0xc00167c020 0xc00167c190 0xc00167c268] [0xc00167c020 0xc00167c190 0xc00167c268] [0xc00167c0c0 0xc00167c230] [0x10f13d0 0x10f13d0] 0xc0028e0240 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:30:11.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:30:15.714: INFO: rc: 1 Oct 10 09:30:15.714: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002969d70 exit status 1 <nil> <nil> true [0xc0000ebe50 0xc00197e0f0 0xc00197e1c0] [0xc0000ebe50 0xc00197e0f0 0xc00197e1c0] [0xc00197e088 0xc00197e1a8] [0x10f13d0 0x10f13d0] 0xc0024287e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:30:15.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:30:19.728: INFO: rc: 1 Oct 10 09:30:19.728: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002ba6660 exit status 1 <nil> <nil> true [0xc00197e228 0xc00197e320 0xc00197e3e8] [0xc00197e228 0xc00197e320 0xc00197e3e8] [0xc00197e300 0xc00197e390] [0x10f13d0 0x10f13d0] 0xc002428ae0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:30:19.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:30:23.747: INFO: rc: 1 Oct 10 09:30:23.748: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002ba6f60 exit status 1 <nil> <nil> true [0xc00197e4a0 0xc00197e5d0 0xc00197e760] [0xc00197e4a0 0xc00197e5d0 0xc00197e760] [0xc00197e560 0xc00197e6d0] [0x10f13d0 0x10f13d0] 0xc002428de0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:30:23.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:30:27.737: INFO: rc: 1 Oct 10 09:30:27.738: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00315c960 exit status 1 <nil> <nil> true [0xc0024e4020 0xc0024e4068 0xc0024e40e0] [0xc0024e4020 0xc0024e4068 0xc0024e40e0] [0xc0024e4058 0xc0024e40d8] [0x10f13d0 0x10f13d0] 0xc0035b6240 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:30:27.931: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:30:31.727: INFO: rc: 1 Oct 10 09:30:31.728: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00277f320 exit status 1 <nil> <nil> true [0xc00167c298 0xc00167c3e8 0xc00167c430] [0xc00167c298 0xc00167c3e8 0xc00167c430] [0xc00167c360 0xc00167c3f8] [0x10f13d0 0x10f13d0] 0xc0028e0540 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:30:31.728: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412' Oct 10 09:30:35.524: INFO: rc: 1 Oct 10 09:30:35.524: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-8757 execpodk5xvl -- /bin/sh -x -c nc -zv -t -w 2 54.233.88.138 32412] [] <nil> + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00277fbf0 exit status 1 <nil> <nil> true [0xc00167c480 0xc00167c528 0xc00167c630] [0xc00167c480 0xc00167c528 0xc00167c630] [0xc00167c4e0 0xc00167c5e0] [0x10f13d0 0x10f13d0] 0xc0028e18c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.233.88.138 32412 nc: connect to 54.233.88.138 port 32412 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:30:35.524: FAIL: Service is not reachable within 2m0s timeout on endpoint 54.233.88.138:32412 over TCP protocol Unexpected error: <*errors.errorString | 0xc0000d5080>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Oct 10 09:30:35.525: INFO: Cleaning up the updating NodePorts test service [AfterEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Collecting events from namespace "services-8757". �[1mSTEP�[0m: Found 14 events. Oct 10 09:30:35.828: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for execpodk5xvl: {default-scheduler } Scheduled: Successfully assigned services-8757/execpodk5xvl to ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:30:35.828: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for nodeport-update-service-frhgm: {default-scheduler } Scheduled: Successfully assigned services-8757/nodeport-update-service-frhgm to ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:30:35.828: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for nodeport-update-service-vzq6h: {default-scheduler } Scheduled: Successfully assigned services-8757/nodeport-update-service-vzq6h to ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:30:35.828: INFO: At 2019-10-10 09:28:09 +0000 UTC - event for nodeport-update-service: {replication-controller } SuccessfulCreate: Created pod: nodeport-update-service-frhgm Oct 10 09:30:35.828: INFO: At 2019-10-10 09:28:09 +0000 UTC - event for nodeport-update-service: {replication-controller } SuccessfulCreate: Created pod: nodeport-update-service-vzq6h Oct 10 09:30:35.828: INFO: At 2019-10-10 09:28:09 +0000 UTC - event for nodeport-update-service-vzq6h: {kubelet ip-172-20-60-88.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:30:35.828: INFO: At 2019-10-10 09:28:09 +0000 UTC - event for nodeport-update-service-vzq6h: {kubelet ip-172-20-60-88.sa-east-1.compute.internal} Created: Created container nodeport-update-service Oct 10 09:30:35.828: INFO: At 2019-10-10 09:28:10 +0000 UTC - event for nodeport-update-service-frhgm: {kubelet ip-172-20-56-86.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:30:35.828: INFO: At 2019-10-10 09:28:10 +0000 UTC - event for nodeport-update-service-frhgm: {kubelet ip-172-20-56-86.sa-east-1.compute.internal} Created: Created container nodeport-update-service Oct 10 09:30:35.828: INFO: At 2019-10-10 09:28:10 +0000 UTC - event for nodeport-update-service-vzq6h: {kubelet ip-172-20-60-88.sa-east-1.compute.internal} Started: Started container nodeport-update-service Oct 10 09:30:35.828: INFO: At 2019-10-10 09:28:11 +0000 UTC - event for nodeport-update-service-frhgm: {kubelet ip-172-20-56-86.sa-east-1.compute.internal} Started: Started container nodeport-update-service Oct 10 09:30:35.828: INFO: At 2019-10-10 09:28:16 +0000 UTC - event for execpodk5xvl: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Created: Created container agnhost-pause Oct 10 09:30:35.828: INFO: At 2019-10-10 09:28:16 +0000 UTC - event for execpodk5xvl: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:30:35.828: INFO: At 2019-10-10 09:28:16 +0000 UTC - event for execpodk5xvl: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Started: Started container agnhost-pause Oct 10 09:30:35.971: INFO: POD NODE PHASE GRACE CONDITIONS Oct 10 09:30:35.971: INFO: execpodk5xvl ip-172-20-49-15.sa-east-1.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:28:15 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:28:16 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:28:16 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:28:15 +0000 UTC }] Oct 10 09:30:35.971: INFO: nodeport-update-service-frhgm ip-172-20-56-86.sa-east-1.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:28:09 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:28:12 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:28:12 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:28:09 +0000 UTC }] Oct 10 09:30:35.971: INFO: nodeport-update-service-vzq6h ip-172-20-60-88.sa-east-1.compute.internal Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:28:09 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:28:10 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:28:10 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-10-10 09:28:09 +0000 UTC }] Oct 10 09:30:35.971: INFO: Oct 10 09:30:36.115: INFO: Logging node info for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:30:36.257: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-37-177.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-37-177.sa-east-1.compute.internal 8ecedabe-969e-476a-8f76-1fb03eedaa56 26931 0 2019-10-10 09:12:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c4.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:master-sa-east-1c kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-37-177.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master:] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-08fb35da4b2014f59,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3949572096 0} {<nil>} 3857004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3844714496 0} {<nil>} 3754604Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:12:53 +0000 UTC,LastTransitionTime:2019-10-10 09:12:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:30:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:30:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:30:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:30:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.177,},NodeAddress{Type:ExternalIP,Address:54.233.97.36,},NodeAddress{Type:Hostname,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-97-36.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:75a86a2fc8e747568f8cd25355ed4a43,SystemUUID:EC277240-730F-D89C-36D2-B12A43ABB39F,BootID:33b7c61a-9c83-42db-9541-8a26846b977a,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[kopeio/etcd-manager@sha256:cb0ed7c56dadbc0f4cd515906d72b30094229d6e0a9fcb7aa44e23680bf9a3a8 kopeio/etcd-manager:3.0.20190930],SizeBytes:656348817,},ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:260130533,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:205085998,},ContainerImage{Names:[kope/dns-controller@sha256:aca3878acdac85716e1317dd2fc85b235551068d667e578fceb9b0e8c3561324 kope/dns-controller:1.15.0-alpha.1],SizeBytes:120867125,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:103791294,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:30:36.258: INFO: Logging kubelet events for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:30:36.430: INFO: Logging pods the kubelet thinks is on node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:30:36.575: INFO: kube-scheduler-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:36.575: INFO: Container kube-scheduler ready: true, restart count 0 Oct 10 09:30:36.575: INFO: etcd-manager-events-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:36.575: INFO: Container etcd-manager ready: true, restart count 0 Oct 10 09:30:36.575: INFO: kops-controller-76f5d459f8-86j85 started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:36.575: INFO: Container kops-controller ready: true, restart count 0 Oct 10 09:30:36.575: INFO: dns-controller-78ccbffc6d-5pnmw started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:36.575: INFO: Container dns-controller ready: true, restart count 0 Oct 10 09:30:36.575: INFO: etcd-manager-main-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:36.575: INFO: Container etcd-manager ready: true, restart count 0 Oct 10 09:30:36.575: INFO: kube-apiserver-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:36.575: INFO: Container kube-apiserver ready: true, restart count 3 Oct 10 09:30:36.575: INFO: kube-controller-manager-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:36.575: INFO: Container kube-controller-manager ready: true, restart count 0 Oct 10 09:30:36.575: INFO: kube-proxy-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:36.575: INFO: Container kube-proxy ready: true, restart count 3 W1010 09:30:36.719058 1021 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:30:37.019: INFO: Latency metrics for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:30:37.019: INFO: Logging node info for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:30:37.162: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-42-37.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-42-37.sa-east-1.compute.internal 8fb9f863-77f2-4451-ba99-614781c1c8bc 27347 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-42-37.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node mounted_volume_expand:mounted-volume-expand-8034 node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-1205":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-4356":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-volume-expand-3381":"ip-172-20-42-37.sa-east-1.compute.internal"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-020fda63f6b69c0ea,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:30:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:30:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:30:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:30:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.37,},NodeAddress{Type:ExternalIP,Address:54.233.88.138,},NodeAddress{Type:Hostname,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-88-138.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dbea17b1df4f4682b3aea8f7967a81f7,SystemUUID:EC276068-34A4-965C-3CB7-CA4BD3478D25,BootID:883b28de-249e-43a6-8e1c-705f97846842,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa k8s.gcr.io/etcd:3.3.15],SizeBytes:246640776,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:1bafcc6fb1aa990b487850adba9cadc020e42d7905aa8a30481182a477ba24b0 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.10],SizeBytes:61365829,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0194c1f06c834833d kubernetes.io/aws-ebs/aws://sa-east-1c/vol-01bd3e8125169a372 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0982651b46866db00 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0fdd29053b527a7bf],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:30:37.162: INFO: Logging kubelet events for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:30:37.307: INFO: Logging pods the kubelet thinks is on node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:30:37.453: INFO: liveness-fc1ba5f3-3014-4f03-8828-a28e3a11bf07 started at 2019-10-10 09:27:19 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:37.453: INFO: Container liveness ready: true, restart count 0 Oct 10 09:30:37.453: INFO: exec-volume-test-aws-gd9n started at 2019-10-10 09:29:35 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:37.453: INFO: Container exec-container-aws-gd9n ready: false, restart count 0 Oct 10 09:30:37.453: INFO: sample-crd-conversion-webhook-deployment-64d485d9bb-8c8m6 started at 2019-10-10 09:30:30 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:37.453: INFO: Container sample-crd-conversion-webhook ready: true, restart count 0 Oct 10 09:30:37.453: INFO: hostexec-ip-172-20-42-37.sa-east-1.compute.internal-rxkbw started at 2019-10-10 09:30:25 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:37.453: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:30:37.453: INFO: aws-injector started at 2019-10-10 09:22:26 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:37.453: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:30:37.453: INFO: exec-volume-test-aws-preprovisionedpv-v2hv started at 2019-10-10 09:28:47 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:37.453: INFO: Container exec-container-aws-preprovisionedpv-v2hv ready: false, restart count 0 Oct 10 09:30:37.453: INFO: kube-proxy-ip-172-20-42-37.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:37.453: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:30:37.453: INFO: hostexec-ip-172-20-42-37.sa-east-1.compute.internal-hgzs4 started at 2019-10-10 09:30:12 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:37.453: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:30:37.453: INFO: exec-volume-test-aws-qfkw started at 2019-10-10 09:26:02 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:37.453: INFO: Container exec-container-aws-qfkw ready: false, restart count 0 Oct 10 09:30:37.453: INFO: ss-1 started at 2019-10-10 09:30:23 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:37.453: INFO: Container webserver ready: true, restart count 0 Oct 10 09:30:37.453: INFO: pod-subpath-test-local-preprovisionedpv-hjk5 started at 2019-10-10 09:30:33 +0000 UTC (0+2 container statuses recorded) Oct 10 09:30:37.453: INFO: Container test-container-subpath-local-preprovisionedpv-hjk5 ready: false, restart count 0 Oct 10 09:30:37.453: INFO: Container test-container-volume-local-preprovisionedpv-hjk5 ready: true, restart count 0 Oct 10 09:30:37.453: INFO: pod-subpath-test-local-preprovisionedpv-8lp5 started at 2019-10-10 09:30:32 +0000 UTC (1+1 container statuses recorded) Oct 10 09:30:37.454: INFO: Init container init-volume-local-preprovisionedpv-8lp5 ready: true, restart count 0 Oct 10 09:30:37.454: INFO: Container test-container-subpath-local-preprovisionedpv-8lp5 ready: true, restart count 0 W1010 09:30:37.601264 1021 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:30:37.939: INFO: Latency metrics for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:30:37.940: INFO: Logging node info for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:30:38.083: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-49-15.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-49-15.sa-east-1.compute.internal 105a0721-5b17-40b8-b686-ccf439f1ca2a 27658 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-49-15.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6677":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-1913":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-6893":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-8860":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-9656":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-5356":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-5574":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-6407":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-volume-expand-3873":"ip-172-20-49-15.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-3724":"csi-mock-csi-mock-volumes-3724","csi-mock-csi-mock-volumes-4205":"csi-mock-csi-mock-volumes-4205","csi-mock-csi-mock-volumes-7612":"csi-mock-csi-mock-volumes-7612","csi-mock-csi-mock-volumes-8888":"csi-mock-csi-mock-volumes-8888"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-056d95303ed61d881,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:30:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:30:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:30:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:30:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.49.15,},NodeAddress{Type:ExternalIP,Address:18.228.205.178,},NodeAddress{Type:Hostname,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-228-205-178.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f468c62663d2465ca17ba5284774252e,SystemUUID:EC23BE58-6EBA-E800-9C73-DEB3BAA2D1B9,BootID:6eb82ab7-2bd7-418a-ba22-36d3a808a22b,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[gcr.io/google-containers/debian-base@sha256:6966a0aedd7592c18ff2dd803c08bd85780ee19f5e3a2e7cf908a4cd837afcde gcr.io/google-containers/debian-base:0.4.1],SizeBytes:42323657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-04d62f6373ff4cab2],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/aws-ebs/aws://sa-east-1c/vol-04d62f6373ff4cab2,DevicePath:/dev/xvdbu,},},Config:nil,},} Oct 10 09:30:38.083: INFO: Logging kubelet events for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:30:38.291: INFO: Logging pods the kubelet thinks is on node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:30:38.437: INFO: kube-proxy-ip-172-20-49-15.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:38.437: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:30:38.437: INFO: ss2-1 started at 2019-10-10 09:30:26 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:38.437: INFO: Container webserver ready: true, restart count 0 Oct 10 09:30:38.437: INFO: pod-secrets-aee72587-d950-4f0c-a471-7d2c193bba72 started at 2019-10-10 09:30:31 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:38.437: INFO: Container secret-volume-test ready: false, restart count 0 Oct 10 09:30:38.437: INFO: nfs-server started at 2019-10-10 09:30:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:38.437: INFO: Container nfs-server ready: true, restart count 0 Oct 10 09:30:38.437: INFO: exceed-active-deadline-8dzct started at 2019-10-10 09:30:30 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:38.437: INFO: Container c ready: true, restart count 0 Oct 10 09:30:38.437: INFO: execpodk5xvl started at 2019-10-10 09:28:15 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:38.437: INFO: Container agnhost-pause ready: true, restart count 0 Oct 10 09:30:38.437: INFO: aws-injector started at 2019-10-10 09:30:35 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:38.437: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:30:38.437: INFO: external-provisioner-fv64j started at 2019-10-10 09:30:28 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:38.437: INFO: Container nfs-provisioner ready: true, restart count 0 Oct 10 09:30:38.437: INFO: downward-api-cde52b1e-34aa-445d-8373-80542e4d7e89 started at 2019-10-10 09:30:32 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:38.437: INFO: Container dapi-container ready: false, restart count 0 Oct 10 09:30:38.437: INFO: exceed-active-deadline-mclxh started at 2019-10-10 09:30:30 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:38.437: INFO: Container c ready: false, restart count 0 Oct 10 09:30:38.437: INFO: liveness-c9eab8da-d94e-40d1-9c55-97b080c0e76d started at 2019-10-10 09:29:57 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:38.437: INFO: Container liveness ready: true, restart count 2 W1010 09:30:38.582629 1021 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:30:38.905: INFO: Latency metrics for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:30:38.905: INFO: Logging node info for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:30:39.048: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-56-86.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-56-86.sa-east-1.compute.internal cccbef08-fa00-42b5-ae85-da8efe4ee848 27662 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-56-86.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9823":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-provisioning-5677":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-1516":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volume-6196":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volumemode-1556":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-1749":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-expand-9939":"ip-172-20-56-86.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-5777":"csi-mock-csi-mock-volumes-5777","csi-mock-csi-mock-volumes-6825":"csi-mock-csi-mock-volumes-6825","csi-mock-csi-mock-volumes-7201":"csi-mock-csi-mock-volumes-7201"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-0b5800b629bcb7519,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:30:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:30:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:30:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:30:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.86,},NodeAddress{Type:ExternalIP,Address:54.207.48.88,},NodeAddress{Type:Hostname,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-207-48-88.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:99be0b3f4ec34abb8f4f249d272797b5,SystemUUID:EC2EB353-C506-B251-A10A-9B28B752A967,BootID:e098fcb6-fca7-433b-9b9f-7e47386c5ca0,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6],SizeBytes:373099368,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:bbc3a03235220b170ba48a157dd097dd1379299370e1ed99ce976df0355d24f0 busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-023ab0ee87ab378fe kubernetes.io/aws-ebs/aws://sa-east-1c/vol-028b66335e31eaf4f kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0bb9f5b60081bc7bc kubernetes.io/csi/csi-hostpath-provisioning-5677^9491aacf-eb40-11e9-a23a-0abd65add406],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0bb9f5b60081bc7bc,DevicePath:/dev/xvdcz,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-5677^9491aacf-eb40-11e9-a23a-0abd65add406,DevicePath:,},},Config:nil,},} Oct 10 09:30:39.049: INFO: Logging kubelet events for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:30:39.193: INFO: Logging pods the kubelet thinks is on node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:30:39.342: INFO: kube-proxy-ip-172-20-56-86.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:39.342: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:30:39.342: INFO: csi-hostpathplugin-0 started at 2019-10-10 09:30:19 +0000 UTC (0+3 container statuses recorded) Oct 10 09:30:39.342: INFO: Container hostpath ready: true, restart count 0 Oct 10 09:30:39.342: INFO: Container liveness-probe ready: true, restart count 0 Oct 10 09:30:39.342: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 10 09:30:39.342: INFO: csi-hostpath-resizer-0 started at 2019-10-10 09:30:20 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:39.342: INFO: Container csi-resizer ready: true, restart count 0 Oct 10 09:30:39.342: INFO: pod-subpath-test-csi-hostpath-dynamicpv-vh4n started at 2019-10-10 09:30:23 +0000 UTC (1+1 container statuses recorded) Oct 10 09:30:39.342: INFO: Init container init-volume-csi-hostpath-dynamicpv-vh4n ready: true, restart count 0 Oct 10 09:30:39.342: INFO: Container test-container-subpath-csi-hostpath-dynamicpv-vh4n ready: true, restart count 0 Oct 10 09:30:39.342: INFO: ss2-2 started at 2019-10-10 09:30:16 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:39.342: INFO: Container webserver ready: true, restart count 0 Oct 10 09:30:39.342: INFO: aws-injector started at 2019-10-10 09:28:01 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:39.342: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:30:39.342: INFO: csi-hostpath-attacher-0 started at 2019-10-10 09:30:19 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:39.342: INFO: Container csi-attacher ready: true, restart count 0 Oct 10 09:30:39.342: INFO: ss-1 started at 2019-10-10 09:29:20 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:39.342: INFO: Container webserver ready: false, restart count 0 Oct 10 09:30:39.342: INFO: csi-hostpath-provisioner-0 started at 2019-10-10 09:30:19 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:39.342: INFO: Container csi-provisioner ready: true, restart count 0 Oct 10 09:30:39.342: INFO: aws-injector started at 2019-10-10 09:21:46 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:39.342: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:30:39.342: INFO: ss-0 started at 2019-10-10 09:30:12 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:39.342: INFO: Container webserver ready: true, restart count 0 Oct 10 09:30:39.342: INFO: hostexec-ip-172-20-56-86.sa-east-1.compute.internal-td8nc started at 2019-10-10 09:30:16 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:39.342: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:30:39.342: INFO: csi-snapshotter-0 started at 2019-10-10 09:30:20 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:39.342: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 10 09:30:39.342: INFO: nodeport-update-service-frhgm started at 2019-10-10 09:28:09 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:39.342: INFO: Container nodeport-update-service ready: true, restart count 0 W1010 09:30:39.488908 1021 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:30:39.812: INFO: Latency metrics for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:30:39.812: INFO: Logging node info for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:30:39.960: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-60-88.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-60-88.sa-east-1.compute.internal f5a2e6d3-a123-4acc-a9b2-8fa0a5c1c28f 27104 0 2019-10-10 09:14:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-60-88.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4801":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-provisioning-2176":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-provisioning-8958":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-9423":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volume-expand-4947":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volume-expand-6712":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volumemode-4728":"ip-172-20-60-88.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-3023":"csi-mock-csi-mock-volumes-3023","csi-mock-csi-mock-volumes-3882":"csi-mock-csi-mock-volumes-3882","csi-mock-csi-mock-volumes-5042":"csi-mock-csi-mock-volumes-5042","csi-mock-csi-mock-volumes-6797":"csi-mock-csi-mock-volumes-6797"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-087c9d5356d3aafe3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146278400 0} {<nil>} 4049100Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041420800 0} {<nil>} 3946700Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:13 +0000 UTC,LastTransitionTime:2019-10-10 09:14:13 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:30:14 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:30:14 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:30:14 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:30:14 +0000 UTC,LastTransitionTime:2019-10-10 09:14:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.88,},NodeAddress{Type:ExternalIP,Address:18.231.36.128,},NodeAddress{Type:Hostname,Address:ip-172-20-60-88.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-60-88.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-231-36-128.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4f6cfed0b3cc440c814a893a63590a26,SystemUUID:EC2CF3F1-2D60-B6EE-FE1D-D82FEFE80523,BootID:fcb35a82-1eda-4e12-88ea-2fc1cfa0c447,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6],SizeBytes:373099368,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:618a82fa66cf0c75e4753369a6999032372be7308866fc9afb381789b1e5ad52 k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13],SizeBytes:51157394,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:12370202895b621a2ac28226292e4578598f13c1502aa4d3ee90fff4325d9275 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.4.0],SizeBytes:45853555,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-sidecar-amd64@sha256:cedc8fe2098dffc26d17f64061296b7aa54258a31513b6c52df271a98bb522b3 k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.13],SizeBytes:42852039,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64@sha256:45df3e8e0c551bd0c79cdba48ae6677f817971dcbd1eeed7fd1f9a35118410e4 k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13],SizeBytes:41372492,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-004155116e0252475 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0269672c060d2e367],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0269672c060d2e367,DevicePath:/dev/xvdbi,},},Config:nil,},} Oct 10 09:30:39.961: INFO: Logging kubelet events for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:30:40.138: INFO: Logging pods the kubelet thinks is on node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:30:40.284: INFO: kube-dns-bb55d6458-cx9kh started at 2019-10-10 09:14:29 +0000 UTC (0+3 container statuses recorded) Oct 10 09:30:40.284: INFO: Container dnsmasq ready: true, restart count 0 Oct 10 09:30:40.284: INFO: Container kubedns ready: true, restart count 0 Oct 10 09:30:40.284: INFO: Container sidecar ready: true, restart count 0 Oct 10 09:30:40.284: INFO: aws-injector started at 2019-10-10 09:20:48 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:40.284: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:30:40.284: INFO: pod-projected-configmaps-dfb382d7-a7c0-4552-9020-dca998d3f04d started at 2019-10-10 09:29:40 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:40.284: INFO: Container projected-configmap-volume-test ready: true, restart count 0 Oct 10 09:30:40.284: INFO: kube-proxy-ip-172-20-60-88.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:40.284: INFO: Container kube-proxy ready: true, restart count 1 Oct 10 09:30:40.284: INFO: kube-dns-autoscaler-66b775459-74nsm started at 2019-10-10 09:14:21 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:40.284: INFO: Container autoscaler ready: true, restart count 0 Oct 10 09:30:40.284: INFO: nodeport-update-service-vzq6h started at 2019-10-10 09:28:09 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:40.284: INFO: Container nodeport-update-service ready: true, restart count 0 Oct 10 09:30:40.284: INFO: kube-dns-bb55d6458-g4ktr started at 2019-10-10 09:14:21 +0000 UTC (0+3 container statuses recorded) Oct 10 09:30:40.284: INFO: Container dnsmasq ready: true, restart count 0 Oct 10 09:30:40.284: INFO: Container kubedns ready: true, restart count 0 Oct 10 09:30:40.284: INFO: Container sidecar ready: true, restart count 0 Oct 10 09:30:40.284: INFO: ss2-0 started at 2019-10-10 09:29:38 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:40.284: INFO: Container webserver ready: false, restart count 0 Oct 10 09:30:40.284: INFO: ss-0 started at 2019-10-10 09:29:45 +0000 UTC (0+1 container statuses recorded) Oct 10 09:30:40.284: INFO: Container webserver ready: true, restart count 0 W1010 09:30:40.427775 1021 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:30:40.752: INFO: Latency metrics for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:30:40.753: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "services-8757" for this suite. [AfterEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:95
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sServices\sshould\shave\ssession\saffinity\swork\sfor\sNodePort\sservice\s\[LinuxOnly\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1772 Oct 10 09:29:08.970: Service is not reachable within 2m0s timeout on endpoint 18.231.36.128:31640 over TCP protocol Unexpected error: <*errors.errorString | 0xc0000a10a0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/service/jig.go:795from junit_22.xml
[BeforeEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:150 �[1mSTEP�[0m: Creating a kubernetes client Oct 10 09:26:42.261: INFO: >>> kubeConfig: /tmp/kops104699295/kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename services �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:91 [It] should have session affinity work for NodePort service [LinuxOnly] /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1772 �[1mSTEP�[0m: creating service in namespace services-6399 �[1mSTEP�[0m: creating service affinity-nodeport in namespace services-6399 �[1mSTEP�[0m: creating replication controller affinity-nodeport in namespace services-6399 I1010 09:26:43.127443 891 runners.go:189] Created replication controller with name: affinity-nodeport, namespace: services-6399, replica count: 3 I1010 09:26:46.277992 891 runners.go:189] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I1010 09:26:49.278380 891 runners.go:189] affinity-nodeport Pods: 3 out of 3 created, 3 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Oct 10 09:26:49.706: INFO: Creating new exec pod Oct 10 09:26:53.279: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 affinity-nodeport 80' Oct 10 09:26:55.111: INFO: stderr: "+ nc -zv -t -w 2 affinity-nodeport 80\nConnection to affinity-nodeport 80 port [tcp/http] succeeded!\n" Oct 10 09:26:55.111: INFO: stdout: "" Oct 10 09:26:55.111: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 100.69.137.222 80' Oct 10 09:26:56.900: INFO: stderr: "+ nc -zv -t -w 2 100.69.137.222 80\nConnection to 100.69.137.222 80 port [tcp/http] succeeded!\n" Oct 10 09:26:56.900: INFO: stdout: "" Oct 10 09:26:56.900: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 172.20.60.88 31640' Oct 10 09:26:58.714: INFO: stderr: "+ nc -zv -t -w 2 172.20.60.88 31640\nConnection to 172.20.60.88 31640 port [tcp/31640] succeeded!\n" Oct 10 09:26:58.714: INFO: stdout: "" Oct 10 09:26:58.714: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 172.20.56.86 31640' Oct 10 09:27:00.510: INFO: stderr: "+ nc -zv -t -w 2 172.20.56.86 31640\nConnection to 172.20.56.86 31640 port [tcp/31640] succeeded!\n" Oct 10 09:27:00.510: INFO: stdout: "" Oct 10 09:27:00.510: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:27:04.297: INFO: rc: 1 Oct 10 09:27:04.297: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001d3b200 exit status 1 <nil> <nil> true [0xc0029f0068 0xc0029f0080 0xc0029f00b0] [0xc0029f0068 0xc0029f0080 0xc0029f00b0] [0xc0029f0078 0xc0029f00a0] [0x10f13d0 0x10f13d0] 0xc0035b5440 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:27:05.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:27:09.167: INFO: rc: 1 Oct 10 09:27:09.167: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001d3baa0 exit status 1 <nil> <nil> true [0xc0029f00c0 0xc0029f00d8 0xc0029f0128] [0xc0029f00c0 0xc0029f00d8 0xc0029f0128] [0xc0029f00d0 0xc0029f0100] [0x10f13d0 0x10f13d0] 0xc0035b5800 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:27:09.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:27:13.121: INFO: rc: 1 Oct 10 09:27:13.121: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001cfd410 exit status 1 <nil> <nil> true [0xc00295a2b0 0xc00295a2d8 0xc00295a308] [0xc00295a2b0 0xc00295a2d8 0xc00295a308] [0xc00295a2c0 0xc00295a2f8] [0x10f13d0 0x10f13d0] 0xc003359200 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:27:13.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:27:17.104: INFO: rc: 1 Oct 10 09:27:17.104: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003a48bd0 exit status 1 <nil> <nil> true [0xc002943200 0xc002943218 0xc002943230] [0xc002943200 0xc002943218 0xc002943230] [0xc002943210 0xc002943228] [0x10f13d0 0x10f13d0] 0xc002923140 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:27:17.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:27:21.081: INFO: rc: 1 Oct 10 09:27:21.081: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001cfdcb0 exit status 1 <nil> <nil> true [0xc00295a318 0xc00295a330 0xc00295a358] [0xc00295a318 0xc00295a330 0xc00295a358] [0xc00295a328 0xc00295a348] [0x10f13d0 0x10f13d0] 0xc003359620 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:27:21.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:27:25.177: INFO: rc: 1 Oct 10 09:27:25.177: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001e46540 exit status 1 <nil> <nil> true [0xc00295a370 0xc00295a388 0xc00295a3a0] [0xc00295a370 0xc00295a388 0xc00295a3a0] [0xc00295a380 0xc00295a398] [0x10f13d0 0x10f13d0] 0xc003359980 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:27:25.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:27:29.114: INFO: rc: 1 Oct 10 09:27:29.114: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001e50360 exit status 1 <nil> <nil> true [0xc0029f0138 0xc0029f0150 0xc0029f01a0] [0xc0029f0138 0xc0029f0150 0xc0029f01a0] [0xc0029f0148 0xc0029f0188] [0x10f13d0 0x10f13d0] 0xc0035b5ce0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:27:29.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:27:33.082: INFO: rc: 1 Oct 10 09:27:33.082: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001ca4a20 exit status 1 <nil> <nil> true [0xc0026563c0 0xc0026563d8 0xc0026563f0] [0xc0026563c0 0xc0026563d8 0xc0026563f0] [0xc0026563d0 0xc0026563e8] [0x10f13d0 0x10f13d0] 0xc003170c60 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:27:33.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:27:37.122: INFO: rc: 1 Oct 10 09:27:37.122: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001ca5290 exit status 1 <nil> <nil> true [0xc0026563f8 0xc002656410 0xc002656428] [0xc0026563f8 0xc002656410 0xc002656428] [0xc002656408 0xc002656420] [0x10f13d0 0x10f13d0] 0xc003170f60 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:27:37.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:27:41.098: INFO: rc: 1 Oct 10 09:27:41.098: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001e50c30 exit status 1 <nil> <nil> true [0xc0029f01a8 0xc0029f01d0 0xc0029f0210] [0xc0029f01a8 0xc0029f01d0 0xc0029f0210] [0xc0029f01c0 0xc0029f0200] [0x10f13d0 0x10f13d0] 0xc001a6a1e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:27:41.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:27:45.090: INFO: rc: 1 Oct 10 09:27:45.090: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001e514a0 exit status 1 <nil> <nil> true [0xc0029f0218 0xc0029f0248 0xc0029f0288] [0xc0029f0218 0xc0029f0248 0xc0029f0288] [0xc0029f0238 0xc0029f0278] [0x10f13d0 0x10f13d0] 0xc001d6f560 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:27:45.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:27:49.112: INFO: rc: 1 Oct 10 09:27:49.112: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001ca5b30 exit status 1 <nil> <nil> true [0xc002656430 0xc002656448 0xc002656460] [0xc002656430 0xc002656448 0xc002656460] [0xc002656440 0xc002656458] [0x10f13d0 0x10f13d0] 0xc0031712c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:27:49.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:27:53.070: INFO: rc: 1 Oct 10 09:27:53.070: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001eea3c0 exit status 1 <nil> <nil> true [0xc002656468 0xc002656480 0xc002656498] [0xc002656468 0xc002656480 0xc002656498] [0xc002656478 0xc002656490] [0x10f13d0 0x10f13d0] 0xc0031715c0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:27:53.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:27:57.115: INFO: rc: 1 Oct 10 09:27:57.115: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001eeac30 exit status 1 <nil> <nil> true [0xc0026564a0 0xc0026564b8 0xc0026564d0] [0xc0026564a0 0xc0026564b8 0xc0026564d0] [0xc0026564b0 0xc0026564c8] [0x10f13d0 0x10f13d0] 0xc003171920 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:27:57.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:28:01.082: INFO: rc: 1 Oct 10 09:28:01.083: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001eeb4d0 exit status 1 <nil> <nil> true [0xc0026564d8 0xc0026564f0 0xc002656508] [0xc0026564d8 0xc0026564f0 0xc002656508] [0xc0026564e8 0xc002656500] [0x10f13d0 0x10f13d0] 0xc003171ce0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:01.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:28:05.107: INFO: rc: 1 Oct 10 09:28:05.107: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001eebd40 exit status 1 <nil> <nil> true [0xc002656510 0xc002656528 0xc002656540] [0xc002656510 0xc002656528 0xc002656540] [0xc002656520 0xc002656538] [0x10f13d0 0x10f13d0] 0xc003280000 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:05.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:28:09.121: INFO: rc: 1 Oct 10 09:28:09.121: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001e46ea0 exit status 1 <nil> <nil> true [0xc00295a3b0 0xc00295a3d8 0xc00295a3f0] [0xc00295a3b0 0xc00295a3d8 0xc00295a3f0] [0xc00295a3c8 0xc00295a3e8] [0x10f13d0 0x10f13d0] 0xc003359c80 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:09.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:28:13.112: INFO: rc: 1 Oct 10 09:28:13.112: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001e51d10 exit status 1 <nil> <nil> true [0xc0029f0298 0xc0029f02c0 0xc0029f0300] [0xc0029f0298 0xc0029f02c0 0xc0029f0300] [0xc0029f02b8 0xc0029f02e0] [0x10f13d0 0x10f13d0] 0xc0020e2900 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:13.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:28:17.173: INFO: rc: 1 Oct 10 09:28:17.173: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001e47740 exit status 1 <nil> <nil> true [0xc00295a3f8 0xc00295a460 0xc00295a4b0] [0xc00295a3f8 0xc00295a460 0xc00295a4b0] [0xc00295a438 0xc00295a4a0] [0x10f13d0 0x10f13d0] 0xc00142d560 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:17.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:28:21.060: INFO: rc: 1 Oct 10 09:28:21.060: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001f80000 exit status 1 <nil> <nil> true [0xc00295a4c0 0xc00295a520 0xc00295a540] [0xc00295a4c0 0xc00295a520 0xc00295a540] [0xc00295a518 0xc00295a530] [0x10f13d0 0x10f13d0] 0xc000d64420 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:21.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:28:25.107: INFO: rc: 1 Oct 10 09:28:25.107: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001fa85a0 exit status 1 <nil> <nil> true [0xc0029f0310 0xc0029f0350 0xc0029f0380] [0xc0029f0310 0xc0029f0350 0xc0029f0380] [0xc0029f0340 0xc0029f0360] [0x10f13d0 0x10f13d0] 0xc0020e34a0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:25.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:28:29.082: INFO: rc: 1 Oct 10 09:28:29.082: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003a494d0 exit status 1 <nil> <nil> true [0xc002943248 0xc002943270 0xc002943288] [0xc002943248 0xc002943270 0xc002943288] [0xc002943268 0xc002943280] [0x10f13d0 0x10f13d0] 0xc001552de0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:29.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:28:33.106: INFO: rc: 1 Oct 10 09:28:33.107: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003a49d40 exit status 1 <nil> <nil> true [0xc002943290 0xc0029432c0 0xc0029432e8] [0xc002943290 0xc0029432c0 0xc0029432e8] [0xc0029432a0 0xc0029432e0] [0x10f13d0 0x10f13d0] 0xc0013151a0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:33.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:28:37.121: INFO: rc: 1 Oct 10 09:28:37.121: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001ff2870 exit status 1 <nil> <nil> true [0xc0009ec680 0xc0009ed6a0 0xc0009ed9c0] [0xc0009ec680 0xc0009ed6a0 0xc0009ed9c0] [0xc0009ed4b8 0xc0009ed9b0] [0x10f13d0 0x10f13d0] 0xc000f48840 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:37.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:28:41.085: INFO: rc: 1 Oct 10 09:28:41.085: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002062870 exit status 1 <nil> <nil> true [0xc00017c000 0xc00017c908 0xc00017d090] [0xc00017c000 0xc00017c908 0xc00017d090] [0xc00017c878 0xc00017cf68] [0x10f13d0 0x10f13d0] 0xc001e4d7a0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:41.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:28:45.087: INFO: rc: 1 Oct 10 09:28:45.087: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002063110 exit status 1 <nil> <nil> true [0xc00017d350 0xc00017d680 0xc00017df80] [0xc00017d350 0xc00017d680 0xc00017df80] [0xc00017d590 0xc00017dbc8] [0x10f13d0 0x10f13d0] 0xc001c97140 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:45.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:28:49.134: INFO: rc: 1 Oct 10 09:28:49.135: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002c24b10 exit status 1 <nil> <nil> true [0xc002656010 0xc002656040 0xc002656058] [0xc002656010 0xc002656040 0xc002656058] [0xc002656038 0xc002656050] [0x10f13d0 0x10f13d0] 0xc001a6aa20 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:49.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:28:53.098: INFO: rc: 1 Oct 10 09:28:53.098: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002c253b0 exit status 1 <nil> <nil> true [0xc002656068 0xc002656080 0xc002656098] [0xc002656068 0xc002656080 0xc002656098] [0xc002656078 0xc002656090] [0x10f13d0 0x10f13d0] 0xc0035b41e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:53.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:28:57.075: INFO: rc: 1 Oct 10 09:28:57.075: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001deca20 exit status 1 <nil> <nil> true [0xc0035b2000 0xc0035b2020 0xc0035b2060] [0xc0035b2000 0xc0035b2020 0xc0035b2060] [0xc0035b2010 0xc0035b2058] [0x10f13d0 0x10f13d0] 0xc003358d20 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:28:57.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:29:01.072: INFO: rc: 1 Oct 10 09:29:01.072: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0019228a0 exit status 1 <nil> <nil> true [0xc0029f0008 0xc0029f0030 0xc0029f0060] [0xc0029f0008 0xc0029f0030 0xc0029f0060] [0xc0029f0020 0xc0029f0050] [0x10f13d0 0x10f13d0] 0xc0031707e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:29:01.297: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:29:05.161: INFO: rc: 1 Oct 10 09:29:05.161: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001ded410 exit status 1 <nil> <nil> true [0xc0035b2078 0xc0035b20b8 0xc0035b20d0] [0xc0035b2078 0xc0035b20b8 0xc0035b20d0] [0xc0035b20a0 0xc0035b20c8] [0x10f13d0 0x10f13d0] 0xc003359080 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:29:05.162: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640' Oct 10 09:29:08.970: INFO: rc: 1 Oct 10 09:29:08.970: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-6399 execpod-affinityw6ksh -- /bin/sh -x -c nc -zv -t -w 2 18.231.36.128 31640] [] <nil> + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001923140 exit status 1 <nil> <nil> true [0xc0029f0068 0xc0029f0080 0xc0029f00b0] [0xc0029f0068 0xc0029f0080 0xc0029f00b0] [0xc0029f0078 0xc0029f00a0] [0x10f13d0 0x10f13d0] 0xc003170ae0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 18.231.36.128 31640 nc: connect to 18.231.36.128 port 31640 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:29:08.970: FAIL: Service is not reachable within 2m0s timeout on endpoint 18.231.36.128:31640 over TCP protocol Unexpected error: <*errors.errorString | 0xc0000a10a0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Oct 10 09:29:08.971: INFO: Cleaning up the exec pod �[1mSTEP�[0m: deleting ReplicationController affinity-nodeport in namespace services-6399, will wait for the garbage collector to delete the pods Oct 10 09:29:09.610: INFO: Deleting ReplicationController affinity-nodeport took: 194.590025ms Oct 10 09:29:09.710: INFO: Terminating ReplicationController affinity-nodeport pods took: 100.23351ms [AfterEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Collecting events from namespace "services-6399". �[1mSTEP�[0m: Found 23 events. Oct 10 09:29:19.244: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-786sr: {default-scheduler } Scheduled: Successfully assigned services-6399/affinity-nodeport-786sr to ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:29:19.244: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-cgsxd: {default-scheduler } Scheduled: Successfully assigned services-6399/affinity-nodeport-cgsxd to ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:29:19.244: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-hhfm5: {default-scheduler } Scheduled: Successfully assigned services-6399/affinity-nodeport-hhfm5 to ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:29:19.244: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for execpod-affinityw6ksh: {default-scheduler } Scheduled: Successfully assigned services-6399/execpod-affinityw6ksh to ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:29:19.244: INFO: At 2019-10-10 09:26:43 +0000 UTC - event for affinity-nodeport: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-786sr Oct 10 09:29:19.244: INFO: At 2019-10-10 09:26:43 +0000 UTC - event for affinity-nodeport: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-cgsxd Oct 10 09:29:19.244: INFO: At 2019-10-10 09:26:43 +0000 UTC - event for affinity-nodeport: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-hhfm5 Oct 10 09:29:19.244: INFO: At 2019-10-10 09:26:43 +0000 UTC - event for affinity-nodeport-cgsxd: {kubelet ip-172-20-56-86.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:29:19.244: INFO: At 2019-10-10 09:26:43 +0000 UTC - event for affinity-nodeport-cgsxd: {kubelet ip-172-20-56-86.sa-east-1.compute.internal} Created: Created container affinity-nodeport Oct 10 09:29:19.244: INFO: At 2019-10-10 09:26:43 +0000 UTC - event for affinity-nodeport-cgsxd: {kubelet ip-172-20-56-86.sa-east-1.compute.internal} Started: Started container affinity-nodeport Oct 10 09:29:19.244: INFO: At 2019-10-10 09:26:43 +0000 UTC - event for affinity-nodeport-hhfm5: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Created: Created container affinity-nodeport Oct 10 09:29:19.244: INFO: At 2019-10-10 09:26:43 +0000 UTC - event for affinity-nodeport-hhfm5: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Started: Started container affinity-nodeport Oct 10 09:29:19.244: INFO: At 2019-10-10 09:26:43 +0000 UTC - event for affinity-nodeport-hhfm5: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:29:19.245: INFO: At 2019-10-10 09:26:44 +0000 UTC - event for affinity-nodeport-786sr: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Started: Started container affinity-nodeport Oct 10 09:29:19.245: INFO: At 2019-10-10 09:26:44 +0000 UTC - event for affinity-nodeport-786sr: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Created: Created container affinity-nodeport Oct 10 09:29:19.245: INFO: At 2019-10-10 09:26:44 +0000 UTC - event for affinity-nodeport-786sr: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:29:19.245: INFO: At 2019-10-10 09:26:50 +0000 UTC - event for execpod-affinityw6ksh: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:29:19.245: INFO: At 2019-10-10 09:26:50 +0000 UTC - event for execpod-affinityw6ksh: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Created: Created container agnhost-pause Oct 10 09:29:19.245: INFO: At 2019-10-10 09:26:50 +0000 UTC - event for execpod-affinityw6ksh: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Started: Started container agnhost-pause Oct 10 09:29:19.245: INFO: At 2019-10-10 09:29:09 +0000 UTC - event for affinity-nodeport-786sr: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Killing: Stopping container affinity-nodeport Oct 10 09:29:19.245: INFO: At 2019-10-10 09:29:09 +0000 UTC - event for affinity-nodeport-cgsxd: {kubelet ip-172-20-56-86.sa-east-1.compute.internal} Killing: Stopping container affinity-nodeport Oct 10 09:29:19.245: INFO: At 2019-10-10 09:29:09 +0000 UTC - event for affinity-nodeport-hhfm5: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Killing: Stopping container affinity-nodeport Oct 10 09:29:19.245: INFO: At 2019-10-10 09:29:09 +0000 UTC - event for execpod-affinityw6ksh: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Killing: Stopping container agnhost-pause Oct 10 09:29:19.391: INFO: POD NODE PHASE GRACE CONDITIONS Oct 10 09:29:19.391: INFO: Oct 10 09:29:19.540: INFO: Logging node info for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:29:19.683: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-37-177.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-37-177.sa-east-1.compute.internal 8ecedabe-969e-476a-8f76-1fb03eedaa56 25648 0 2019-10-10 09:12:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c4.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:master-sa-east-1c kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-37-177.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master:] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-08fb35da4b2014f59,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3949572096 0} {<nil>} 3857004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3844714496 0} {<nil>} 3754604Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:12:53 +0000 UTC,LastTransitionTime:2019-10-10 09:12:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:29:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:29:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:29:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:29:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.177,},NodeAddress{Type:ExternalIP,Address:54.233.97.36,},NodeAddress{Type:Hostname,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-97-36.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:75a86a2fc8e747568f8cd25355ed4a43,SystemUUID:EC277240-730F-D89C-36D2-B12A43ABB39F,BootID:33b7c61a-9c83-42db-9541-8a26846b977a,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[kopeio/etcd-manager@sha256:cb0ed7c56dadbc0f4cd515906d72b30094229d6e0a9fcb7aa44e23680bf9a3a8 kopeio/etcd-manager:3.0.20190930],SizeBytes:656348817,},ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:260130533,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:205085998,},ContainerImage{Names:[kope/dns-controller@sha256:aca3878acdac85716e1317dd2fc85b235551068d667e578fceb9b0e8c3561324 kope/dns-controller:1.15.0-alpha.1],SizeBytes:120867125,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:103791294,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:29:19.684: INFO: Logging kubelet events for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:29:19.828: INFO: Logging pods the kubelet thinks is on node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:29:19.973: INFO: kube-proxy-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:19.973: INFO: Container kube-proxy ready: true, restart count 3 Oct 10 09:29:19.973: INFO: kube-scheduler-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:19.973: INFO: Container kube-scheduler ready: true, restart count 0 Oct 10 09:29:19.973: INFO: etcd-manager-events-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:19.973: INFO: Container etcd-manager ready: true, restart count 0 Oct 10 09:29:19.973: INFO: kops-controller-76f5d459f8-86j85 started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:19.973: INFO: Container kops-controller ready: true, restart count 0 Oct 10 09:29:19.973: INFO: dns-controller-78ccbffc6d-5pnmw started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:19.973: INFO: Container dns-controller ready: true, restart count 0 Oct 10 09:29:19.973: INFO: etcd-manager-main-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:19.973: INFO: Container etcd-manager ready: true, restart count 0 Oct 10 09:29:19.973: INFO: kube-apiserver-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:19.973: INFO: Container kube-apiserver ready: true, restart count 3 Oct 10 09:29:19.973: INFO: kube-controller-manager-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:19.973: INFO: Container kube-controller-manager ready: true, restart count 0 W1010 09:29:20.120292 891 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:29:20.423: INFO: Latency metrics for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:29:20.423: INFO: Logging node info for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:29:20.566: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-42-37.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-42-37.sa-east-1.compute.internal 8fb9f863-77f2-4451-ba99-614781c1c8bc 25218 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-42-37.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node mounted_volume_expand:mounted-volume-expand-8034 node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-1205":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-4356":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-volume-expand-3381":"ip-172-20-42-37.sa-east-1.compute.internal"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-020fda63f6b69c0ea,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:28:51 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:28:51 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:28:51 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:28:51 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.37,},NodeAddress{Type:ExternalIP,Address:54.233.88.138,},NodeAddress{Type:Hostname,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-88-138.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dbea17b1df4f4682b3aea8f7967a81f7,SystemUUID:EC276068-34A4-965C-3CB7-CA4BD3478D25,BootID:883b28de-249e-43a6-8e1c-705f97846842,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa k8s.gcr.io/etcd:3.3.15],SizeBytes:246640776,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:1bafcc6fb1aa990b487850adba9cadc020e42d7905aa8a30481182a477ba24b0 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.10],SizeBytes:61365829,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0194c1f06c834833d kubernetes.io/aws-ebs/aws://sa-east-1c/vol-01bd3e8125169a372 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0269672c060d2e367 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0fdd29053b527a7bf],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0269672c060d2e367,DevicePath:/dev/xvdcw,},},Config:nil,},} Oct 10 09:29:20.567: INFO: Logging kubelet events for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:29:20.711: INFO: Logging pods the kubelet thinks is on node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:29:20.856: INFO: dns-test-91d50278-569f-4ce0-9e67-3a9e91067f5b started at 2019-10-10 09:29:19 +0000 UTC (0+3 container statuses recorded) Oct 10 09:29:20.856: INFO: Container jessie-querier ready: false, restart count 0 Oct 10 09:29:20.856: INFO: Container querier ready: false, restart count 0 Oct 10 09:29:20.856: INFO: Container webserver ready: false, restart count 0 Oct 10 09:29:20.856: INFO: exec-volume-test-aws-qfkw started at 2019-10-10 09:26:02 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:20.856: INFO: Container exec-container-aws-qfkw ready: false, restart count 0 Oct 10 09:29:20.856: INFO: annotationupdate4ebd7d7c-6149-4dcd-9bcc-1d2b8c154510 started at 2019-10-10 09:29:16 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:20.856: INFO: Container client-container ready: true, restart count 0 Oct 10 09:29:20.856: INFO: pod-configmaps-93d4f6b7-8f2d-4bcb-94da-6c3604b22df7 started at 2019-10-10 09:28:43 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:20.856: INFO: Container configmap-volume-test ready: true, restart count 0 Oct 10 09:29:20.856: INFO: liveness-fc1ba5f3-3014-4f03-8828-a28e3a11bf07 started at 2019-10-10 09:27:19 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:20.856: INFO: Container liveness ready: true, restart count 0 Oct 10 09:29:20.856: INFO: test-pod started at 2019-10-10 09:28:52 +0000 UTC (0+3 container statuses recorded) Oct 10 09:29:20.856: INFO: Container busybox-1 ready: true, restart count 0 Oct 10 09:29:20.856: INFO: Container busybox-2 ready: true, restart count 0 Oct 10 09:29:20.856: INFO: Container busybox-3 ready: true, restart count 0 Oct 10 09:29:20.856: INFO: aws-injector started at 2019-10-10 09:22:26 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:20.856: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:29:20.856: INFO: exec-volume-test-aws-preprovisionedpv-v2hv started at 2019-10-10 09:28:47 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:20.856: INFO: Container exec-container-aws-preprovisionedpv-v2hv ready: false, restart count 0 Oct 10 09:29:20.856: INFO: kube-proxy-ip-172-20-42-37.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:20.856: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:29:20.856: INFO: ss-0 started at 2019-10-10 09:28:26 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:20.856: INFO: Container webserver ready: true, restart count 0 W1010 09:29:20.999828 891 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:29:21.311: INFO: Latency metrics for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:29:21.311: INFO: Logging node info for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:29:21.454: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-49-15.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-49-15.sa-east-1.compute.internal 105a0721-5b17-40b8-b686-ccf439f1ca2a 26085 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-49-15.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6677":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-1913":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-6893":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-8860":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-9656":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-5356":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-5574":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-6407":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-volume-expand-3873":"ip-172-20-49-15.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-3724":"csi-mock-csi-mock-volumes-3724","csi-mock-csi-mock-volumes-4205":"csi-mock-csi-mock-volumes-4205","csi-mock-csi-mock-volumes-7612":"csi-mock-csi-mock-volumes-7612","csi-mock-csi-mock-volumes-8888":"csi-mock-csi-mock-volumes-8888"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-056d95303ed61d881,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:29:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:29:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:29:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:29:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.49.15,},NodeAddress{Type:ExternalIP,Address:18.228.205.178,},NodeAddress{Type:Hostname,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-228-205-178.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f468c62663d2465ca17ba5284774252e,SystemUUID:EC23BE58-6EBA-E800-9C73-DEB3BAA2D1B9,BootID:6eb82ab7-2bd7-418a-ba22-36d3a808a22b,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[gcr.io/google-containers/debian-base@sha256:6966a0aedd7592c18ff2dd803c08bd85780ee19f5e3a2e7cf908a4cd837afcde gcr.io/google-containers/debian-base:0.4.1],SizeBytes:42323657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-04d62f6373ff4cab2 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-051bb41c62b923490 kubernetes.io/csi/csi-hostpath-v0-provisioning-5574^6b5e9331-eb40-11e9-83ad-0a8a6f62bd00],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/aws-ebs/aws://sa-east-1c/vol-04d62f6373ff4cab2,DevicePath:/dev/xvdbu,},AttachedVolume{Name:kubernetes.io/aws-ebs/aws://sa-east-1c/vol-051bb41c62b923490,DevicePath:/dev/xvdch,},},Config:nil,},} Oct 10 09:29:21.455: INFO: Logging kubelet events for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:29:21.598: INFO: Logging pods the kubelet thinks is on node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:29:21.751: INFO: test-host-network-pod started at 2019-10-10 09:28:55 +0000 UTC (0+2 container statuses recorded) Oct 10 09:29:21.751: INFO: Container busybox-1 ready: true, restart count 0 Oct 10 09:29:21.751: INFO: Container busybox-2 ready: true, restart count 0 Oct 10 09:29:21.752: INFO: pod-subpath-test-csi-hostpath-v0-dynamicpv-664s started at 2019-10-10 09:29:14 +0000 UTC (1+2 container statuses recorded) Oct 10 09:29:21.752: INFO: Init container test-init-subpath-csi-hostpath-v0-dynamicpv-664s ready: false, restart count 0 Oct 10 09:29:21.752: INFO: Container test-container-subpath-csi-hostpath-v0-dynamicpv-664s ready: false, restart count 0 Oct 10 09:29:21.752: INFO: Container test-container-volume-csi-hostpath-v0-dynamicpv-664s ready: false, restart count 0 Oct 10 09:29:21.752: INFO: csi-hostpath-attacher-0 started at 2019-10-10 09:29:04 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:21.752: INFO: Container csi-attacher ready: true, restart count 0 Oct 10 09:29:21.752: INFO: csi-hostpathplugin-xbc4h started at 2019-10-10 09:29:04 +0000 UTC (0+2 container statuses recorded) Oct 10 09:29:21.752: INFO: Container driver-registrar ready: true, restart count 0 Oct 10 09:29:21.752: INFO: Container hostpath ready: true, restart count 0 Oct 10 09:29:21.752: INFO: kube-proxy-ip-172-20-49-15.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:21.752: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:29:21.752: INFO: csi-hostpath-provisioner-0 started at 2019-10-10 09:29:04 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:21.752: INFO: Container csi-provisioner ready: true, restart count 0 Oct 10 09:29:21.752: INFO: hostexec-ip-172-20-49-15.sa-east-1.compute.internal-8gqth started at 2019-10-10 09:29:12 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:21.752: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:29:21.752: INFO: aws-injector started at 2019-10-10 09:29:05 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:21.752: INFO: Container aws-injector ready: true, restart count 0 Oct 10 09:29:21.752: INFO: execpodk5xvl started at 2019-10-10 09:28:15 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:21.752: INFO: Container agnhost-pause ready: true, restart count 0 Oct 10 09:29:21.752: INFO: ss-2 started at 2019-10-10 09:28:59 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:21.752: INFO: Container webserver ready: true, restart count 0 W1010 09:29:21.895339 891 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:29:22.204: INFO: Latency metrics for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:29:22.204: INFO: Logging node info for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:29:22.347: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-56-86.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-56-86.sa-east-1.compute.internal cccbef08-fa00-42b5-ae85-da8efe4ee848 26094 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-56-86.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9823":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volume-6196":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volumemode-1556":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-1749":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-expand-9939":"ip-172-20-56-86.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-5777":"csi-mock-csi-mock-volumes-5777","csi-mock-csi-mock-volumes-6825":"csi-mock-csi-mock-volumes-6825"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-0b5800b629bcb7519,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:29:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:29:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:29:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:29:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.86,},NodeAddress{Type:ExternalIP,Address:54.207.48.88,},NodeAddress{Type:Hostname,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-207-48-88.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:99be0b3f4ec34abb8f4f249d272797b5,SystemUUID:EC2EB353-C506-B251-A10A-9B28B752A967,BootID:e098fcb6-fca7-433b-9b9f-7e47386c5ca0,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6],SizeBytes:373099368,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:6757579,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0],SizeBytes:4747037,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[busybox@sha256:bbc3a03235220b170ba48a157dd097dd1379299370e1ed99ce976df0355d24f0 busybox:1.27],SizeBytes:1129289,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-023ab0ee87ab378fe kubernetes.io/aws-ebs/aws://sa-east-1c/vol-028b66335e31eaf4f kubernetes.io/aws-ebs/aws://sa-east-1c/vol-04fa7884970040b89 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0bb9f5b60081bc7bc],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/aws-ebs/aws://sa-east-1c/vol-04fa7884970040b89,DevicePath:/dev/xvdbh,},},Config:nil,},} Oct 10 09:29:22.347: INFO: Logging kubelet events for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:29:22.491: INFO: Logging pods the kubelet thinks is on node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:29:22.636: INFO: pvc-volume-tester-7mrkc started at 2019-10-10 09:29:21 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:22.636: INFO: Container volume-tester ready: false, restart count 0 Oct 10 09:29:22.636: INFO: kube-proxy-ip-172-20-56-86.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:22.636: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:29:22.636: INFO: csi-hostpathplugin-29bbl started at 2019-10-10 09:29:17 +0000 UTC (0+2 container statuses recorded) Oct 10 09:29:22.636: INFO: Container driver-registrar ready: false, restart count 0 Oct 10 09:29:22.636: INFO: Container hostpath ready: false, restart count 0 Oct 10 09:29:22.636: INFO: csi-hostpath-attacher-0 started at 2019-10-10 09:29:16 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:22.636: INFO: Container csi-attacher ready: true, restart count 0 Oct 10 09:29:22.636: INFO: aws-injector started at 2019-10-10 09:28:53 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:22.636: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:29:22.636: INFO: aws-injector started at 2019-10-10 09:28:01 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:22.636: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:29:22.636: INFO: csi-mockplugin-0 started at 2019-10-10 09:29:13 +0000 UTC (0+3 container statuses recorded) Oct 10 09:29:22.636: INFO: Container csi-provisioner ready: true, restart count 0 Oct 10 09:29:22.636: INFO: Container driver-registrar ready: true, restart count 0 Oct 10 09:29:22.636: INFO: Container mock ready: true, restart count 0 Oct 10 09:29:22.636: INFO: ss-1 started at 2019-10-10 09:29:20 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:22.636: INFO: Container webserver ready: false, restart count 0 Oct 10 09:29:22.636: INFO: aws-injector started at 2019-10-10 09:21:46 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:22.636: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:29:22.636: INFO: csi-mockplugin-attacher-0 started at 2019-10-10 09:29:13 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:22.636: INFO: Container csi-attacher ready: true, restart count 0 Oct 10 09:29:22.636: INFO: pfpod started at 2019-10-10 09:29:03 +0000 UTC (0+2 container statuses recorded) Oct 10 09:29:22.636: INFO: Container portforwardtester ready: false, restart count 0 Oct 10 09:29:22.636: INFO: Container readiness ready: false, restart count 0 Oct 10 09:29:22.636: INFO: nodeport-update-service-frhgm started at 2019-10-10 09:28:09 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:22.636: INFO: Container nodeport-update-service ready: true, restart count 0 Oct 10 09:29:22.636: INFO: csi-hostpath-provisioner-0 started at 2019-10-10 09:29:17 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:22.636: INFO: Container csi-provisioner ready: false, restart count 0 W1010 09:29:22.780859 891 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:29:23.093: INFO: Latency metrics for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:29:23.093: INFO: Logging node info for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:29:23.235: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-60-88.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-60-88.sa-east-1.compute.internal f5a2e6d3-a123-4acc-a9b2-8fa0a5c1c28f 24964 0 2019-10-10 09:14:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-60-88.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4801":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-provisioning-2176":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-provisioning-8958":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-9423":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volume-expand-4947":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volume-expand-6712":"ip-172-20-60-88.sa-east-1.compute.internal","csi-hostpath-volumemode-4728":"ip-172-20-60-88.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-3023":"csi-mock-csi-mock-volumes-3023","csi-mock-csi-mock-volumes-3882":"csi-mock-csi-mock-volumes-3882","csi-mock-csi-mock-volumes-5042":"csi-mock-csi-mock-volumes-5042","csi-mock-csi-mock-volumes-6797":"csi-mock-csi-mock-volumes-6797"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-087c9d5356d3aafe3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146278400 0} {<nil>} 4049100Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041420800 0} {<nil>} 3946700Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:13 +0000 UTC,LastTransitionTime:2019-10-10 09:14:13 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:28:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:28:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:28:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:28:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.88,},NodeAddress{Type:ExternalIP,Address:18.231.36.128,},NodeAddress{Type:Hostname,Address:ip-172-20-60-88.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-60-88.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-231-36-128.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4f6cfed0b3cc440c814a893a63590a26,SystemUUID:EC2CF3F1-2D60-B6EE-FE1D-D82FEFE80523,BootID:fcb35a82-1eda-4e12-88ea-2fc1cfa0c447,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6],SizeBytes:373099368,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-kube-dns-amd64@sha256:618a82fa66cf0c75e4753369a6999032372be7308866fc9afb381789b1e5ad52 k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13],SizeBytes:51157394,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:12370202895b621a2ac28226292e4578598f13c1502aa4d3ee90fff4325d9275 k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.4.0],SizeBytes:45853555,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-sidecar-amd64@sha256:cedc8fe2098dffc26d17f64061296b7aa54258a31513b6c52df271a98bb522b3 k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.13],SizeBytes:42852039,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:f315c9042e56def3c05c6b04fe79ec9da6d39ddc557ca365a76cf35964ea08b6 quay.io/k8scsi/csi-resizer:v0.1.0],SizeBytes:42623056,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:d4ede5c74517090b6686219059118ed178cf4620f5db8781b32f806bb1e7395b gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:42321438,},ContainerImage{Names:[k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64@sha256:45df3e8e0c551bd0c79cdba48ae6677f817971dcbd1eeed7fd1f9a35118410e4 k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13],SizeBytes:41372492,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:0aa496f3e7ff7240abbf306e4244a75c5e59cbf2e4dbc246a6db2ca1bc67c6b1 quay.io/k8scsi/hostpathplugin:v0.4.1],SizeBytes:18583451,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-004155116e0252475 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0bd7bdab1ba865787 kubernetes.io/csi/csi-mock-csi-mock-volumes-6797^4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-6797^4,DevicePath:,},},Config:nil,},} Oct 10 09:29:23.236: INFO: Logging kubelet events for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:29:23.380: INFO: Logging pods the kubelet thinks is on node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:29:23.526: INFO: aws-injector started at 2019-10-10 09:20:48 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:23.526: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:29:23.526: INFO: csi-mockplugin-attacher-0 started at 2019-10-10 09:27:01 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:23.526: INFO: Container csi-attacher ready: true, restart count 0 Oct 10 09:29:23.526: INFO: pod-subpath-test-local-preprovisionedpv-m85v started at 2019-10-10 09:29:16 +0000 UTC (0+2 container statuses recorded) Oct 10 09:29:23.526: INFO: Container test-container-subpath-local-preprovisionedpv-m85v ready: false, restart count 0 Oct 10 09:29:23.526: INFO: Container test-container-volume-local-preprovisionedpv-m85v ready: true, restart count 0 Oct 10 09:29:23.526: INFO: kube-dns-autoscaler-66b775459-74nsm started at 2019-10-10 09:14:21 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:23.526: INFO: Container autoscaler ready: true, restart count 0 Oct 10 09:29:23.526: INFO: csi-mockplugin-0 started at 2019-10-10 09:27:01 +0000 UTC (0+3 container statuses recorded) Oct 10 09:29:23.526: INFO: Container csi-provisioner ready: true, restart count 0 Oct 10 09:29:23.526: INFO: Container driver-registrar ready: true, restart count 0 Oct 10 09:29:23.526: INFO: Container mock ready: true, restart count 0 Oct 10 09:29:23.526: INFO: nodeport-update-service-vzq6h started at 2019-10-10 09:28:09 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:23.526: INFO: Container nodeport-update-service ready: true, restart count 0 Oct 10 09:29:23.526: INFO: kube-proxy-ip-172-20-60-88.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:23.526: INFO: Container kube-proxy ready: true, restart count 1 Oct 10 09:29:23.526: INFO: exec-volume-test-aws-b7pn started at 2019-10-10 09:24:20 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:23.526: INFO: Container exec-container-aws-b7pn ready: false, restart count 0 Oct 10 09:29:23.526: INFO: hostexec-ip-172-20-60-88.sa-east-1.compute.internal-vw5ks started at 2019-10-10 09:29:11 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:23.526: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:29:23.526: INFO: kube-dns-bb55d6458-g4ktr started at 2019-10-10 09:14:21 +0000 UTC (0+3 container statuses recorded) Oct 10 09:29:23.526: INFO: Container dnsmasq ready: true, restart count 0 Oct 10 09:29:23.526: INFO: Container kubedns ready: true, restart count 0 Oct 10 09:29:23.526: INFO: Container sidecar ready: true, restart count 0 Oct 10 09:29:23.526: INFO: pvc-volume-tester-q6l5f started at 2019-10-10 09:27:09 +0000 UTC (0+1 container statuses recorded) Oct 10 09:29:23.526: INFO: Container volume-tester ready: false, restart count 0 Oct 10 09:29:23.526: INFO: kube-dns-bb55d6458-cx9kh started at 2019-10-10 09:14:29 +0000 UTC (0+3 container statuses recorded) Oct 10 09:29:23.526: INFO: Container dnsmasq ready: true, restart count 0 Oct 10 09:29:23.526: INFO: Container kubedns ready: true, restart count 0 Oct 10 09:29:23.526: INFO: Container sidecar ready: true, restart count 0 W1010 09:29:23.670350 891 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:29:24.003: INFO: Latency metrics for node ip-172-20-60-88.sa-east-1.compute.internal Oct 10 09:29:24.003: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "services-6399" for this suite. [AfterEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:95
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sServices\sshould\shave\ssession\saffinity\swork\sfor\sNodePort\sservice\s\[LinuxOnly\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1772 Oct 10 09:26:19.885: Service is not reachable within 2m0s timeout on endpoint 54.207.48.88:32353 over TCP protocol Unexpected error: <*errors.errorString | 0xc0000a10a0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/service/jig.go:795
[BeforeEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:150 �[1mSTEP�[0m: Creating a kubernetes client Oct 10 09:23:46.569: INFO: >>> kubeConfig: /tmp/kops104699295/kubeconfig �[1mSTEP�[0m: Building a namespace api object, basename services �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:91 [It] should have session affinity work for NodePort service [LinuxOnly] /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1772 �[1mSTEP�[0m: creating service in namespace services-2853 �[1mSTEP�[0m: creating service affinity-nodeport in namespace services-2853 �[1mSTEP�[0m: creating replication controller affinity-nodeport in namespace services-2853 I1010 09:23:47.435432 891 runners.go:189] Created replication controller with name: affinity-nodeport, namespace: services-2853, replica count: 3 I1010 09:23:50.585994 891 runners.go:189] affinity-nodeport Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I1010 09:23:53.586262 891 runners.go:189] affinity-nodeport Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I1010 09:23:56.586515 891 runners.go:189] affinity-nodeport Pods: 3 out of 3 created, 3 running, 0 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady Oct 10 09:23:57.015: INFO: Creating new exec pod Oct 10 09:24:04.588: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 affinity-nodeport 80' Oct 10 09:24:06.432: INFO: stderr: "+ nc -zv -t -w 2 affinity-nodeport 80\nConnection to affinity-nodeport 80 port [tcp/http] succeeded!\n" Oct 10 09:24:06.432: INFO: stdout: "" Oct 10 09:24:06.433: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 100.69.184.248 80' Oct 10 09:24:08.259: INFO: stderr: "+ nc -zv -t -w 2 100.69.184.248 80\nConnection to 100.69.184.248 80 port [tcp/http] succeeded!\n" Oct 10 09:24:08.259: INFO: stdout: "" Oct 10 09:24:08.259: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 172.20.56.86 32353' Oct 10 09:24:10.108: INFO: stderr: "+ nc -zv -t -w 2 172.20.56.86 32353\nConnection to 172.20.56.86 32353 port [tcp/32353] succeeded!\n" Oct 10 09:24:10.108: INFO: stdout: "" Oct 10 09:24:10.109: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 172.20.60.88 32353' Oct 10 09:24:11.970: INFO: stderr: "+ nc -zv -t -w 2 172.20.60.88 32353\nConnection to 172.20.60.88 32353 port [tcp/32353] succeeded!\n" Oct 10 09:24:11.970: INFO: stdout: "" Oct 10 09:24:11.970: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:24:15.802: INFO: rc: 1 Oct 10 09:24:15.803: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002206fc0 exit status 1 <nil> <nil> true [0xc00295a568 0xc00295a5b0 0xc00295a5c8] [0xc00295a568 0xc00295a5b0 0xc00295a5c8] [0xc00295a590 0xc00295a5c0] [0x10f13d0 0x10f13d0] 0xc003171aa0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:16.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:24:20.843: INFO: rc: 1 Oct 10 09:24:20.843: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001e7bb00 exit status 1 <nil> <nil> true [0xc0026569e8 0xc002656a00 0xc002656a18] [0xc0026569e8 0xc002656a00 0xc002656a18] [0xc0026569f8 0xc002656a10] [0x10f13d0 0x10f13d0] 0xc0033d10e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:21.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:24:25.614: INFO: rc: 1 Oct 10 09:24:25.614: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc002207860 exit status 1 <nil> <nil> true [0xc00295a5d0 0xc00295a5e8 0xc00295a600] [0xc00295a5d0 0xc00295a5e8 0xc00295a600] [0xc00295a5e0 0xc00295a5f8] [0x10f13d0 0x10f13d0] 0xc003171e60 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:25.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:24:29.630: INFO: rc: 1 Oct 10 09:24:29.631: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00271a0f0 exit status 1 <nil> <nil> true [0xc00295a608 0xc00295a620 0xc00295a638] [0xc00295a608 0xc00295a620 0xc00295a638] [0xc00295a618 0xc00295a630] [0x10f13d0 0x10f13d0] 0xc003514180 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:29.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:24:33.609: INFO: rc: 1 Oct 10 09:24:33.609: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00271a960 exit status 1 <nil> <nil> true [0xc00295a640 0xc00295a658 0xc00295a670] [0xc00295a640 0xc00295a658 0xc00295a670] [0xc00295a650 0xc00295a668] [0x10f13d0 0x10f13d0] 0xc003514480 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:33.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:24:37.619: INFO: rc: 1 Oct 10 09:24:37.619: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0033a9bc0 exit status 1 <nil> <nil> true [0xc0035b2be8 0xc0035b2c00 0xc0035b2c18] [0xc0035b2be8 0xc0035b2c00 0xc0035b2c18] [0xc0035b2bf8 0xc0035b2c10] [0x10f13d0 0x10f13d0] 0xc00331ad20 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:37.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:24:41.707: INFO: rc: 1 Oct 10 09:24:41.707: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0027b0480 exit status 1 <nil> <nil> true [0xc0035b2c20 0xc0035b2c38 0xc0035b2c50] [0xc0035b2c20 0xc0035b2c38 0xc0035b2c50] [0xc0035b2c30 0xc0035b2c48] [0x10f13d0 0x10f13d0] 0xc00331b020 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:41.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:24:45.651: INFO: rc: 1 Oct 10 09:24:45.651: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0027b0cf0 exit status 1 <nil> <nil> true [0xc0035b2c58 0xc0035b2c70 0xc0035b2c88] [0xc0035b2c58 0xc0035b2c70 0xc0035b2c88] [0xc0035b2c68 0xc0035b2c80] [0x10f13d0 0x10f13d0] 0xc00331b320 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:45.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:24:49.638: INFO: rc: 1 Oct 10 09:24:49.638: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0027b1560 exit status 1 <nil> <nil> true [0xc0035b2c90 0xc0035b2ca8 0xc0035b2cc0] [0xc0035b2c90 0xc0035b2ca8 0xc0035b2cc0] [0xc0035b2ca0 0xc0035b2cb8] [0x10f13d0 0x10f13d0] 0xc00331b620 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:49.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:24:53.631: INFO: rc: 1 Oct 10 09:24:53.631: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00271b230 exit status 1 <nil> <nil> true [0xc00295a678 0xc00295a690 0xc00295a6a8] [0xc00295a678 0xc00295a690 0xc00295a6a8] [0xc00295a688 0xc00295a6a0] [0x10f13d0 0x10f13d0] 0xc003514780 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:53.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:24:57.586: INFO: rc: 1 Oct 10 09:24:57.586: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0027b1dd0 exit status 1 <nil> <nil> true [0xc0035b2cc8 0xc0035b2ce0 0xc0035b2cf8] [0xc0035b2cc8 0xc0035b2ce0 0xc0035b2cf8] [0xc0035b2cd8 0xc0035b2cf0] [0x10f13d0 0x10f13d0] 0xc00331b920 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:24:57.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:25:01.643: INFO: rc: 1 Oct 10 09:25:01.643: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00271bad0 exit status 1 <nil> <nil> true [0xc00295a6b0 0xc00295a6c8 0xc00295a6e0] [0xc00295a6b0 0xc00295a6c8 0xc00295a6e0] [0xc00295a6c0 0xc00295a6d8] [0x10f13d0 0x10f13d0] 0xc003514a80 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:01.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:25:05.610: INFO: rc: 1 Oct 10 09:25:05.610: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00293e2d0 exit status 1 <nil> <nil> true [0xc002943288 0xc0029432a0 0xc0029432e0] [0xc002943288 0xc0029432a0 0xc0029432e0] [0xc002943298 0xc0029432d8] [0x10f13d0 0x10f13d0] 0xc003572960 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:05.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:25:09.616: INFO: rc: 1 Oct 10 09:25:09.616: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc00288dfb0 exit status 1 <nil> <nil> true [0xc001494028 0xc0014940f0 0xc0014942f8] [0xc001494028 0xc0014940f0 0xc0014942f8] [0xc001494060 0xc001494250] [0x10f13d0 0x10f13d0] 0xc0035b4fc0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:09.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:25:13.673: INFO: rc: 1 Oct 10 09:25:13.673: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001ce09f0 exit status 1 <nil> <nil> true [0xc001494408 0xc001494650 0xc0014946f0] [0xc001494408 0xc001494650 0xc0014946f0] [0xc0014945f0 0xc0014946b0] [0x10f13d0 0x10f13d0] 0xc0035b5440 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:13.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:25:17.612: INFO: rc: 1 Oct 10 09:25:17.612: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001deca80 exit status 1 <nil> <nil> true [0xc002362068 0xc0023620d8 0xc0023621d8] [0xc002362068 0xc0023620d8 0xc0023621d8] [0xc0023620a8 0xc002362160] [0x10f13d0 0x10f13d0] 0xc003358d20 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:17.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:25:21.575: INFO: rc: 1 Oct 10 09:25:21.575: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001f86870 exit status 1 <nil> <nil> true [0xc00184a150 0xc00184a318 0xc00184a5f0] [0xc00184a150 0xc00184a318 0xc00184a5f0] [0xc00184a2d8 0xc00184a440] [0x10f13d0 0x10f13d0] 0xc003280240 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:21.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:25:25.650: INFO: rc: 1 Oct 10 09:25:25.650: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001f87290 exit status 1 <nil> <nil> true [0xc00184a728 0xc00184a998 0xc00184ad38] [0xc00184a728 0xc00184a998 0xc00184ad38] [0xc00184a7d0 0xc00184ab90] [0x10f13d0 0x10f13d0] 0xc003280540 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:25.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:25:29.749: INFO: rc: 1 Oct 10 09:25:29.749: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001f87e30 exit status 1 <nil> <nil> true [0xc00184adb8 0xc00184b070 0xc00184b390] [0xc00184adb8 0xc00184b070 0xc00184b390] [0xc00184aee0 0xc00184b1e8] [0x10f13d0 0x10f13d0] 0xc003280960 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:29.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:25:33.710: INFO: rc: 1 Oct 10 09:25:33.710: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001ded470 exit status 1 <nil> <nil> true [0xc002362228 0xc002362288 0xc0023622c0] [0xc002362228 0xc002362288 0xc0023622c0] [0xc002362280 0xc0023622a8] [0x10f13d0 0x10f13d0] 0xc003359080 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:33.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:25:37.647: INFO: rc: 1 Oct 10 09:25:37.647: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001dede00 exit status 1 <nil> <nil> true [0xc002362320 0xc0023623a8 0xc002362458] [0xc002362320 0xc0023623a8 0xc002362458] [0xc002362378 0xc002362448] [0x10f13d0 0x10f13d0] 0xc003359440 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:37.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:25:41.597: INFO: rc: 1 Oct 10 09:25:41.597: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001a92690 exit status 1 <nil> <nil> true [0xc002362468 0xc0023624c8 0xc0023624f8] [0xc002362468 0xc0023624c8 0xc0023624f8] [0xc0023624b0 0xc0023624f0] [0x10f13d0 0x10f13d0] 0xc003359800 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:41.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:25:45.617: INFO: rc: 1 Oct 10 09:25:45.617: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001ce1290 exit status 1 <nil> <nil> true [0xc001494720 0xc0014947c8 0xc001494858] [0xc001494720 0xc0014947c8 0xc001494858] [0xc001494760 0xc001494830] [0x10f13d0 0x10f13d0] 0xc0035b5740 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:45.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:25:49.596: INFO: rc: 1 Oct 10 09:25:49.596: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001ce1b30 exit status 1 <nil> <nil> true [0xc001494890 0xc001494948 0xc001494978] [0xc001494890 0xc001494948 0xc001494978] [0xc001494910 0xc001494968] [0x10f13d0 0x10f13d0] 0xc0035b5c20 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:49.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:25:53.805: INFO: rc: 1 Oct 10 09:25:53.805: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001a93020 exit status 1 <nil> <nil> true [0xc002362500 0xc002362528 0xc002362588] [0xc002362500 0xc002362528 0xc002362588] [0xc002362518 0xc002362548] [0x10f13d0 0x10f13d0] 0xc003359b00 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:54.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:25:58.677: INFO: rc: 1 Oct 10 09:25:58.677: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003570510 exit status 1 <nil> <nil> true [0xc0014949a8 0xc001494a58 0xc001494aa0] [0xc0014949a8 0xc001494a58 0xc001494aa0] [0xc001494a38 0xc001494a90] [0x10f13d0 0x10f13d0] 0xc0035b5f20 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:25:58.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:26:02.711: INFO: rc: 1 Oct 10 09:26:02.711: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0034bc990 exit status 1 <nil> <nil> true [0xc000010bb0 0xc000011e68 0xc00017c000] [0xc000010bb0 0xc000011e68 0xc00017c000] [0xc000011c90 0xc000011f50] [0x10f13d0 0x10f13d0] 0xc0031707e0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:26:02.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:26:06.740: INFO: rc: 1 Oct 10 09:26:06.740: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc003570ea0 exit status 1 <nil> <nil> true [0xc001494aa8 0xc001494b18 0xc001494ba8] [0xc001494aa8 0xc001494b18 0xc001494ba8] [0xc001494af8 0xc001494b80] [0x10f13d0 0x10f13d0] 0xc002922780 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:26:06.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:26:10.836: INFO: rc: 1 Oct 10 09:26:10.836: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0034bd230 exit status 1 <nil> <nil> true [0xc00017c7e0 0xc00017cba0 0xc00017d350] [0xc00017c7e0 0xc00017cba0 0xc00017d350] [0xc00017c908 0xc00017d090] [0x10f13d0 0x10f13d0] 0xc003170ae0 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:26:11.803: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:26:15.890: INFO: rc: 1 Oct 10 09:26:15.890: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc0035717a0 exit status 1 <nil> <nil> true [0xc001494bd8 0xc001494c80 0xc001494cb8] [0xc001494bd8 0xc001494c80 0xc001494cb8] [0xc001494c20 0xc001494ca0] [0x10f13d0 0x10f13d0] 0xc002923140 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:26:15.890: INFO: Running '/workspace/kubernetes/platforms/linux/amd64/kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353' Oct 10 09:26:19.885: INFO: rc: 1 Oct 10 09:26:19.885: INFO: Service reachability failing with error: error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://api.e2e-kops-aws.test-cncf-aws.k8s.io --kubeconfig=/tmp/kops104699295/kubeconfig exec --namespace=services-2853 execpod-affinitywxt4q -- /bin/sh -x -c nc -zv -t -w 2 54.207.48.88 32353] [] <nil> + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 [] <nil> 0xc001a93950 exit status 1 <nil> <nil> true [0xc0023625c8 0xc002362638 0xc002362658] [0xc0023625c8 0xc002362638 0xc002362658] [0xc002362628 0xc002362650] [0x10f13d0 0x10f13d0] 0xc0029e8060 <nil>}: Command stdout: stderr: + nc -zv -t -w 2 54.207.48.88 32353 nc: connect to 54.207.48.88 port 32353 (tcp) timed out: Operation in progress command terminated with exit code 1 error: exit status 1 Retrying... Oct 10 09:26:19.885: FAIL: Service is not reachable within 2m0s timeout on endpoint 54.207.48.88:32353 over TCP protocol Unexpected error: <*errors.errorString | 0xc0000a10a0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Oct 10 09:26:19.886: INFO: Cleaning up the exec pod �[1mSTEP�[0m: deleting ReplicationController affinity-nodeport in namespace services-2853, will wait for the garbage collector to delete the pods Oct 10 09:26:20.471: INFO: Deleting ReplicationController affinity-nodeport took: 144.573523ms Oct 10 09:26:20.572: INFO: Terminating ReplicationController affinity-nodeport pods took: 100.299505ms [AfterEach] [sig-network] Services /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151 �[1mSTEP�[0m: Collecting events from namespace "services-2853". �[1mSTEP�[0m: Found 24 events. Oct 10 09:26:37.176: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-cscrr: {default-scheduler } Scheduled: Successfully assigned services-2853/affinity-nodeport-cscrr to ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:26:37.176: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-wx7m8: {default-scheduler } Scheduled: Successfully assigned services-2853/affinity-nodeport-wx7m8 to ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:26:37.176: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for affinity-nodeport-zpdnf: {default-scheduler } Scheduled: Successfully assigned services-2853/affinity-nodeport-zpdnf to ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:26:37.176: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for execpod-affinitywxt4q: {default-scheduler } Scheduled: Successfully assigned services-2853/execpod-affinitywxt4q to ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:26:37.176: INFO: At 2019-10-10 09:23:47 +0000 UTC - event for affinity-nodeport: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-zpdnf Oct 10 09:26:37.176: INFO: At 2019-10-10 09:23:47 +0000 UTC - event for affinity-nodeport: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-cscrr Oct 10 09:26:37.176: INFO: At 2019-10-10 09:23:47 +0000 UTC - event for affinity-nodeport: {replication-controller } SuccessfulCreate: Created pod: affinity-nodeport-wx7m8 Oct 10 09:26:37.176: INFO: At 2019-10-10 09:23:48 +0000 UTC - event for affinity-nodeport-cscrr: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Started: Started container affinity-nodeport Oct 10 09:26:37.176: INFO: At 2019-10-10 09:23:48 +0000 UTC - event for affinity-nodeport-cscrr: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Created: Created container affinity-nodeport Oct 10 09:26:37.176: INFO: At 2019-10-10 09:23:48 +0000 UTC - event for affinity-nodeport-cscrr: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:26:37.176: INFO: At 2019-10-10 09:23:48 +0000 UTC - event for affinity-nodeport-wx7m8: {kubelet ip-172-20-56-86.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:26:37.176: INFO: At 2019-10-10 09:23:48 +0000 UTC - event for affinity-nodeport-wx7m8: {kubelet ip-172-20-56-86.sa-east-1.compute.internal} Started: Started container affinity-nodeport Oct 10 09:26:37.176: INFO: At 2019-10-10 09:23:48 +0000 UTC - event for affinity-nodeport-wx7m8: {kubelet ip-172-20-56-86.sa-east-1.compute.internal} Created: Created container affinity-nodeport Oct 10 09:26:37.176: INFO: At 2019-10-10 09:23:48 +0000 UTC - event for affinity-nodeport-zpdnf: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:26:37.176: INFO: At 2019-10-10 09:23:48 +0000 UTC - event for affinity-nodeport-zpdnf: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Started: Started container affinity-nodeport Oct 10 09:26:37.176: INFO: At 2019-10-10 09:23:48 +0000 UTC - event for affinity-nodeport-zpdnf: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Created: Created container affinity-nodeport Oct 10 09:26:37.176: INFO: At 2019-10-10 09:23:57 +0000 UTC - event for execpod-affinitywxt4q: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Started: Started container agnhost-pause Oct 10 09:26:37.176: INFO: At 2019-10-10 09:23:57 +0000 UTC - event for execpod-affinitywxt4q: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.6" already present on machine Oct 10 09:26:37.176: INFO: At 2019-10-10 09:23:57 +0000 UTC - event for execpod-affinitywxt4q: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Created: Created container agnhost-pause Oct 10 09:26:37.176: INFO: At 2019-10-10 09:26:19 +0000 UTC - event for execpod-affinitywxt4q: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Killing: Stopping container agnhost-pause Oct 10 09:26:37.176: INFO: At 2019-10-10 09:26:20 +0000 UTC - event for affinity-nodeport: {endpoint-controller } FailedToUpdateEndpoint: Failed to update endpoint services-2853/affinity-nodeport: Operation cannot be fulfilled on endpoints "affinity-nodeport": the object has been modified; please apply your changes to the latest version and try again Oct 10 09:26:37.176: INFO: At 2019-10-10 09:26:20 +0000 UTC - event for affinity-nodeport-cscrr: {kubelet ip-172-20-42-37.sa-east-1.compute.internal} Killing: Stopping container affinity-nodeport Oct 10 09:26:37.176: INFO: At 2019-10-10 09:26:20 +0000 UTC - event for affinity-nodeport-wx7m8: {kubelet ip-172-20-56-86.sa-east-1.compute.internal} Killing: Stopping container affinity-nodeport Oct 10 09:26:37.176: INFO: At 2019-10-10 09:26:20 +0000 UTC - event for affinity-nodeport-zpdnf: {kubelet ip-172-20-49-15.sa-east-1.compute.internal} Killing: Stopping container affinity-nodeport Oct 10 09:26:37.319: INFO: POD NODE PHASE GRACE CONDITIONS Oct 10 09:26:37.319: INFO: Oct 10 09:26:37.462: INFO: Logging node info for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:26:37.605: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-37-177.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-37-177.sa-east-1.compute.internal 8ecedabe-969e-476a-8f76-1fb03eedaa56 20868 0 2019-10-10 09:12:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c4.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:master-sa-east-1c kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-37-177.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:master node-role.kubernetes.io/master:] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-08fb35da4b2014f59,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3949572096 0} {<nil>} 3857004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3844714496 0} {<nil>} 3754604Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:12:53 +0000 UTC,LastTransitionTime:2019-10-10 09:12:53 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:26:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:26:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:26:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:26:06 +0000 UTC,LastTransitionTime:2019-10-10 09:12:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.177,},NodeAddress{Type:ExternalIP,Address:54.233.97.36,},NodeAddress{Type:Hostname,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-37-177.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-97-36.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:75a86a2fc8e747568f8cd25355ed4a43,SystemUUID:EC277240-730F-D89C-36D2-B12A43ABB39F,BootID:33b7c61a-9c83-42db-9541-8a26846b977a,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[kopeio/etcd-manager@sha256:cb0ed7c56dadbc0f4cd515906d72b30094229d6e0a9fcb7aa44e23680bf9a3a8 kopeio/etcd-manager:3.0.20190930],SizeBytes:656348817,},ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:260130533,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:205085998,},ContainerImage{Names:[kope/dns-controller@sha256:aca3878acdac85716e1317dd2fc85b235551068d667e578fceb9b0e8c3561324 kope/dns-controller:1.15.0-alpha.1],SizeBytes:120867125,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:103791294,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Oct 10 09:26:37.605: INFO: Logging kubelet events for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:26:37.749: INFO: Logging pods the kubelet thinks is on node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:26:37.898: INFO: kube-controller-manager-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:37.898: INFO: Container kube-controller-manager ready: true, restart count 0 Oct 10 09:26:37.898: INFO: kube-proxy-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:37.898: INFO: Container kube-proxy ready: true, restart count 3 Oct 10 09:26:37.898: INFO: kube-scheduler-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:37.898: INFO: Container kube-scheduler ready: true, restart count 0 Oct 10 09:26:37.898: INFO: etcd-manager-events-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:37.898: INFO: Container etcd-manager ready: true, restart count 0 Oct 10 09:26:37.898: INFO: kops-controller-76f5d459f8-86j85 started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:37.898: INFO: Container kops-controller ready: true, restart count 0 Oct 10 09:26:37.898: INFO: dns-controller-78ccbffc6d-5pnmw started at 2019-10-10 09:13:34 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:37.898: INFO: Container dns-controller ready: true, restart count 0 Oct 10 09:26:37.898: INFO: etcd-manager-main-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:37.898: INFO: Container etcd-manager ready: true, restart count 0 Oct 10 09:26:37.898: INFO: kube-apiserver-ip-172-20-37-177.sa-east-1.compute.internal started at 2019-10-10 09:10:29 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:37.898: INFO: Container kube-apiserver ready: true, restart count 3 W1010 09:26:38.044119 891 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:26:38.351: INFO: Latency metrics for node ip-172-20-37-177.sa-east-1.compute.internal Oct 10 09:26:38.352: INFO: Logging node info for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:26:38.494: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-42-37.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-42-37.sa-east-1.compute.internal 8fb9f863-77f2-4451-ba99-614781c1c8bc 21709 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-42-37.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node mounted_volume_expand:mounted-volume-expand-8034 node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-1205":"ip-172-20-42-37.sa-east-1.compute.internal","csi-hostpath-volume-expand-3381":"ip-172-20-42-37.sa-east-1.compute.internal"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-020fda63f6b69c0ea,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:26:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:26:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:26:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:26:31 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.37,},NodeAddress{Type:ExternalIP,Address:54.233.88.138,},NodeAddress{Type:Hostname,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-42-37.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-233-88-138.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dbea17b1df4f4682b3aea8f7967a81f7,SystemUUID:EC276068-34A4-965C-3CB7-CA4BD3478D25,BootID:883b28de-249e-43a6-8e1c-705f97846842,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-00ffd682f68e9de2a kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0194c1f06c834833d kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0269672c060d2e367 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-07729e10024634411 kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0fdd29053b527a7bf kubernetes.io/csi/csi-hostpath-volume-expand-3381^0870b375-eb40-11e9-9e53-0a54417f5128],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/aws-ebs/aws://sa-east-1c/vol-07729e10024634411,DevicePath:/dev/xvdcb,},AttachedVolume{Name:kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0269672c060d2e367,DevicePath:/dev/xvdbc,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-3381^0870b375-eb40-11e9-9e53-0a54417f5128,DevicePath:,},AttachedVolume{Name:kubernetes.io/aws-ebs/aws://sa-east-1c/vol-00ffd682f68e9de2a,DevicePath:/dev/xvdbn,},},Config:nil,},} Oct 10 09:26:38.495: INFO: Logging kubelet events for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:26:38.640: INFO: Logging pods the kubelet thinks is on node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:26:38.806: INFO: csi-hostpathplugin-0 started at 2019-10-10 09:26:24 +0000 UTC (0+3 container statuses recorded) Oct 10 09:26:38.806: INFO: Container hostpath ready: true, restart count 0 Oct 10 09:26:38.806: INFO: Container liveness-probe ready: true, restart count 0 Oct 10 09:26:38.806: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 10 09:26:38.806: INFO: up-down-1-5zlsj started at 2019-10-10 09:26:23 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:38.806: INFO: Container up-down-1 ready: true, restart count 0 Oct 10 09:26:38.806: INFO: csi-hostpath-provisioner-0 started at 2019-10-10 09:26:24 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:38.806: INFO: Container csi-provisioner ready: true, restart count 0 Oct 10 09:26:38.806: INFO: hostexec-ip-172-20-42-37.sa-east-1.compute.internal-cntwf started at 2019-10-10 09:26:30 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:38.806: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:26:38.806: INFO: ss-0 started at 2019-10-10 09:26:14 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:38.806: INFO: Container webserver ready: true, restart count 0 Oct 10 09:26:38.806: INFO: replace-1570699560-nln8k started at 2019-10-10 09:26:03 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:38.806: INFO: Container c ready: false, restart count 0 Oct 10 09:26:38.806: INFO: security-context-9aac24d7-b18d-48e0-b42d-6817c5bd1e58 started at 2019-10-10 09:26:28 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:38.806: INFO: Container write-pod ready: true, restart count 0 Oct 10 09:26:38.806: INFO: csi-hostpath-resizer-0 started at 2019-10-10 09:26:24 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:38.806: INFO: Container csi-resizer ready: true, restart count 0 Oct 10 09:26:38.807: INFO: csi-snapshotter-0 started at 2019-10-10 09:26:25 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:38.807: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 10 09:26:38.807: INFO: exec-volume-test-aws-dynamicpv-d922 started at 2019-10-10 09:26:25 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:38.807: INFO: Container exec-container-aws-dynamicpv-d922 ready: false, restart count 0 Oct 10 09:26:38.807: INFO: aws-injector started at 2019-10-10 09:22:26 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:38.807: INFO: Container aws-injector ready: false, restart count 0 Oct 10 09:26:38.807: INFO: netserver-0 started at 2019-10-10 09:26:37 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:38.807: INFO: Container webserver ready: false, restart count 0 Oct 10 09:26:38.807: INFO: csi-hostpath-attacher-0 started at 2019-10-10 09:26:23 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:38.807: INFO: Container csi-attacher ready: true, restart count 0 Oct 10 09:26:38.807: INFO: kube-proxy-ip-172-20-42-37.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:38.807: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:26:38.807: INFO: exec-volume-test-aws-qfkw started at 2019-10-10 09:26:02 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:38.807: INFO: Container exec-container-aws-qfkw ready: false, restart count 0 Oct 10 09:26:38.807: INFO: ss-0 started at 2019-10-10 09:26:04 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:38.807: INFO: Container webserver ready: false, restart count 0 W1010 09:26:38.951062 891 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:26:39.280: INFO: Latency metrics for node ip-172-20-42-37.sa-east-1.compute.internal Oct 10 09:26:39.280: INFO: Logging node info for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:26:39.423: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-49-15.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-49-15.sa-east-1.compute.internal 105a0721-5b17-40b8-b686-ccf439f1ca2a 21350 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-49-15.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6677":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-1913":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-6893":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-8860":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-provisioning-9656":"ip-172-20-49-15.sa-east-1.compute.internal","csi-hostpath-v0-provisioning-5356":"ip-172-20-49-15.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-3724":"csi-mock-csi-mock-volumes-3724","csi-mock-csi-mock-volumes-4205":"csi-mock-csi-mock-volumes-4205","csi-mock-csi-mock-volumes-7612":"csi-mock-csi-mock-volumes-7612","csi-mock-csi-mock-volumes-8888":"csi-mock-csi-mock-volumes-8888"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-056d95303ed61d881,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:26:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:26:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:26:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:26:21 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.49.15,},NodeAddress{Type:ExternalIP,Address:18.228.205.178,},NodeAddress{Type:Hostname,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-49-15.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-228-205-178.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f468c62663d2465ca17ba5284774252e,SystemUUID:EC23BE58-6EBA-E800-9C73-DEB3BAA2D1B9,BootID:6eb82ab7-2bd7-418a-ba22-36d3a808a22b,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:195659796,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resizer@sha256:7d46fb6eb8b890dc546029d1565d502b4a1d974d33625c6ee2bc7991b77fc1a1 quay.io/k8scsi/csi-resizer:v0.2.0],SizeBytes:42817100,},ContainerImage{Names:[gcr.io/google-containers/debian-base@sha256:6966a0aedd7592c18ff2dd803c08bd85780ee19f5e3a2e7cf908a4cd837afcde gcr.io/google-containers/debian-base:0.4.1],SizeBytes:42323657,},ContainerImage{Names:[redis@sha256:50899ea1ceed33fa03232f3ac57578a424faa1742c1ac9c7a7bdb95cdf19b858 redis:5.0.5-alpine],SizeBytes:29331594,},ContainerImage{Names:[quay.io/k8scsi/hostpathplugin@sha256:b4826e492fc1762fceaf9726f41575ca0a4567864d3d235da874818de18039de quay.io/k8scsi/hostpathplugin:v1.2.0-rc5],SizeBytes:28761497,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/echoserver@sha256:e9ba514b896cdf559eef8788b66c2c3ee55f3572df617647b4b0d8b6bf81cf19 gcr.io/kubernetes-e2e-test-images/echoserver:2.2],SizeBytes:21692741,},ContainerImage{Names:[quay.io/k8scsi/mock-driver@sha256:e0eed916b7d970bad2b7d9875f9ad16932f987f0f3d91ec5d86da68b0b5cc9d1 quay.io/k8scsi/mock-driver:v2.1.0],SizeBytes:16226335,},ContainerImage{Names:[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine],SizeBytes:16032814,},ContainerImage{Names:[quay.io/k8scsi/csi-node-driver-registrar@sha256:13daf82fb99e951a4bff8ae5fc7c17c3a8fe7130be6400990d8f6076c32d4599 quay.io/k8scsi/csi-node-driver-registrar:v1.1.0],SizeBytes:15815995,},ContainerImage{Names:[quay.io/k8scsi/livenessprobe@sha256:dde617756e0f602adc566ab71fd885f1dad451ad3fb063ac991c95a2ff47aea5 quay.io/k8scsi/livenessprobe:v1.1.0],SizeBytes:14967303,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1],SizeBytes:9349974,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:4753501,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0],SizeBytes:4732240,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0],SizeBytes:1563521,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0],SizeBytes:1450451,},ContainerImage{Names:[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29],SizeBytes:1154361,},ContainerImage{Names:[k8s.gcr.io/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 k8s.gcr.io/pause-amd64:3.0],SizeBytes:746888,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea k8s.gcr.io/pause:3.1],SizeBytes:742472,},},VolumesInUse:[kubernetes.io/aws-ebs/aws://sa-east-1c/vol-0271c4f9c5e0a387e kubernetes.io/csi/csi-hostpath-v0-provisioning-5356^fe93d3a8-eb3f-11e9-b581-0a8a6f62bd00],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-v0-provisioning-5356^fe93d3a8-eb3f-11e9-b581-0a8a6f62bd00,DevicePath:,},},Config:nil,},} Oct 10 09:26:39.424: INFO: Logging kubelet events for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:26:39.568: INFO: Logging pods the kubelet thinks is on node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:26:39.715: INFO: pod-subpath-test-local-preprovisionedpv-5dww started at 2019-10-10 09:26:33 +0000 UTC (1+1 container statuses recorded) Oct 10 09:26:39.715: INFO: Init container init-volume-local-preprovisionedpv-5dww ready: true, restart count 0 Oct 10 09:26:39.715: INFO: Container test-container-subpath-local-preprovisionedpv-5dww ready: true, restart count 0 Oct 10 09:26:39.715: INFO: kube-proxy-ip-172-20-49-15.sa-east-1.compute.internal started at 2019-10-10 09:09:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:39.715: INFO: Container kube-proxy ready: true, restart count 2 Oct 10 09:26:39.715: INFO: hostexec-ip-172-20-49-15.sa-east-1.compute.internal-hhmrz started at 2019-10-10 09:26:17 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:39.715: INFO: Container agnhost ready: true, restart count 0 Oct 10 09:26:39.715: INFO: csi-hostpathplugin-j9vg2 started at 2019-10-10 09:25:49 +0000 UTC (0+2 container statuses recorded) Oct 10 09:26:39.715: INFO: Container driver-registrar ready: true, restart count 0 Oct 10 09:26:39.715: INFO: Container hostpath ready: true, restart count 0 Oct 10 09:26:39.715: INFO: exec-volume-test-aws-preprovisionedpv-v568 started at 2019-10-10 09:23:32 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:39.715: INFO: Container exec-container-aws-preprovisionedpv-v568 ready: false, restart count 0 Oct 10 09:26:39.715: INFO: csi-hostpath-attacher-0 started at 2019-10-10 09:25:48 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:39.715: INFO: Container csi-attacher ready: true, restart count 0 Oct 10 09:26:39.715: INFO: up-down-1-d7hwr started at 2019-10-10 09:26:23 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:39.715: INFO: Container up-down-1 ready: true, restart count 0 Oct 10 09:26:39.715: INFO: csi-hostpath-provisioner-0 started at 2019-10-10 09:25:49 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:39.715: INFO: Container csi-provisioner ready: true, restart count 0 Oct 10 09:26:39.715: INFO: netserver-1 started at 2019-10-10 09:26:37 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:39.715: INFO: Container webserver ready: false, restart count 0 Oct 10 09:26:39.715: INFO: pod-subpath-test-csi-hostpath-v0-dynamicpv-phb4 started at 2019-10-10 09:26:11 +0000 UTC (0+2 container statuses recorded) Oct 10 09:26:39.715: INFO: Container test-container-subpath-csi-hostpath-v0-dynamicpv-phb4 ready: false, restart count 0 Oct 10 09:26:39.715: INFO: Container test-container-volume-csi-hostpath-v0-dynamicpv-phb4 ready: false, restart count 0 Oct 10 09:26:39.715: INFO: up-down-2-5pwmc started at 2019-10-10 09:26:36 +0000 UTC (0+1 container statuses recorded) Oct 10 09:26:39.715: INFO: Container up-down-2 ready: true, restart count 0 W1010 09:26:39.860538 891 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled. Oct 10 09:26:40.175: INFO: Latency metrics for node ip-172-20-49-15.sa-east-1.compute.internal Oct 10 09:26:40.175: INFO: Logging node info for node ip-172-20-56-86.sa-east-1.compute.internal Oct 10 09:26:40.318: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-56-86.sa-east-1.compute.internal /api/v1/nodes/ip-172-20-56-86.sa-east-1.compute.internal cccbef08-fa00-42b5-ae85-da8efe4ee848 21058 0 2019-10-10 09:14:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t2.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:sa-east-1 failure-domain.beta.kubernetes.io/zone:sa-east-1c kops.k8s.io/instancegroup:nodes kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-56-86.sa-east-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node:] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9823":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volume-6196":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-v0-volumemode-1556":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-1749":"ip-172-20-56-86.sa-east-1.compute.internal","csi-hostpath-volume-expand-9939":"ip-172-20-56-86.sa-east-1.compute.internal","csi-mock-csi-mock-volumes-5777":"csi-mock-csi-mock-volumes-5777","csi-mock-csi-mock-volumes-6825":"csi-mock-csi-mock-volumes-6825"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///sa-east-1c/i-0b5800b629bcb7519,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{48246685696 0} {<nil>} BinarySI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4146270208 0} {<nil>} 4049092Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-aws-ebs: {{39 0} {<nil>} 39 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{43422017055 0} {<nil>} 43422017055 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4041412608 0} {<nil>} 3946692Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2019-10-10 09:14:43 +0000 UTC,LastTransitionTime:2019-10-10 09:14:43 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2019-10-10 09:26:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2019-10-10 09:26:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2019-10-10 09:26:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2019-10-10 09:26:11 +0000 UTC,LastTransitionTime:2019-10-10 09:14:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.86,},NodeAddress{Type:ExternalIP,Address:54.207.48.88,},NodeAddress{Type:Hostname,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-56-86.sa-east-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-207-48-88.sa-east-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:99be0b3f4ec34abb8f4f249d272797b5,SystemUUID:EC2EB353-C506-B251-A10A-9B28B752A967,BootID:e098fcb6-fca7-433b-9b9f-7e47386c5ca0,KernelVersion:4.9.0-9-amd64,OSImage:Debian GNU/Linux 9 (stretch),ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.17.0-alpha.1.268+2d8b8703de920b,KubeProxyVersion:v1.17.0-alpha.1.268+2d8b8703de920b,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[protokube:1.15.0-alpha.1],SizeBytes:566206391,},ContainerImage{Names:[quay.io/kubernetes_incubator/nfs-provisioner@sha256:df762117e3c891f2d2ddff46ecb0776ba1f9f3c44cfd7739b0683bcd7a7954a8 quay.io/kubernetes_incubator/nfs-provisioner:v2.2.2],SizeBytes:391772778,},ContainerImage{Names:[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6],SizeBytes:373099368,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:225358913,},ContainerImage{Names:[httpd@sha256:addd70e4ee83f3bc9a4c1c7c41e37927ba47faf639312fc936df3afad7926f5a httpd:2.4.39-alpine],SizeBytes:126894770,},ContainerImage{Names:[httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 httpd:2.4.38-alpine],SizeBytes:123781643,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.17.0-alpha.1.268_2d8b8703de920b],SizeBytes:100151374,},ContainerImage{Names:[kope/kops-controller:1.15.0-alpha.1],SizeBytes:78585473,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/kubernetes-e2e-test-images/agnhost:2.6],SizeBytes:57345321,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:0efcb424f1dde9b9fb11a1a14f2e48ab47e1c3f08bc3a929990dcfcb1f7ab34f quay.io/k8scsi/csi-provisioner:v1.4.0-rc1],SizeBytes:54431016,},ContainerImage{Names:[quay.io/k8scsi/csi-provisioner@sha256:b23381325dc242cb761861514195efc600f6a403fcd20a2ac4c6b26704def66f quay.io/k8scsi/csi-provisioner:v0.4.1],SizeBytes:53938589,},ContainerImage{Names:[quay.io/k8scsi/csi-snapshotter@sha256:e3d3e742e32d00488fdb401045b9b1d033d7ca0ab6e760f77b24750fc95e5f70 quay.io/k8scsi/csi-snapshotter:v2.0.0-rc1],SizeBytes:51703561,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:6fe3b8b1f8a1b3706fe740a278266cef53a9308d9b1ae736a46684c0d0cb52e1 quay.io/k8scsi/csi-attacher:v0.4.1],SizeBytes:49452185,},ContainerImage{Names:[quay.io/k8scsi/driver-registrar@sha256:b7c6cdbd3ad9e585f79365a5b9f5a83551629c2a3235ed0825d7629371963c10 quay.io/k8scsi/driver-registrar:v0.4.1],SizeBytes:47425903,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:26fccd7a99d973845df1193b46ebdcc6ab8dc5f6e6be319750c471fce1742d13 quay.io/k8scsi/csi-attacher:v1.2.0],SizeBytes:46226754,},ContainerImage{Names:[quay.io/k8scsi/csi-attacher@sha256:0aba670b4d9d6b2e720bbf575d733156c676b693ca26501235444490300db838 quay.io/k8scsi/csi-attacher:v1.1.0],SizeBytes:42839085,},ContainerImage{Names:[quay.io/k8scsi/csi-resize