This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 2 failed / 1187 succeeded
Started2020-10-13 05:54
Elapsed13h30m
Revision
Builder78c772fc-0d18-11eb-acdd-663f8ab42c5e
infra-commite1204ee06
job-versionv1.19.3-rc.0.58+5e3fac6ab2bbc5
master_os_imagecos-81-12871-59-0
node_os_imagecos-81-12871-59-0
revisionv1.19.3-rc.0.58+5e3fac6ab2bbc5

Test Failures


Kubernetes e2e suite [k8s.io] [sig-node] NodeProblemDetector [DisabledForLargeClusters] should run without error 2m10s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sNodeProblemDetector\s\[DisabledForLargeClusters\]\sshould\srun\swithout\serror$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:59
Oct 13 14:32:48.792: Timed out after 60.002s.
Expected success, but got an error:
    <*errors.errorString | 0xc0049cfb50>: {
        s: "expect event number 1, got 0: [{{ } {bootstrap-e2e-minion-group-g3lf.163d91d4e80e6692  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-g3lf.163d91d4e80e6692 3e50b2ff-b9a3-43af-abb0-3725010eec79 123116 0 2020-10-13 13:56:26 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-13 13:56:26 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:apiVersion\":{},\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-g3lf b9e2d78e-3ace-432b-bed8-a2f224b88be7 v1  } NodeNotReady Node bootstrap-e2e-minion-group-g3lf status is now: NodeNotReady {node-controller } 2020-10-13 13:56:26 +0000 UTC 2020-10-13 13:56:26 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-g3lf.163d91e6bb88962f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-g3lf.163d91e6bb88962f 568909bf-a917-4b37-8b66-b0d676b090c0 123122 0 2020-10-13 13:57:42 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-13 13:57:42 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-g3lf b9e2d78e-3ace-432b-bed8-a2f224b88be7   } Deleting node bootstrap-e2e-minion-group-g3lf because it does not exist in the cloud provider Node bootstrap-e2e-minion-group-g3lf event: DeletingNode {cloud-node-lifecycle-controller } 2020-10-13 13:57:42 +0000 UTC 2020-10-13 13:57:42 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-g3lf.163d91e7934c516c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-g3lf.163d91e7934c516c 6de9770a-0634-4239-b8cb-9a536472d815 123123 0 2020-10-13 13:57:46 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-13 13:57:46 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:apiVersion\":{},\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-g3lf b9e2d78e-3ace-432b-bed8-a2f224b88be7 v1  } RemovingNode Node bootstrap-e2e-minion-group-g3lf event: Removing Node bootstrap-e2e-minion-group-g3lf from Controller {node-controller } 2020-10-13 13:57:46 +0000 UTC 2020-10-13 13:57:46 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-k080.163d3a91020d55df  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-k080.163d3a91020d55df c4b58600-1f26-417c-b8f9-ed8002812a15 124424 0 2020-10-13 14:31:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 14:31:43 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-k080 bootstrap-e2e-minion-group-k080   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-k080} 2020-10-12 11:17:16 +0000 UTC 2020-10-13 14:31:43 +0000 UTC 3 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91bfdccd7746  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91bfdccd7746 fe386dd7-7417-4878-929f-e2d3159bef0d 123071 0 2020-10-13 13:54:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-13 13:54:55 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-p499} 2020-10-13 13:54:55 +0000 UTC 2020-10-13 13:54:55 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91bfdd9a30c4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91bfdd9a30c4 9d6d328c-4a24-49ac-a3bc-9bd27c0e3580 123072 0 2020-10-13 13:54:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-13 13:54:55 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } InvalidDiskCapacity invalid capacity 0 on image filesystem {kubelet bootstrap-e2e-minion-group-p499} 2020-10-13 13:54:55 +0000 UTC 2020-10-13 13:54:55 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91bfe5c96c89  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91bfe5c96c89 5a3b1127-0535-4c05-b6d0-a651025fe73d 123087 0 2020-10-13 13:54:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-13 13:54:56 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-p499 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-p499} 2020-10-13 13:54:55 +0000 UTC 2020-10-13 13:54:55 +0000 UTC 4 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91bfe5cab474  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91bfe5cab474 0680b074-e5f1-4ab9-a9f1-09669a2f6e0b 123085 0 2020-10-13 13:54:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-13 13:54:56 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-p499 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-p499} 2020-10-13 13:54:55 +0000 UTC 2020-10-13 13:54:55 +0000 UTC 4 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91bfe5cbde5e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91bfe5cbde5e 13e3990f-9d5c-4091-bbe0-7e1ab856b088 123086 0 2020-10-13 13:54:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-13 13:54:56 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-p499 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-p499} 2020-10-13 13:54:55 +0000 UTC 2020-10-13 13:54:55 +0000 UTC 4 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91bfe97e044f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91bfe97e044f 0ede6df7-6b5e-4732-906a-d6e31452e06b 123079 0 2020-10-13 13:54:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-13 13:54:55 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-p499} 2020-10-13 13:54:55 +0000 UTC 2020-10-13 13:54:55 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91c0c147b16e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91c0c147b16e cc29a11f-adc5-4e97-9515-ab136357986e 123091 0 2020-10-13 13:54:59 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 13:54:59 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } ContainerdStart Starting containerd container runtime... {systemd-monitor bootstrap-e2e-minion-group-p499} 2020-10-13 13:54:59 +0000 UTC 2020-10-13 13:54:59 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91c0c205d4e6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91c0c205d4e6 4e188791-da95-48fd-be4a-4b33df74c749 123092 0 2020-10-13 13:54:59 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 13:54:59 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } DockerStart Starting Docker Application Container Engine... {systemd-monitor bootstrap-e2e-minion-group-p499} 2020-10-13 13:54:59 +0000 UTC 2020-10-13 13:54:59 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91c0c2346a44  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91c0c2346a44 c3af4bc1-2d36-4e25-aa9a-b35b3c4a8aee 123093 0 2020-10-13 13:54:59 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 13:54:59 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-p499} 2020-10-13 13:54:59 +0000 UTC 2020-10-13 13:54:59 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91c11b75fc32  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91c11b75fc32 fa463903-6188-4a77-a6a4-7eca8b1ddaee 123094 0 2020-10-13 13:55:00 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-13 13:55:00 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:apiVersion\":{},\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-p499 3bc0d5c6-6409-4a83-9db3-be0eca36738c v1  } RegisteredNode Node bootstrap-e2e-minion-group-p499 event: Registered Node bootstrap-e2e-minion-group-p499 in Controller {node-controller } 2020-10-13 13:55:00 +0000 UTC 2020-10-13 13:55:00 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91c196c6e66d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91c196c6e66d 3ca5a770-c05c-4b28-84ef-9e833f701f3f 123099 0 2020-10-13 13:55:03 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-proxy Update v1 2020-10-13 13:55:03 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } Starting Starting kube-proxy. {kube-proxy bootstrap-e2e-minion-group-p499} 2020-10-13 13:55:03 +0000 UTC 2020-10-13 13:55:03 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91c24f2aba38  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91c24f2aba38 3507afbc-5372-455a-9a27-a352b90018f0 123111 0 2020-10-13 13:55:06 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-13 13:55:06 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } NodeReady Node bootstrap-e2e-minion-group-p499 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-p499} 2020-10-13 13:55:06 +0000 UTC 2020-10-13 13:55:06 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d93c2818162dd  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d93c2818162dd f6c32c7f-8b2e-460e-9dfb-8dbef27653a9 124426 0 2020-10-13 14:31:46 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 14:31:46 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-p499} 2020-10-13 14:31:46 +0000 UTC 2020-10-13 14:31:46 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d93c2818184c7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d93c2818184c7 43d291aa-bc29-4091-8264-16a281b73dd4 124425 0 2020-10-13 14:31:46 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 14:31:46 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-p499} 2020-10-13 14:31:46 +0000 UTC 2020-10-13 14:31:46 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-zl0k.163d3a91a07b5efe  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-zl0k.163d3a91a07b5efe 775ac8af-4ddf-4a75-9b99-5bcf8f3791bd 124427 0 2020-10-13 14:31:48 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 14:31:48 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-zl0k bootstrap-e2e-minion-group-zl0k   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-zl0k} 2020-10-12 11:17:19 +0000 UTC 2020-10-13 14:31:48 +0000 UTC 3 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  }]",
    }
    expect event number 1, got 0: [{{ } {bootstrap-e2e-minion-group-g3lf.163d91d4e80e6692  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-g3lf.163d91d4e80e6692 3e50b2ff-b9a3-43af-abb0-3725010eec79 123116 0 2020-10-13 13:56:26 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-13 13:56:26 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-g3lf b9e2d78e-3ace-432b-bed8-a2f224b88be7 v1  } NodeNotReady Node bootstrap-e2e-minion-group-g3lf status is now: NodeNotReady {node-controller } 2020-10-13 13:56:26 +0000 UTC 2020-10-13 13:56:26 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-g3lf.163d91e6bb88962f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-g3lf.163d91e6bb88962f 568909bf-a917-4b37-8b66-b0d676b090c0 123122 0 2020-10-13 13:57:42 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-13 13:57:42 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-g3lf b9e2d78e-3ace-432b-bed8-a2f224b88be7   } Deleting node bootstrap-e2e-minion-group-g3lf because it does not exist in the cloud provider Node bootstrap-e2e-minion-group-g3lf event: DeletingNode {cloud-node-lifecycle-controller } 2020-10-13 13:57:42 +0000 UTC 2020-10-13 13:57:42 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-g3lf.163d91e7934c516c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-g3lf.163d91e7934c516c 6de9770a-0634-4239-b8cb-9a536472d815 123123 0 2020-10-13 13:57:46 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-13 13:57:46 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-g3lf b9e2d78e-3ace-432b-bed8-a2f224b88be7 v1  } RemovingNode Node bootstrap-e2e-minion-group-g3lf event: Removing Node bootstrap-e2e-minion-group-g3lf from Controller {node-controller } 2020-10-13 13:57:46 +0000 UTC 2020-10-13 13:57:46 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-k080.163d3a91020d55df  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-k080.163d3a91020d55df c4b58600-1f26-417c-b8f9-ed8002812a15 124424 0 2020-10-13 14:31:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 14:31:43 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-k080 bootstrap-e2e-minion-group-k080   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-k080} 2020-10-12 11:17:16 +0000 UTC 2020-10-13 14:31:43 +0000 UTC 3 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91bfdccd7746  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91bfdccd7746 fe386dd7-7417-4878-929f-e2d3159bef0d 123071 0 2020-10-13 13:54:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-13 13:54:55 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-p499} 2020-10-13 13:54:55 +0000 UTC 2020-10-13 13:54:55 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91bfdd9a30c4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91bfdd9a30c4 9d6d328c-4a24-49ac-a3bc-9bd27c0e3580 123072 0 2020-10-13 13:54:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-13 13:54:55 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } InvalidDiskCapacity invalid capacity 0 on image filesystem {kubelet bootstrap-e2e-minion-group-p499} 2020-10-13 13:54:55 +0000 UTC 2020-10-13 13:54:55 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91bfe5c96c89  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91bfe5c96c89 5a3b1127-0535-4c05-b6d0-a651025fe73d 123087 0 2020-10-13 13:54:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-13 13:54:56 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-p499 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-p499} 2020-10-13 13:54:55 +0000 UTC 2020-10-13 13:54:55 +0000 UTC 4 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91bfe5cab474  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91bfe5cab474 0680b074-e5f1-4ab9-a9f1-09669a2f6e0b 123085 0 2020-10-13 13:54:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-13 13:54:56 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-p499 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-p499} 2020-10-13 13:54:55 +0000 UTC 2020-10-13 13:54:55 +0000 UTC 4 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91bfe5cbde5e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91bfe5cbde5e 13e3990f-9d5c-4091-bbe0-7e1ab856b088 123086 0 2020-10-13 13:54:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-13 13:54:56 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-p499 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-p499} 2020-10-13 13:54:55 +0000 UTC 2020-10-13 13:54:55 +0000 UTC 4 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91bfe97e044f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91bfe97e044f 0ede6df7-6b5e-4732-906a-d6e31452e06b 123079 0 2020-10-13 13:54:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-13 13:54:55 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-p499} 2020-10-13 13:54:55 +0000 UTC 2020-10-13 13:54:55 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91c0c147b16e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91c0c147b16e cc29a11f-adc5-4e97-9515-ab136357986e 123091 0 2020-10-13 13:54:59 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 13:54:59 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } ContainerdStart Starting containerd container runtime... {systemd-monitor bootstrap-e2e-minion-group-p499} 2020-10-13 13:54:59 +0000 UTC 2020-10-13 13:54:59 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91c0c205d4e6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91c0c205d4e6 4e188791-da95-48fd-be4a-4b33df74c749 123092 0 2020-10-13 13:54:59 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 13:54:59 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } DockerStart Starting Docker Application Container Engine... {systemd-monitor bootstrap-e2e-minion-group-p499} 2020-10-13 13:54:59 +0000 UTC 2020-10-13 13:54:59 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91c0c2346a44  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91c0c2346a44 c3af4bc1-2d36-4e25-aa9a-b35b3c4a8aee 123093 0 2020-10-13 13:54:59 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 13:54:59 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-p499} 2020-10-13 13:54:59 +0000 UTC 2020-10-13 13:54:59 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91c11b75fc32  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91c11b75fc32 fa463903-6188-4a77-a6a4-7eca8b1ddaee 123094 0 2020-10-13 13:55:00 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-13 13:55:00 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:apiVersion":{},"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-p499 3bc0d5c6-6409-4a83-9db3-be0eca36738c v1  } RegisteredNode Node bootstrap-e2e-minion-group-p499 event: Registered Node bootstrap-e2e-minion-group-p499 in Controller {node-controller } 2020-10-13 13:55:00 +0000 UTC 2020-10-13 13:55:00 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91c196c6e66d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91c196c6e66d 3ca5a770-c05c-4b28-84ef-9e833f701f3f 123099 0 2020-10-13 13:55:03 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-proxy Update v1 2020-10-13 13:55:03 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } Starting Starting kube-proxy. {kube-proxy bootstrap-e2e-minion-group-p499} 2020-10-13 13:55:03 +0000 UTC 2020-10-13 13:55:03 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d91c24f2aba38  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d91c24f2aba38 3507afbc-5372-455a-9a27-a352b90018f0 123111 0 2020-10-13 13:55:06 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-13 13:55:06 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } NodeReady Node bootstrap-e2e-minion-group-p499 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-p499} 2020-10-13 13:55:06 +0000 UTC 2020-10-13 13:55:06 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d93c2818162dd  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d93c2818162dd f6c32c7f-8b2e-460e-9dfb-8dbef27653a9 124426 0 2020-10-13 14:31:46 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 14:31:46 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-p499} 2020-10-13 14:31:46 +0000 UTC 2020-10-13 14:31:46 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p499.163d93c2818184c7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-p499.163d93c2818184c7 43d291aa-bc29-4091-8264-16a281b73dd4 124425 0 2020-10-13 14:31:46 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 14:31:46 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-p499 bootstrap-e2e-minion-group-p499   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-p499} 2020-10-13 14:31:46 +0000 UTC 2020-10-13 14:31:46 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-zl0k.163d3a91a07b5efe  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-zl0k.163d3a91a07b5efe 775ac8af-4ddf-4a75-9b99-5bcf8f3791bd 124427 0 2020-10-13 14:31:48 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 14:31:48 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-zl0k bootstrap-e2e-minion-group-zl0k   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-zl0k} 2020-10-12 11:17:19 +0000 UTC 2020-10-13 14:31:48 +0000 UTC 3 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  }]
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:134
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Test 13h26m

error during ./hack/ginkgo-e2e.sh --ginkgo.skip=\[Disruptive\]|\[Flaky\]|\[Feature:.+\] --clean-start=true --minStartupPods=8 --report-dir=/workspace/_artifacts --disable-log-dump=true: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 1187 Passed Tests

Show 4050 Skipped Tests