This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 2 failed / 1196 succeeded
Started2020-10-13 07:24
Elapsed15h52m
Revision
Builder0c88a660-0d25-11eb-acdd-663f8ab42c5e
infra-commitfbd8fdf50
job-versionv1.20.0-alpha.1.381+ee297b6f4d78da
master_os_imagecos-85-13310-1041-9
node_os_imagecos-85-13310-1041-9
repogithub.com/containerd/cri
repo-commita0b3b4e4da2e7802927f67efc77feb5433882b0e
repos{u'github.com/containerd/cri': u'master'}
revisionv1.20.0-alpha.1.381+ee297b6f4d78da

Test Failures


Kubernetes e2e suite [k8s.io] [sig-node] NodeProblemDetector [DisabledForLargeClusters] should run without error 2m10s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sNodeProblemDetector\s\[DisabledForLargeClusters\]\sshould\srun\swithout\serror$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:59
Oct 13 12:51:09.770: Timed out after 60.001s.
Expected success, but got an error:
    <*errors.errorString | 0xc00304ce80>: {
        s: "Event KubeletStart does not exist: [{{ } {bootstrap-e2e-master.163d888647b7cfe1  default  27ba8650-b471-45b7-bb6d-cb7297edf420 156279 0 2020-10-13 11:05:52 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-13 11:05:52 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-master bootstrap-e2e-master   } FreeDiskSpaceFailed (combined from similar events): failed to garbage collect required amount of images. Wanted to free 1203784908 bytes, but freed 76581188 bytes {kubelet bootstrap-e2e-master} 2020-10-13 11:05:52 +0000 UTC 2020-10-13 12:20:54 +0000 UTC 16 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-master.163d88cc357f7dfc  default  ca49db3a-f140-4f2b-86fc-20d57377d7f3 157657 0 2020-10-13 11:10:53 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-13 11:10:53 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-master bootstrap-e2e-master   } ImageGCFailed (combined from similar events): failed to garbage collect required amount of images. Wanted to free 1030982860 bytes, but freed 0 bytes {kubelet bootstrap-e2e-master} 2020-10-13 11:10:53 +0000 UTC 2020-10-13 12:50:54 +0000 UTC 21 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mq91.163d8e35dd5b45cb  default  424473fe-d26b-4818-9ccb-31db9a714176 157654 0 2020-10-13 12:50:04 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 12:50:04 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-mq91 bootstrap-e2e-minion-group-mq91   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-mq91} 2020-10-13 12:50:04 +0000 UTC 2020-10-13 12:50:04 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mq91.163d8e35dd5c0622  default  de83925c-d3b4-4e1d-88a6-4da488342302 157653 0 2020-10-13 12:50:04 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 12:50:04 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-mq91 bootstrap-e2e-minion-group-mq91   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-mq91} 2020-10-13 12:50:04 +0000 UTC 2020-10-13 12:50:04 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-tt1c.163d22b08edbf791  default  14aaeb11-8cd4-4ea7-8146-271fac06f7d1 157655 0 2020-10-13 12:50:07 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 12:50:07 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-tt1c bootstrap-e2e-minion-group-tt1c   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-tt1c} 2020-10-12 03:59:44 +0000 UTC 2020-10-13 12:50:07 +0000 UTC 3 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-zmg9.163cf0937bad2fea  default  19dd11b2-9b87-4e79-bae7-e25085a1d35a 157656 0 2020-10-13 12:50:09 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 12:50:09 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{\"f:kind\":{},\"f:name\":{},\"f:uid\":{}},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}}}]} {Node  bootstrap-e2e-minion-group-zmg9 bootstrap-e2e-minion-group-zmg9   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-zmg9} 2020-10-11 12:41:23 +0000 UTC 2020-10-13 12:50:09 +0000 UTC 4 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  }]",
    }
    Event KubeletStart does not exist: [{{ } {bootstrap-e2e-master.163d888647b7cfe1  default  27ba8650-b471-45b7-bb6d-cb7297edf420 156279 0 2020-10-13 11:05:52 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-13 11:05:52 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-master bootstrap-e2e-master   } FreeDiskSpaceFailed (combined from similar events): failed to garbage collect required amount of images. Wanted to free 1203784908 bytes, but freed 76581188 bytes {kubelet bootstrap-e2e-master} 2020-10-13 11:05:52 +0000 UTC 2020-10-13 12:20:54 +0000 UTC 16 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-master.163d88cc357f7dfc  default  ca49db3a-f140-4f2b-86fc-20d57377d7f3 157657 0 2020-10-13 11:10:53 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-13 11:10:53 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-master bootstrap-e2e-master   } ImageGCFailed (combined from similar events): failed to garbage collect required amount of images. Wanted to free 1030982860 bytes, but freed 0 bytes {kubelet bootstrap-e2e-master} 2020-10-13 11:10:53 +0000 UTC 2020-10-13 12:50:54 +0000 UTC 21 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mq91.163d8e35dd5b45cb  default  424473fe-d26b-4818-9ccb-31db9a714176 157654 0 2020-10-13 12:50:04 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 12:50:04 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-mq91 bootstrap-e2e-minion-group-mq91   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-mq91} 2020-10-13 12:50:04 +0000 UTC 2020-10-13 12:50:04 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mq91.163d8e35dd5c0622  default  de83925c-d3b4-4e1d-88a6-4da488342302 157653 0 2020-10-13 12:50:04 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 12:50:04 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-mq91 bootstrap-e2e-minion-group-mq91   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-mq91} 2020-10-13 12:50:04 +0000 UTC 2020-10-13 12:50:04 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-tt1c.163d22b08edbf791  default  14aaeb11-8cd4-4ea7-8146-271fac06f7d1 157655 0 2020-10-13 12:50:07 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 12:50:07 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-tt1c bootstrap-e2e-minion-group-tt1c   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-tt1c} 2020-10-12 03:59:44 +0000 UTC 2020-10-13 12:50:07 +0000 UTC 3 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-zmg9.163cf0937bad2fea  default  19dd11b2-9b87-4e79-bae7-e25085a1d35a 157656 0 2020-10-13 12:50:09 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-13 12:50:09 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{"f:kind":{},"f:name":{},"f:uid":{}},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}}}]} {Node  bootstrap-e2e-minion-group-zmg9 bootstrap-e2e-minion-group-zmg9   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-zmg9} 2020-10-11 12:41:23 +0000 UTC 2020-10-13 12:50:09 +0000 UTC 4 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  }]
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:142
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Test 15h37m

error during ./hack/ginkgo-e2e.sh --ginkgo.skip=\[Disruptive\]|\[Flaky\]|\[Feature:.+\] --clean-start=true --minStartupPods=8 --report-dir=/workspace/_artifacts --disable-log-dump=true: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 1196 Passed Tests

Show 4035 Skipped Tests