This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 3 failed / 1256 succeeded
Started2022-08-07 14:21
Elapsed14h50m
Revision
Builder2aea2ae1-165c-11ed-bcf2-1217529f69d6
control_plane_node_os_imagecos-85-13310-1308-1
infra-commite29f272f4
job-versionv1.24.4-rc.0.14+3dc15e1cdde539
kubetest-versionv20220804-4fa19ea91a
revisionv1.24.4-rc.0.14+3dc15e1cdde539
worker_node_os_imagecos-85-13310-1308-1

Test Failures


Kubernetes e2e suite [sig-node] NodeProblemDetector should run without error 2m13s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-node\]\sNodeProblemDetector\sshould\srun\swithout\serror$'
test/e2e/node/node_problem_detector.go:62
Aug  7 14:25:21.090: Timed out after 60.001s.
Expected success, but got an error:
    <*errors.errorString | 0xc0040b3db0>: {
        s: "expect event number 1, got 0: [{{ } {bootstrap-e2e-minion-group-4w90.170914c2265f96a9  default  ea0bc9c6-0304-41ce-a58d-c817cd51af2e 59252 0 2022-08-07 13:59:21 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2022-08-07 13:59:21 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-4w90 936ae8b4-e337-49bb-9304-eb4a00f0dfb3 v1  } NodeNotReady Node bootstrap-e2e-minion-group-4w90 status is now: NodeNotReady {node-controller } 2022-08-07 13:59:21 +0000 UTC 2022-08-07 13:59:21 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4w90.170914d18c43fcd8  default  84462f05-eb25-4c0a-a2a2-c5d9b4b5b501 59259 0 2022-08-07 14:00:27 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2022-08-07 14:00:27 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-4w90 936ae8b4-e337-49bb-9304-eb4a00f0dfb3   } DeletingNode Deleting node bootstrap-e2e-minion-group-4w90 because it does not exist in the cloud provider {cloud-node-lifecycle-controller } 2022-08-07 14:00:27 +0000 UTC 2022-08-07 14:00:27 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4w90.170914d27cb78425  default  310ec8f6-c59b-46f3-ab56-0478582beb38 59263 0 2022-08-07 14:00:31 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2022-08-07 14:00:31 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-4w90 936ae8b4-e337-49bb-9304-eb4a00f0dfb3 v1  } RemovingNode Node bootstrap-e2e-minion-group-4w90 event: Removing Node bootstrap-e2e-minion-group-4w90 from Controller {node-controller } 2022-08-07 14:00:31 +0000 UTC 2022-08-07 14:00:31 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914add1fe8e57  default  0ccf316c-e468-4472-b40a-7b12580af725 59203 0 2022-08-07 13:57:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-08-07 13:57:54 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:57:54 +0000 UTC 2022-08-07 13:57:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914add2bb8132  default  c84b195e-815a-45b9-a6ab-09e47b6ea457 59204 0 2022-08-07 13:57:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-08-07 13:57:54 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } InvalidDiskCapacity invalid capacity 0 on image filesystem {kubelet bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:57:54 +0000 UTC 2022-08-07 13:57:54 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914addb7e3d59  default  7cfd5f5a-c111-4336-bd67-fcef6e243644 59208 0 2022-08-07 13:57:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-08-07 13:57:54 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-mlk2 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:57:54 +0000 UTC 2022-08-07 13:57:54 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914addb7e9eeb  default  45f02649-8f2f-4d38-b593-1065196018de 59209 0 2022-08-07 13:57:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-08-07 13:57:54 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-mlk2 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:57:54 +0000 UTC 2022-08-07 13:57:54 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914addb7eef27  default  6f4635aa-7295-4f83-a538-12b4416928af 59210 0 2022-08-07 13:57:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-08-07 13:57:54 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-mlk2 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:57:54 +0000 UTC 2022-08-07 13:57:54 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914addcd41560  default  ca93fb1c-5ea8-4c0a-a6b9-12d298c4ec55 59211 0 2022-08-07 13:57:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-08-07 13:57:54 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:57:54 +0000 UTC 2022-08-07 13:57:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914ae535d99c5  default  161ae646-8391-404f-838c-bea2c65d5392 59217 0 2022-08-07 13:57:56 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-proxy Update events.k8s.io/v1 2022-08-07 13:57:56 +0000 UTC FieldsV1 {\"f:action\":{},\"f:eventTime\":{},\"f:reason\":{},\"f:regarding\":{},\"f:reportingController\":{},\"f:reportingInstance\":{},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } Starting  { } 0001-01-01 00:00:00 +0000 UTC 0001-01-01 00:00:00 +0000 UTC 0 Normal 2022-08-07 13:57:56.618245006 +0000 UTC nil StartKubeProxy nil kube-proxy kube-proxy-bootstrap-e2e-minion-group-mlk2} {{ } {bootstrap-e2e-minion-group-mlk2.170914ae56461e93  default  3aaaa5a3-84e6-4ff8-9050-49c8dfe9f451 59218 0 2022-08-07 13:57:56 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2022-08-07 13:57:56 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 38f25bb0-e77d-4bc2-9ce8-9cddd0ca619a v1  } RegisteredNode Node bootstrap-e2e-minion-group-mlk2 event: Registered Node bootstrap-e2e-minion-group-mlk2 in Controller {node-controller } 2022-08-07 13:57:56 +0000 UTC 2022-08-07 13:57:56 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914aed7d546b8  default  10d3b356-687e-42a9-abb0-7c5cc339858d 59226 0 2022-08-07 13:57:58 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-08-07 13:57:58 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } ContainerdStart Starting containerd container runtime... {systemd-monitor bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:57:58 +0000 UTC 2022-08-07 13:57:58 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914aedc2b95da  default  0423160b-601c-4901-916f-6ea0ef9768f8 59224 0 2022-08-07 13:57:58 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-08-07 13:57:58 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } DockerStart Starting Docker Application Container Engine... {systemd-monitor bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:57:58 +0000 UTC 2022-08-07 13:57:58 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914aedc3e6865  default  0e82c630-488f-4e15-8b8d-11be7d4e7dd9 59225 0 2022-08-07 13:57:58 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-08-07 13:57:58 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:57:58 +0000 UTC 2022-08-07 13:57:58 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914b0445759c3  default  e9135e5a-dc4f-404d-8f0d-eede238e3112 59239 0 2022-08-07 13:58:04 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-08-07 13:58:04 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } NodeReady Node bootstrap-e2e-minion-group-mlk2 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:58:04 +0000 UTC 2022-08-07 13:58:04 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.1709161db0bd2288  default  60f7b671-3b83-4252-8f7c-634d2c9c102d 60039 0 2022-08-07 14:24:14 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-08-07 14:24:14 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } TaskHung kernel: INFO: task docker:12345 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-mlk2} 2022-08-07 14:24:14 +0000 UTC 2022-08-07 14:24:14 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.1709161db0bd4716  default  51472001-8cfd-4bdd-b59a-be2c0fdd046f 60038 0 2022-08-07 14:24:14 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-08-07 14:24:14 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } DockerHung Node condition KernelDeadlock is now: True, reason: DockerHung {kernel-monitor bootstrap-e2e-minion-group-mlk2} 2022-08-07 14:24:14 +0000 UTC 2022-08-07 14:24:14 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p23x.1708f45e01a0e92f  default  3d102761-0556-487f-a3fb-89fc03a266bd 60040 0 2022-08-07 14:24:17 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-08-07 14:24:17 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-p23x bootstrap-e2e-minion-group-p23x   } TaskHung kernel: INFO: task docker:12345 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-p23x} 2022-08-07 04:05:47 +0000 UTC 2022-08-07 14:24:17 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-t7p0.1708f45ec1ddf9ce  default  8240c43f-f2fc-480b-9a69-26e59c9931ca 60041 0 2022-08-07 14:24:20 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-08-07 14:24:20 +0000 UTC FieldsV1 {\"f:count\":{},\"f:firstTimestamp\":{},\"f:involvedObject\":{},\"f:lastTimestamp\":{},\"f:message\":{},\"f:reason\":{},\"f:source\":{\"f:component\":{},\"f:host\":{}},\"f:type\":{}} }]} {Node  bootstrap-e2e-minion-group-t7p0 bootstrap-e2e-minion-group-t7p0   } TaskHung kernel: INFO: task docker:12345 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-t7p0} 2022-08-07 04:05:50 +0000 UTC 2022-08-07 14:24:20 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  }]",
    }
    expect event number 1, got 0: [{{ } {bootstrap-e2e-minion-group-4w90.170914c2265f96a9  default  ea0bc9c6-0304-41ce-a58d-c817cd51af2e 59252 0 2022-08-07 13:59:21 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2022-08-07 13:59:21 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-4w90 936ae8b4-e337-49bb-9304-eb4a00f0dfb3 v1  } NodeNotReady Node bootstrap-e2e-minion-group-4w90 status is now: NodeNotReady {node-controller } 2022-08-07 13:59:21 +0000 UTC 2022-08-07 13:59:21 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4w90.170914d18c43fcd8  default  84462f05-eb25-4c0a-a2a2-c5d9b4b5b501 59259 0 2022-08-07 14:00:27 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2022-08-07 14:00:27 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-4w90 936ae8b4-e337-49bb-9304-eb4a00f0dfb3   } DeletingNode Deleting node bootstrap-e2e-minion-group-4w90 because it does not exist in the cloud provider {cloud-node-lifecycle-controller } 2022-08-07 14:00:27 +0000 UTC 2022-08-07 14:00:27 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4w90.170914d27cb78425  default  310ec8f6-c59b-46f3-ab56-0478582beb38 59263 0 2022-08-07 14:00:31 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2022-08-07 14:00:31 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-4w90 936ae8b4-e337-49bb-9304-eb4a00f0dfb3 v1  } RemovingNode Node bootstrap-e2e-minion-group-4w90 event: Removing Node bootstrap-e2e-minion-group-4w90 from Controller {node-controller } 2022-08-07 14:00:31 +0000 UTC 2022-08-07 14:00:31 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914add1fe8e57  default  0ccf316c-e468-4472-b40a-7b12580af725 59203 0 2022-08-07 13:57:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-08-07 13:57:54 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:57:54 +0000 UTC 2022-08-07 13:57:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914add2bb8132  default  c84b195e-815a-45b9-a6ab-09e47b6ea457 59204 0 2022-08-07 13:57:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-08-07 13:57:54 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } InvalidDiskCapacity invalid capacity 0 on image filesystem {kubelet bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:57:54 +0000 UTC 2022-08-07 13:57:54 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914addb7e3d59  default  7cfd5f5a-c111-4336-bd67-fcef6e243644 59208 0 2022-08-07 13:57:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-08-07 13:57:54 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-mlk2 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:57:54 +0000 UTC 2022-08-07 13:57:54 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914addb7e9eeb  default  45f02649-8f2f-4d38-b593-1065196018de 59209 0 2022-08-07 13:57:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-08-07 13:57:54 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-mlk2 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:57:54 +0000 UTC 2022-08-07 13:57:54 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914addb7eef27  default  6f4635aa-7295-4f83-a538-12b4416928af 59210 0 2022-08-07 13:57:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-08-07 13:57:54 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-mlk2 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:57:54 +0000 UTC 2022-08-07 13:57:54 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914addcd41560  default  ca93fb1c-5ea8-4c0a-a6b9-12d298c4ec55 59211 0 2022-08-07 13:57:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-08-07 13:57:54 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:57:54 +0000 UTC 2022-08-07 13:57:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914ae535d99c5  default  161ae646-8391-404f-838c-bea2c65d5392 59217 0 2022-08-07 13:57:56 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-proxy Update events.k8s.io/v1 2022-08-07 13:57:56 +0000 UTC FieldsV1 {"f:action":{},"f:eventTime":{},"f:reason":{},"f:regarding":{},"f:reportingController":{},"f:reportingInstance":{},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } Starting  { } 0001-01-01 00:00:00 +0000 UTC 0001-01-01 00:00:00 +0000 UTC 0 Normal 2022-08-07 13:57:56.618245006 +0000 UTC nil StartKubeProxy nil kube-proxy kube-proxy-bootstrap-e2e-minion-group-mlk2} {{ } {bootstrap-e2e-minion-group-mlk2.170914ae56461e93  default  3aaaa5a3-84e6-4ff8-9050-49c8dfe9f451 59218 0 2022-08-07 13:57:56 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2022-08-07 13:57:56 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 38f25bb0-e77d-4bc2-9ce8-9cddd0ca619a v1  } RegisteredNode Node bootstrap-e2e-minion-group-mlk2 event: Registered Node bootstrap-e2e-minion-group-mlk2 in Controller {node-controller } 2022-08-07 13:57:56 +0000 UTC 2022-08-07 13:57:56 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914aed7d546b8  default  10d3b356-687e-42a9-abb0-7c5cc339858d 59226 0 2022-08-07 13:57:58 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-08-07 13:57:58 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } ContainerdStart Starting containerd container runtime... {systemd-monitor bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:57:58 +0000 UTC 2022-08-07 13:57:58 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914aedc2b95da  default  0423160b-601c-4901-916f-6ea0ef9768f8 59224 0 2022-08-07 13:57:58 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-08-07 13:57:58 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } DockerStart Starting Docker Application Container Engine... {systemd-monitor bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:57:58 +0000 UTC 2022-08-07 13:57:58 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914aedc3e6865  default  0e82c630-488f-4e15-8b8d-11be7d4e7dd9 59225 0 2022-08-07 13:57:58 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-08-07 13:57:58 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:57:58 +0000 UTC 2022-08-07 13:57:58 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.170914b0445759c3  default  e9135e5a-dc4f-404d-8f0d-eede238e3112 59239 0 2022-08-07 13:58:04 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2022-08-07 13:58:04 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } NodeReady Node bootstrap-e2e-minion-group-mlk2 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-mlk2} 2022-08-07 13:58:04 +0000 UTC 2022-08-07 13:58:04 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.1709161db0bd2288  default  60f7b671-3b83-4252-8f7c-634d2c9c102d 60039 0 2022-08-07 14:24:14 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-08-07 14:24:14 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } TaskHung kernel: INFO: task docker:12345 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-mlk2} 2022-08-07 14:24:14 +0000 UTC 2022-08-07 14:24:14 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mlk2.1709161db0bd4716  default  51472001-8cfd-4bdd-b59a-be2c0fdd046f 60038 0 2022-08-07 14:24:14 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-08-07 14:24:14 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-mlk2 bootstrap-e2e-minion-group-mlk2   } DockerHung Node condition KernelDeadlock is now: True, reason: DockerHung {kernel-monitor bootstrap-e2e-minion-group-mlk2} 2022-08-07 14:24:14 +0000 UTC 2022-08-07 14:24:14 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-p23x.1708f45e01a0e92f  default  3d102761-0556-487f-a3fb-89fc03a266bd 60040 0 2022-08-07 14:24:17 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-08-07 14:24:17 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-p23x bootstrap-e2e-minion-group-p23x   } TaskHung kernel: INFO: task docker:12345 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-p23x} 2022-08-07 04:05:47 +0000 UTC 2022-08-07 14:24:17 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-t7p0.1708f45ec1ddf9ce  default  8240c43f-f2fc-480b-9a69-26e59c9931ca 60041 0 2022-08-07 14:24:20 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2022-08-07 14:24:20 +0000 UTC FieldsV1 {"f:count":{},"f:firstTimestamp":{},"f:involvedObject":{},"f:lastTimestamp":{},"f:message":{},"f:reason":{},"f:source":{"f:component":{},"f:host":{}},"f:type":{}} }]} {Node  bootstrap-e2e-minion-group-t7p0 bootstrap-e2e-minion-group-t7p0   } TaskHung kernel: INFO: task docker:12345 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-t7p0} 2022-08-07 04:05:50 +0000 UTC 2022-08-07 14:24:20 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  }]
test/e2e/node/node_problem_detector.go:153
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gluster] [Testpattern: Pre-provisioned PV (default fs)] volumeIO should write files of various sizes, verify size, validate content [Slow] 1h0m

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sIn\-tree\sVolumes\s\[Driver\:\sgluster\]\s\[Testpattern\:\sPre\-provisioned\sPV\s\(default\sfs\)\]\svolumeIO\sshould\swrite\sfiles\sof\svarious\ssizes\,\sverify\ssize\,\svalidate\scontent\s\[Slow\]$'
test/e2e/storage/testsuites/volume_io.go:149
Aug  7 15:41:21.888: Unexpected error:
    <*errors.errorString | 0xc0044940a0>: {
        s: "error writing to volume using \"i=0; while [ $i -lt 100 ]; do dd if=/opt/gluster-volumeio-8641-dd_if bs=1048576 >>/opt/gluster_io_test_volumeio-8641-104857600 2>/dev/null; let i+=1; done\": command terminated with exit code 137\nstdout: \nstderr: ",
    }
    error writing to volume using "i=0; while [ $i -lt 100 ]; do dd if=/opt/gluster-volumeio-8641-dd_if bs=1048576 >>/opt/gluster_io_test_volumeio-8641-104857600 2>/dev/null; let i+=1; done": command terminated with exit code 137
    stdout: 
    stderr: 
occurred
test/e2e/storage/testsuites/volume_io.go:165
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


kubetest Test 14h41m

error during ./hack/ginkgo-e2e.sh --ginkgo.skip=\[Driver:.gcepd\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\] --clean-start=true --minStartupPods=8 --report-dir=/workspace/_artifacts --disable-log-dump=true: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 1256 Passed Tests

Show 5721 Skipped Tests