This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 17 failed / 778 succeeded
Started2020-03-10 14:07
Elapsed15h15m
Revision
Builder651ee389-62d8-11ea-9509-56dae67b7bf1
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/312460cc-fbb6-4342-b135-76e6d758f6d3/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/312460cc-fbb6-4342-b135-76e6d758f6d3/targets/test
infra-commit69c454f53
job-versionv1.16.8-beta.0.55+33f0187aa847c7
master_os_imagecos-77-12371-175-0
node_os_imagecos-73-11647-163-0
revisionv1.16.8-beta.0.55+33f0187aa847c7

Test Failures


Kubernetes e2e suite [k8s.io] [sig-cloud-provider-gcp] Upgrade [Feature:Upgrade] master upgrade should maintain a functioning cluster [Feature:MasterUpgrade] 17m57s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-cloud\-provider\-gcp\]\sUpgrade\s\[Feature\:Upgrade\]\smaster\supgrade\sshould\smaintain\sa\sfunctioning\scluster\s\[Feature\:MasterUpgrade\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:91
Mar 10 14:23:02.592: Unexpected error:
    <*errors.errorString | 0xc002ff5640>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.4-beta.0.52+382306b5476db4]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.8-beta.0.55+33f0187aa847c7\\\"\\nname: \\\"bootstrap-e2e-minion-group-0vf0\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.8-beta.0.55+33f0187aa847c7\\\"\\nname: \\\"bootstrap-e2e-minion-group-d4pg\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.8-beta.0.55+33f0187aa847c7\\\"\\nname: \\\"bootstrap-e2e-minion-group-lqb6\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.8-beta.0.55+33f0187aa847c7\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.4-beta.0.52+382306b5476db4/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n.....................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Upgrading the CoreDNS ConfigMap ==\\nconfigmap/coredns configured\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE     VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   9m29s   v1.17.4-beta.0.52+382306b5476db4\\nbootstrap-e2e-minion-group-0vf0   Ready                      <none>   9m33s   v1.16.8-beta.0.55+33f0187aa847c7\\nbootstrap-e2e-minion-group-d4pg   Ready                      <none>   9m23s   v1.16.8-beta.0.55+33f0187aa847c7\\nbootstrap-e2e-minion-group-lqb6   Ready                      <none>   9m33s   v1.16.8-beta.0.55+33f0187aa847c7\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\nscheduler            Healthy   ok                  \\ncontroller-manager   Healthy   ok                  \\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.4-beta.0.52+382306b5476db4\\\"\\nname: \\\"bootstrap-e2e-minion-group-0vf0\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.8-beta.0.55+33f0187aa847c7\\\"\\nname: \\\"bootstrap-e2e-minion-group-d4pg\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.8-beta.0.55+33f0187aa847c7\\\"\\nname: \\\"bootstrap-e2e-minion-group-lqb6\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.8-beta.0.55+33f0187aa847c7\\\"\\n\", stderr \"Project: k8s-jkns-e2e-gci-gce-alpha\\nNetwork Project: k8s-jkns-e2e-gci-gce-alpha\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-0vf0 bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-lqb6\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 34.83.120.144; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP    STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   34.83.120.144  RUNNING\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: k8s-jkns-e2e-gci-gce-alpha\\nNetwork Project: k8s-jkns-e2e-gci-gce-alpha\\nZone: us-west1-b\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.4-beta.0.52+382306b5476db4]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.8-beta.0.55+33f0187aa847c7\"\nname: \"bootstrap-e2e-minion-group-0vf0\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.8-beta.0.55+33f0187aa847c7\"\nname: \"bootstrap-e2e-minion-group-d4pg\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.8-beta.0.55+33f0187aa847c7\"\nname: \"bootstrap-e2e-minion-group-lqb6\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.8-beta.0.55+33f0187aa847c7\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.4-beta.0.52+382306b5476db4/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n.....................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Upgrading the CoreDNS ConfigMap ==\nconfigmap/coredns configured\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE     VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   9m29s   v1.17.4-beta.0.52+382306b5476db4\nbootstrap-e2e-minion-group-0vf0   Ready                      <none>   9m33s   v1.16.8-beta.0.55+33f0187aa847c7\nbootstrap-e2e-minion-group-d4pg   Ready                      <none>   9m23s   v1.16.8-beta.0.55+33f0187aa847c7\nbootstrap-e2e-minion-group-lqb6   Ready                      <none>   9m33s   v1.16.8-beta.0.55+33f0187aa847c7\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\nscheduler            Healthy   ok                  \ncontroller-manager   Healthy   ok                  \netcd-1               Healthy   {\"health\":\"true\"}   \netcd-0               Healthy   {\"health\":\"true\"}   \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.4-beta.0.52+382306b5476db4\"\nname: \"bootstrap-e2e-minion-group-0vf0\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.8-beta.0.55+33f0187aa847c7\"\nname: \"bootstrap-e2e-minion-group-d4pg\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.8-beta.0.55+33f0187aa847c7\"\nname: \"bootstrap-e2e-minion-group-lqb6\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.8-beta.0.55+33f0187aa847c7\"\n", stderr "Project: k8s-jkns-e2e-gci-gce-alpha\nNetwork Project: k8s-jkns-e2e-gci-gce-alpha\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-0vf0 bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-lqb6\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 34.83.120.144; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gci-gce-alpha/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP    STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   34.83.120.144  RUNNING\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: k8s-jkns-e2e-gci-gce-alpha\nNetwork Project: k8s-jkns-e2e-gci-gce-alpha\nZone: us-west1-b\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:106
				
				Click to see stdout/stderrfrom junit_upgrade01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] [sig-node] NodeProblemDetector [DisabledForLargeClusters] should run without error 2m18s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sNodeProblemDetector\s\[DisabledForLargeClusters\]\sshould\srun\swithout\serror$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:58
Mar 11 00:36:18.313: Timed out after 60.007s.
Expected success, but got an error:
    <*errors.errorString | 0xc0040ed930>: {
        s: "Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-8kg3.15fb159cb1f0a399  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159cb1f0a399 fce0cec4-6db0-4dff-b8f5-78e6c5ae9974 22716 0 2020-03-10 23:37:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:36 +0000 UTC 2020-03-10 23:37:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159cb9b852c0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159cb9b852c0 1739098a-6366-44e6-a4ed-aadc926c3c22 22717 0 2020-03-10 23:37:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-8kg3 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:36 +0000 UTC 2020-03-10 23:37:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159cb9b896bd  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159cb9b896bd 043f6dd1-af60-41a0-b509-3fe4bec3b486 22718 0 2020-03-10 23:37:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-8kg3 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:36 +0000 UTC 2020-03-10 23:37:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159cb9b8d1bc  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159cb9b8d1bc 57f4ee21-b57a-431e-9b24-152cce82fdc4 22719 0 2020-03-10 23:37:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-8kg3 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:36 +0000 UTC 2020-03-10 23:37:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159cc0896eeb  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159cc0896eeb c3d314a7-42d8-42e0-a62c-2e581c4bc759 22720 0 2020-03-10 23:37:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:36 +0000 UTC 2020-03-10 23:37:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159cc220f090  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159cc220f090 22762817-b3f0-4291-8515-983e7c8eb0e1 22722 0 2020-03-10 23:37:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } NodeReady Node bootstrap-e2e-minion-group-8kg3 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:36 +0000 UTC 2020-03-10 23:37:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159d3156a6dc  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159d3156a6dc f5f3dd76-5a60-45f4-892d-7ce62d6f16cd 22730 0 2020-03-10 23:37:38 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } Starting Starting kube-proxy. {kube-proxy bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:38 +0000 UTC 2020-03-10 23:37:38 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159da67f9b45  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159da67f9b45 daa22f99-7dba-46d2-9ea4-d4b8ae10e3fd 22734 0 2020-03-10 23:37:40 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 52a6316b-9627-4301-99e8-c6459c85b714   } RegisteredNode Node bootstrap-e2e-minion-group-8kg3 event: Registered Node bootstrap-e2e-minion-group-8kg3 in Controller {node-controller } 2020-03-10 23:37:40 +0000 UTC 2020-03-10 23:37:40 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159da7bd7dda  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159da7bd7dda e9a5696e-4374-4bed-91f1-58a05620f1c6 22735 0 2020-03-10 23:37:40 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } ContainerdStart Starting containerd container runtime... {systemd-monitor bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:40 +0000 UTC 2020-03-10 23:37:40 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159dab2089fb  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159dab2089fb 7ea1044d-8a81-4757-bcc3-e6577c9d2c07 22738 0 2020-03-10 23:37:40 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } DockerStart Starting Docker Application Container Engine... {systemd-monitor bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:40 +0000 UTC 2020-03-10 23:37:40 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159dad09aa29  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159dad09aa29 032244e4-0020-4aaa-ae92-9d2d301d6589 22737 0 2020-03-10 23:37:40 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:40 +0000 UTC 2020-03-10 23:37:40 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb15adf3e0b44c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb15adf3e0b44c a4bc5d65-7195-4344-8901-75aaeb373aca 22761 0 2020-03-10 23:38:50 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 52a6316b-9627-4301-99e8-c6459c85b714   } NodeNotReady Node bootstrap-e2e-minion-group-8kg3 status is now: NodeNotReady {node-controller } 2020-03-10 23:38:50 +0000 UTC 2020-03-10 23:38:50 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb15bfad00d0b7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb15bfad00d0b7 6af2214c-5df9-468d-b5a0-d5c4fabedce2 22762 0 2020-03-10 23:40:06 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 52a6316b-9627-4301-99e8-c6459c85b714   } Deleting node bootstrap-e2e-minion-group-8kg3 because it does not exist in the cloud provider Node bootstrap-e2e-minion-group-8kg3 event: DeletingNode {cloud-node-lifecycle-controller } 2020-03-10 23:40:06 +0000 UTC 2020-03-10 23:40:06 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb15c098225bb9  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb15c098225bb9 dedede61-8e71-46c0-a472-a61318f1b784 22763 0 2020-03-10 23:40:10 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 52a6316b-9627-4301-99e8-c6459c85b714   } RemovingNode Node bootstrap-e2e-minion-group-8kg3 event: Removing Node bootstrap-e2e-minion-group-8kg3 from Controller {node-controller } 2020-03-10 23:40:10 +0000 UTC 2020-03-10 23:40:10 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15faf6d6fd549fce  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15faf6d6fd549fce a1f2262b-bc25-4011-a5a8-115b1fa7923c 24828 0 2020-03-10 18:51:10 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-d4pg} 2020-03-10 14:13:42 +0000 UTC 2020-03-11 00:23:34 +0000 UTC 23 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb07b8571f2610  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb07b8571f2610 3c87088d-ce5e-4fe8-b0ad-0951ad23ae7e 24827 0 2020-03-11 00:23:31 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg 74c784ec-1c5e-49ae-bfe3-450acef753de   } NodeNotReady Node bootstrap-e2e-minion-group-d4pg status is now: NodeNotReady {node-controller } 2020-03-10 19:23:02 +0000 UTC 2020-03-11 00:23:31 +0000 UTC 9 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb162c7cf42ceb  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb162c7cf42ceb 761bc64c-c06c-4fb9-8c70-3f33493c5105 23474 0 2020-03-10 23:47:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-10 23:47:54 +0000 UTC 2020-03-10 23:47:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb162c87d47396  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb162c87d47396 8c278e98-84a0-42fd-b5b5-36279cbbe2c6 23475 0 2020-03-10 23:47:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-d4pg status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-10 23:47:54 +0000 UTC 2020-03-10 23:47:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb162c87d54663  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb162c87d54663 2868588f-c7c7-49ed-8df2-bcef64814062 23476 0 2020-03-10 23:47:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-d4pg status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-10 23:47:54 +0000 UTC 2020-03-10 23:47:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb162c87d59d10  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb162c87d59d10 8f7b53c6-e41d-4ef0-897b-4f9d36845ef5 23477 0 2020-03-10 23:47:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-d4pg status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-10 23:47:54 +0000 UTC 2020-03-10 23:47:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb162c8999c740  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb162c8999c740 bbd96deb-8dc4-41d8-8513-5376b3b80f7e 23478 0 2020-03-10 23:47:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeNotReady Node bootstrap-e2e-minion-group-d4pg status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-10 23:47:54 +0000 UTC 2020-03-10 23:47:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb162ca091b581  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb162ca091b581 957f3288-51a2-4c0e-8c31-b1b2776843c7 23479 0 2020-03-10 23:47:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-10 23:47:54 +0000 UTC 2020-03-10 23:47:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb162ca39066f2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb162ca39066f2 b2736e4f-ce7c-453d-b0ef-da1dd9108c52 23480 0 2020-03-10 23:47:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeReady Node bootstrap-e2e-minion-group-d4pg status is now: NodeReady {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-10 23:47:54 +0000 UTC 2020-03-10 23:47:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb181ec2190ed7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb181ec2190ed7 3d2f09b5-1e89-4f2d-8811-43be4d503d6e 24829 0 2020-03-11 00:23:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-11 00:23:34 +0000 UTC 2020-03-11 00:23:34 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb181ecd89c185  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb181ecd89c185 67c4004d-051b-455a-8a32-a5624d32893d 24834 0 2020-03-11 00:23:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-d4pg status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-11 00:23:34 +0000 UTC 2020-03-11 00:23:34 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb181ecd8a64c5  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb181ecd8a64c5 d4cfae06-2d36-444d-bd49-399653ddd8ab 24833 0 2020-03-11 00:23:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-d4pg status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-11 00:23:34 +0000 UTC 2020-03-11 00:23:34 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb181ecd8aafd1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb181ecd8aafd1 2dd8bf0e-1440-451c-97f5-c84d0cb7f40f 24835 0 2020-03-11 00:23:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-d4pg status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-11 00:23:34 +0000 UTC 2020-03-11 00:23:34 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb181ed04d32a0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb181ed04d32a0 68d61755-f7f5-4bcd-8088-35c7af8b8623 24836 0 2020-03-11 00:23:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeNotReady Node bootstrap-e2e-minion-group-d4pg status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-11 00:23:34 +0000 UTC 2020-03-11 00:23:34 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb181ede58e75f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb181ede58e75f 77fbc545-127b-4368-8ec2-44336ae8d121 24837 0 2020-03-11 00:23:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-11 00:23:34 +0000 UTC 2020-03-11 00:23:34 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb181ee283c884  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb181ee283c884 9746c49a-7a1e-4565-afcf-bc5f58ff49ff 24838 0 2020-03-11 00:23:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeReady Node bootstrap-e2e-minion-group-d4pg status is now: NodeReady {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-11 00:23:34 +0000 UTC 2020-03-11 00:23:34 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb18c154649117  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb18c154649117 4e43950f-ee30-4d08-a610-c39795a5ae0a 25791 0 2020-03-11 00:35:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-d4pg} 2020-03-11 00:35:12 +0000 UTC 2020-03-11 00:35:12 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb18c15464bae6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb18c15464bae6 ef14ef4a-9b81-4f30-9fbb-b0f2d6825802 25790 0 2020-03-11 00:35:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-d4pg} 2020-03-11 00:35:12 +0000 UTC 2020-03-11 00:35:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-lqb6.15fb18c1f817bea6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-lqb6.15fb18c1f817bea6 74e61f3e-e214-48d5-8dfe-bedac339501a 25793 0 2020-03-11 00:35:15 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-lqb6 bootstrap-e2e-minion-group-lqb6   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-lqb6} 2020-03-11 00:35:15 +0000 UTC 2020-03-11 00:35:15 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-lqb6.15fb18c1f817dcad  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-lqb6.15fb18c1f817dcad 2feb9023-2a2b-49f3-8bec-37630a9c404f 25792 0 2020-03-11 00:35:15 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-lqb6 bootstrap-e2e-minion-group-lqb6   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-lqb6} 2020-03-11 00:35:15 +0000 UTC 2020-03-11 00:35:15 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb020f6af7512a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb020f6af7512a 29abcb35-c194-415a-990e-b037f918dd75 24794 0 2020-03-11 00:21:47 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-slgh} 2020-03-10 17:39:19 +0000 UTC 2020-03-11 00:21:47 +0000 UTC 6 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb1805d4e78cd9  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb1805d4e78cd9 5c721a51-d316-4135-87ff-ca9c4f3fa017 24795 0 2020-03-11 00:21:47 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-slgh} 2020-03-11 00:21:47 +0000 UTC 2020-03-11 00:21:47 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb1805de505887  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb1805de505887 f24726f4-2884-4a7a-9372-b3ef63c44edb 24796 0 2020-03-11 00:21:47 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-slgh status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-slgh} 2020-03-11 00:21:47 +0000 UTC 2020-03-11 00:21:47 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb1805de509343  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb1805de509343 17905eca-e1f8-4402-aaad-1ff85018ef83 24797 0 2020-03-11 00:21:47 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-slgh status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-slgh} 2020-03-11 00:21:47 +0000 UTC 2020-03-11 00:21:47 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb1805de50c049  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb1805de50c049 5a0edc68-2838-40f3-9eba-46a5e73316e4 24798 0 2020-03-11 00:21:47 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-slgh status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-slgh} 2020-03-11 00:21:47 +0000 UTC 2020-03-11 00:21:47 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb1805e20ecbb0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb1805e20ecbb0 7a989e19-31d9-411e-9c0d-c21897938b2a 24799 0 2020-03-11 00:21:47 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } NodeNotReady Node bootstrap-e2e-minion-group-slgh status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-slgh} 2020-03-11 00:21:47 +0000 UTC 2020-03-11 00:21:47 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb1806096f8ae8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb1806096f8ae8 7f56bbf7-b548-4f38-834b-2a2db3996ef3 24800 0 2020-03-11 00:21:48 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-slgh} 2020-03-11 00:21:48 +0000 UTC 2020-03-11 00:21:48 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb18060d4d4edd  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb18060d4d4edd fe96a8d0-59e3-4fca-8425-cb58b513f039 24801 0 2020-03-11 00:21:48 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } NodeReady Node bootstrap-e2e-minion-group-slgh status is now: NodeReady {kubelet bootstrap-e2e-minion-group-slgh} 2020-03-11 00:21:48 +0000 UTC 2020-03-11 00:21:48 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb18c29b636496  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb18c29b636496 0b407a4b-9322-4ed0-ac74-f7a714ef98d8 25795 0 2020-03-11 00:35:18 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-slgh} 2020-03-11 00:35:18 +0000 UTC 2020-03-11 00:35:18 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb18c29b6383b6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb18c29b6383b6 3e18c584-7889-4353-9a74-7eee50240a67 25794 0 2020-03-11 00:35:18 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-slgh} 2020-03-11 00:35:18 +0000 UTC 2020-03-11 00:35:18 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]",
    }
    Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-8kg3.15fb159cb1f0a399  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159cb1f0a399 fce0cec4-6db0-4dff-b8f5-78e6c5ae9974 22716 0 2020-03-10 23:37:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:36 +0000 UTC 2020-03-10 23:37:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159cb9b852c0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159cb9b852c0 1739098a-6366-44e6-a4ed-aadc926c3c22 22717 0 2020-03-10 23:37:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-8kg3 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:36 +0000 UTC 2020-03-10 23:37:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159cb9b896bd  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159cb9b896bd 043f6dd1-af60-41a0-b509-3fe4bec3b486 22718 0 2020-03-10 23:37:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-8kg3 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:36 +0000 UTC 2020-03-10 23:37:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159cb9b8d1bc  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159cb9b8d1bc 57f4ee21-b57a-431e-9b24-152cce82fdc4 22719 0 2020-03-10 23:37:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-8kg3 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:36 +0000 UTC 2020-03-10 23:37:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159cc0896eeb  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159cc0896eeb c3d314a7-42d8-42e0-a62c-2e581c4bc759 22720 0 2020-03-10 23:37:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:36 +0000 UTC 2020-03-10 23:37:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159cc220f090  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159cc220f090 22762817-b3f0-4291-8515-983e7c8eb0e1 22722 0 2020-03-10 23:37:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } NodeReady Node bootstrap-e2e-minion-group-8kg3 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:36 +0000 UTC 2020-03-10 23:37:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159d3156a6dc  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159d3156a6dc f5f3dd76-5a60-45f4-892d-7ce62d6f16cd 22730 0 2020-03-10 23:37:38 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } Starting Starting kube-proxy. {kube-proxy bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:38 +0000 UTC 2020-03-10 23:37:38 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159da67f9b45  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159da67f9b45 daa22f99-7dba-46d2-9ea4-d4b8ae10e3fd 22734 0 2020-03-10 23:37:40 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 52a6316b-9627-4301-99e8-c6459c85b714   } RegisteredNode Node bootstrap-e2e-minion-group-8kg3 event: Registered Node bootstrap-e2e-minion-group-8kg3 in Controller {node-controller } 2020-03-10 23:37:40 +0000 UTC 2020-03-10 23:37:40 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159da7bd7dda  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159da7bd7dda e9a5696e-4374-4bed-91f1-58a05620f1c6 22735 0 2020-03-10 23:37:40 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } ContainerdStart Starting containerd container runtime... {systemd-monitor bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:40 +0000 UTC 2020-03-10 23:37:40 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159dab2089fb  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159dab2089fb 7ea1044d-8a81-4757-bcc3-e6577c9d2c07 22738 0 2020-03-10 23:37:40 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } DockerStart Starting Docker Application Container Engine... {systemd-monitor bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:40 +0000 UTC 2020-03-10 23:37:40 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb159dad09aa29  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb159dad09aa29 032244e4-0020-4aaa-ae92-9d2d301d6589 22737 0 2020-03-10 23:37:40 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 bootstrap-e2e-minion-group-8kg3   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-8kg3} 2020-03-10 23:37:40 +0000 UTC 2020-03-10 23:37:40 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb15adf3e0b44c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb15adf3e0b44c a4bc5d65-7195-4344-8901-75aaeb373aca 22761 0 2020-03-10 23:38:50 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 52a6316b-9627-4301-99e8-c6459c85b714   } NodeNotReady Node bootstrap-e2e-minion-group-8kg3 status is now: NodeNotReady {node-controller } 2020-03-10 23:38:50 +0000 UTC 2020-03-10 23:38:50 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb15bfad00d0b7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb15bfad00d0b7 6af2214c-5df9-468d-b5a0-d5c4fabedce2 22762 0 2020-03-10 23:40:06 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 52a6316b-9627-4301-99e8-c6459c85b714   } Deleting node bootstrap-e2e-minion-group-8kg3 because it does not exist in the cloud provider Node bootstrap-e2e-minion-group-8kg3 event: DeletingNode {cloud-node-lifecycle-controller } 2020-03-10 23:40:06 +0000 UTC 2020-03-10 23:40:06 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kg3.15fb15c098225bb9  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kg3.15fb15c098225bb9 dedede61-8e71-46c0-a472-a61318f1b784 22763 0 2020-03-10 23:40:10 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kg3 52a6316b-9627-4301-99e8-c6459c85b714   } RemovingNode Node bootstrap-e2e-minion-group-8kg3 event: Removing Node bootstrap-e2e-minion-group-8kg3 from Controller {node-controller } 2020-03-10 23:40:10 +0000 UTC 2020-03-10 23:40:10 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15faf6d6fd549fce  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15faf6d6fd549fce a1f2262b-bc25-4011-a5a8-115b1fa7923c 24828 0 2020-03-10 18:51:10 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-d4pg} 2020-03-10 14:13:42 +0000 UTC 2020-03-11 00:23:34 +0000 UTC 23 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb07b8571f2610  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb07b8571f2610 3c87088d-ce5e-4fe8-b0ad-0951ad23ae7e 24827 0 2020-03-11 00:23:31 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg 74c784ec-1c5e-49ae-bfe3-450acef753de   } NodeNotReady Node bootstrap-e2e-minion-group-d4pg status is now: NodeNotReady {node-controller } 2020-03-10 19:23:02 +0000 UTC 2020-03-11 00:23:31 +0000 UTC 9 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb162c7cf42ceb  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb162c7cf42ceb 761bc64c-c06c-4fb9-8c70-3f33493c5105 23474 0 2020-03-10 23:47:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-10 23:47:54 +0000 UTC 2020-03-10 23:47:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb162c87d47396  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb162c87d47396 8c278e98-84a0-42fd-b5b5-36279cbbe2c6 23475 0 2020-03-10 23:47:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-d4pg status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-10 23:47:54 +0000 UTC 2020-03-10 23:47:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb162c87d54663  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb162c87d54663 2868588f-c7c7-49ed-8df2-bcef64814062 23476 0 2020-03-10 23:47:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-d4pg status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-10 23:47:54 +0000 UTC 2020-03-10 23:47:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb162c87d59d10  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb162c87d59d10 8f7b53c6-e41d-4ef0-897b-4f9d36845ef5 23477 0 2020-03-10 23:47:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-d4pg status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-10 23:47:54 +0000 UTC 2020-03-10 23:47:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb162c8999c740  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb162c8999c740 bbd96deb-8dc4-41d8-8513-5376b3b80f7e 23478 0 2020-03-10 23:47:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeNotReady Node bootstrap-e2e-minion-group-d4pg status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-10 23:47:54 +0000 UTC 2020-03-10 23:47:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb162ca091b581  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb162ca091b581 957f3288-51a2-4c0e-8c31-b1b2776843c7 23479 0 2020-03-10 23:47:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-10 23:47:54 +0000 UTC 2020-03-10 23:47:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb162ca39066f2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb162ca39066f2 b2736e4f-ce7c-453d-b0ef-da1dd9108c52 23480 0 2020-03-10 23:47:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeReady Node bootstrap-e2e-minion-group-d4pg status is now: NodeReady {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-10 23:47:54 +0000 UTC 2020-03-10 23:47:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb181ec2190ed7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb181ec2190ed7 3d2f09b5-1e89-4f2d-8811-43be4d503d6e 24829 0 2020-03-11 00:23:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-11 00:23:34 +0000 UTC 2020-03-11 00:23:34 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb181ecd89c185  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb181ecd89c185 67c4004d-051b-455a-8a32-a5624d32893d 24834 0 2020-03-11 00:23:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-d4pg status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-11 00:23:34 +0000 UTC 2020-03-11 00:23:34 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb181ecd8a64c5  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb181ecd8a64c5 d4cfae06-2d36-444d-bd49-399653ddd8ab 24833 0 2020-03-11 00:23:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-d4pg status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-11 00:23:34 +0000 UTC 2020-03-11 00:23:34 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb181ecd8aafd1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb181ecd8aafd1 2dd8bf0e-1440-451c-97f5-c84d0cb7f40f 24835 0 2020-03-11 00:23:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-d4pg status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-11 00:23:34 +0000 UTC 2020-03-11 00:23:34 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb181ed04d32a0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb181ed04d32a0 68d61755-f7f5-4bcd-8088-35c7af8b8623 24836 0 2020-03-11 00:23:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeNotReady Node bootstrap-e2e-minion-group-d4pg status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-11 00:23:34 +0000 UTC 2020-03-11 00:23:34 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb181ede58e75f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb181ede58e75f 77fbc545-127b-4368-8ec2-44336ae8d121 24837 0 2020-03-11 00:23:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-11 00:23:34 +0000 UTC 2020-03-11 00:23:34 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb181ee283c884  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb181ee283c884 9746c49a-7a1e-4565-afcf-bc5f58ff49ff 24838 0 2020-03-11 00:23:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } NodeReady Node bootstrap-e2e-minion-group-d4pg status is now: NodeReady {kubelet bootstrap-e2e-minion-group-d4pg} 2020-03-11 00:23:34 +0000 UTC 2020-03-11 00:23:34 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb18c154649117  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb18c154649117 4e43950f-ee30-4d08-a610-c39795a5ae0a 25791 0 2020-03-11 00:35:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-d4pg} 2020-03-11 00:35:12 +0000 UTC 2020-03-11 00:35:12 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-d4pg.15fb18c15464bae6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-d4pg.15fb18c15464bae6 ef14ef4a-9b81-4f30-9fbb-b0f2d6825802 25790 0 2020-03-11 00:35:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-d4pg bootstrap-e2e-minion-group-d4pg   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-d4pg} 2020-03-11 00:35:12 +0000 UTC 2020-03-11 00:35:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-lqb6.15fb18c1f817bea6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-lqb6.15fb18c1f817bea6 74e61f3e-e214-48d5-8dfe-bedac339501a 25793 0 2020-03-11 00:35:15 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-lqb6 bootstrap-e2e-minion-group-lqb6   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-lqb6} 2020-03-11 00:35:15 +0000 UTC 2020-03-11 00:35:15 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-lqb6.15fb18c1f817dcad  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-lqb6.15fb18c1f817dcad 2feb9023-2a2b-49f3-8bec-37630a9c404f 25792 0 2020-03-11 00:35:15 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-lqb6 bootstrap-e2e-minion-group-lqb6   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-lqb6} 2020-03-11 00:35:15 +0000 UTC 2020-03-11 00:35:15 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb020f6af7512a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb020f6af7512a 29abcb35-c194-415a-990e-b037f918dd75 24794 0 2020-03-11 00:21:47 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-slgh} 2020-03-10 17:39:19 +0000 UTC 2020-03-11 00:21:47 +0000 UTC 6 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb1805d4e78cd9  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb1805d4e78cd9 5c721a51-d316-4135-87ff-ca9c4f3fa017 24795 0 2020-03-11 00:21:47 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-slgh} 2020-03-11 00:21:47 +0000 UTC 2020-03-11 00:21:47 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb1805de505887  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb1805de505887 f24726f4-2884-4a7a-9372-b3ef63c44edb 24796 0 2020-03-11 00:21:47 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-slgh status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-slgh} 2020-03-11 00:21:47 +0000 UTC 2020-03-11 00:21:47 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb1805de509343  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb1805de509343 17905eca-e1f8-4402-aaad-1ff85018ef83 24797 0 2020-03-11 00:21:47 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-slgh status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-slgh} 2020-03-11 00:21:47 +0000 UTC 2020-03-11 00:21:47 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb1805de50c049  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb1805de50c049 5a0edc68-2838-40f3-9eba-46a5e73316e4 24798 0 2020-03-11 00:21:47 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-slgh status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-slgh} 2020-03-11 00:21:47 +0000 UTC 2020-03-11 00:21:47 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb1805e20ecbb0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb1805e20ecbb0 7a989e19-31d9-411e-9c0d-c21897938b2a 24799 0 2020-03-11 00:21:47 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } NodeNotReady Node bootstrap-e2e-minion-group-slgh status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-slgh} 2020-03-11 00:21:47 +0000 UTC 2020-03-11 00:21:47 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb1806096f8ae8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb1806096f8ae8 7f56bbf7-b548-4f38-834b-2a2db3996ef3 24800 0 2020-03-11 00:21:48 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-slgh} 2020-03-11 00:21:48 +0000 UTC 2020-03-11 00:21:48 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb18060d4d4edd  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb18060d4d4edd fe96a8d0-59e3-4fca-8425-cb58b513f039 24801 0 2020-03-11 00:21:48 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } NodeReady Node bootstrap-e2e-minion-group-slgh status is now: NodeReady {kubelet bootstrap-e2e-minion-group-slgh} 2020-03-11 00:21:48 +0000 UTC 2020-03-11 00:21:48 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb18c29b636496  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb18c29b636496 0b407a4b-9322-4ed0-ac74-f7a714ef98d8 25795 0 2020-03-11 00:35:18 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-slgh} 2020-03-11 00:35:18 +0000 UTC 2020-03-11 00:35:18 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-slgh.15fb18c29b6383b6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-slgh.15fb18c29b6383b6 3e18c584-7889-4353-9a74-7eee50240a67 25794 0 2020-03-11 00:35:18 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-slgh bootstrap-e2e-minion-group-slgh   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-slgh} 2020-03-11 00:35:18 +0000 UTC 2020-03-11 00:35:18 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:141
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [sig-apps] Daemon set [Serial] should update pod when spec was updated and update strategy is RollingUpdate [Conformance] 38m54s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sDaemon\sset\s\[Serial\]\sshould\supdate\spod\swhen\sspec\swas\supdated\sand\supdate\sstrategy\sis\sRollingUpdate\s\[Conformance\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:698
Mar 11 03:24:26.747: Unexpected error:
    <*errors.errorString | 0xc005d4c9b0>: {
        s: "number of unavailable pods: 2 is greater than maxUnavailable: 1",
    }
    number of unavailable pods: 2 is greater than maxUnavailable: 1
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/daemon_set.go:362