This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 7 failed / 926 succeeded
Started2020-03-31 21:55
Elapsed15h12m
Revision
Builder3beb2823-739a-11ea-901a-3a7046a79cdf
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/2d72ca2e-d8f1-476f-a835-cab7765bf891/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/2d72ca2e-d8f1-476f-a835-cab7765bf891/targets/test
infra-commitc614d8a89
job-versionv1.16.9-beta.0.17+bb616cba1cc983
master_os_imagecos-77-12371-175-0
node_os_imagecos-73-11647-163-0
revisionv1.16.9-beta.0.17+bb616cba1cc983

Test Failures


Kubernetes e2e suite [k8s.io] [sig-cloud-provider-gcp] Upgrade [Feature:Upgrade] master upgrade should maintain a functioning cluster [Feature:MasterUpgrade] 18m0s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-cloud\-provider\-gcp\]\sUpgrade\s\[Feature\:Upgrade\]\smaster\supgrade\sshould\smaintain\sa\sfunctioning\scluster\s\[Feature\:MasterUpgrade\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:91
Mar 31 22:13:34.881: Unexpected error:
    <*errors.errorString | 0xc000e698f0>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.22+ea3eeb494a528e]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-j9jm\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-m1r0\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-sghl\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.22+ea3eeb494a528e/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n.......................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Upgrading the CoreDNS ConfigMap ==\\nconfigmap/coredns configured\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE   VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   10m   v1.17.5-beta.0.22+ea3eeb494a528e\\nbootstrap-e2e-minion-group-j9jm   Ready                      <none>   10m   v1.16.9-beta.0.17+bb616cba1cc983\\nbootstrap-e2e-minion-group-m1r0   Ready                      <none>   10m   v1.16.9-beta.0.17+bb616cba1cc983\\nbootstrap-e2e-minion-group-sghl   Ready                      <none>   10m   v1.16.9-beta.0.17+bb616cba1cc983\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\ncontroller-manager   Healthy   ok                  \\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\nscheduler            Healthy   ok                  \\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.5-beta.0.22+ea3eeb494a528e\\\"\\nname: \\\"bootstrap-e2e-minion-group-j9jm\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-m1r0\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-sghl\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\n\", stderr \"Project: k8s-jkns-e2e-gce-gci-slow\\nNetwork Project: k8s-jkns-e2e-gce-gci-slow\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-j9jm bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-sghl\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 35.247.104.98; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-slow/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-slow/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP    STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.247.104.98  RUNNING\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: k8s-jkns-e2e-gce-gci-slow\\nNetwork Project: k8s-jkns-e2e-gce-gci-slow\\nZone: us-west1-b\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.22+ea3eeb494a528e]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-j9jm\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-m1r0\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-sghl\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.22+ea3eeb494a528e/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n.......................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Upgrading the CoreDNS ConfigMap ==\nconfigmap/coredns configured\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE   VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   10m   v1.17.5-beta.0.22+ea3eeb494a528e\nbootstrap-e2e-minion-group-j9jm   Ready                      <none>   10m   v1.16.9-beta.0.17+bb616cba1cc983\nbootstrap-e2e-minion-group-m1r0   Ready                      <none>   10m   v1.16.9-beta.0.17+bb616cba1cc983\nbootstrap-e2e-minion-group-sghl   Ready                      <none>   10m   v1.16.9-beta.0.17+bb616cba1cc983\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\ncontroller-manager   Healthy   ok                  \netcd-1               Healthy   {\"health\":\"true\"}   \nscheduler            Healthy   ok                  \netcd-0               Healthy   {\"health\":\"true\"}   \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.5-beta.0.22+ea3eeb494a528e\"\nname: \"bootstrap-e2e-minion-group-j9jm\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-m1r0\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-sghl\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\n", stderr "Project: k8s-jkns-e2e-gce-gci-slow\nNetwork Project: k8s-jkns-e2e-gce-gci-slow\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-j9jm bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-sghl\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 35.247.104.98; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-slow/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci-slow/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP    STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.247.104.98  RUNNING\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: k8s-jkns-e2e-gce-gci-slow\nNetwork Project: k8s-jkns-e2e-gce-gci-slow\nZone: us-west1-b\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:106
				
				Click to see stdout/stderrfrom junit_upgrade01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] [sig-node] NodeProblemDetector [DisabledForLargeClusters] should run without error 2m17s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sNodeProblemDetector\s\[DisabledForLargeClusters\]\sshould\srun\swithout\serror$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:58
Apr  1 09:14:38.082: Timed out after 60.001s.
Expected success, but got an error:
    <*errors.errorString | 0xc008da9d70>: {
        s: "Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-5mff.1601a6a67b7dd6e4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a67b7dd6e4 6b8675b0-76ae-43c1-97c5-e79eda6c93b3 25035 0 2020-04-01 09:02:57 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:02:57 +0000 UTC 2020-04-01 09:02:57 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a683bcd168  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a683bcd168 e0e0804a-a7f2-4d59-9a95-12e92fab8edd 25036 0 2020-04-01 09:02:57 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-5mff status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:02:57 +0000 UTC 2020-04-01 09:02:57 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a683bd2027  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a683bd2027 2bfa15a2-6444-4adc-840e-8fcf667f31ec 25037 0 2020-04-01 09:02:57 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-5mff status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:02:57 +0000 UTC 2020-04-01 09:02:57 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a683bd5b51  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a683bd5b51 a99138ce-e23e-42aa-b6ca-e8a0c1d1fb8e 25038 0 2020-04-01 09:02:57 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-5mff status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:02:57 +0000 UTC 2020-04-01 09:02:57 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a68799b6e1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a68799b6e1 a8ec75b0-4881-4350-ad82-893f7f9a49ff 25039 0 2020-04-01 09:02:57 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:02:57 +0000 UTC 2020-04-01 09:02:57 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a68b106da8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a68b106da8 b2a8a674-8352-49fb-b0cd-8a941cbf3162 25042 0 2020-04-01 09:02:58 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeReady Node bootstrap-e2e-minion-group-5mff status is now: NodeReady {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:02:58 +0000 UTC 2020-04-01 09:02:58 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a6a2650e9f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a6a2650e9f 3744d7a5-421a-4789-a898-07c600d26082 25045 0 2020-04-01 09:02:58 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff 5a388080-9a9e-4bc9-b399-cdf941578762   } RegisteredNode Node bootstrap-e2e-minion-group-5mff event: Registered Node bootstrap-e2e-minion-group-5mff in Controller {node-controller } 2020-04-01 09:02:58 +0000 UTC 2020-04-01 09:02:58 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a6fc4ca956  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a6fc4ca956 054c06ec-ff10-490c-a7c3-73487a893cd1 25050 0 2020-04-01 09:02:59 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } Starting Starting kube-proxy. {kube-proxy bootstrap-e2e-minion-group-5mff} 2020-04-01 09:02:59 +0000 UTC 2020-04-01 09:02:59 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a785e90814  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a785e90814 d84ab960-da7a-4a8d-9559-24dd087167e5 25054 0 2020-04-01 09:03:02 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } ContainerdStart Starting containerd container runtime... {systemd-monitor bootstrap-e2e-minion-group-5mff} 2020-04-01 09:03:02 +0000 UTC 2020-04-01 09:03:02 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a785e97a73  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a785e97a73 acd1db4e-46b5-4a05-844c-b36d02d3e259 25056 0 2020-04-01 09:03:02 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } DockerStart Starting Docker Application Container Engine... {systemd-monitor bootstrap-e2e-minion-group-5mff} 2020-04-01 09:03:02 +0000 UTC 2020-04-01 09:03:02 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a7860cd7e1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a7860cd7e1 a70d1b29-e6e3-4123-b217-7f6ceb9f55aa 25339 0 2020-04-01 09:03:02 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-5mff} 2020-04-01 09:03:02 +0000 UTC 2020-04-01 09:11:11 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a718e3a07192  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a718e3a07192 8d6d83c5-b4c9-4dd1-b556-c8f34bb95f19 25338 0 2020-04-01 09:11:09 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff 5a388080-9a9e-4bc9-b399-cdf941578762   } NodeNotReady Node bootstrap-e2e-minion-group-5mff status is now: NodeNotReady {node-controller } 2020-04-01 09:11:09 +0000 UTC 2020-04-01 09:11:09 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a7197d38bf30  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a7197d38bf30 ab4e1bdb-904b-42b5-b21d-0298650171a2 25340 0 2020-04-01 09:11:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:11:11 +0000 UTC 2020-04-01 09:11:11 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a719876c8514  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a719876c8514 3adf9f1d-31d0-42e4-8078-01dac23ef13f 25344 0 2020-04-01 09:11:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-5mff status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:11:11 +0000 UTC 2020-04-01 09:11:11 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a719876cbdbb  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a719876cbdbb 576dbe42-b866-47f1-8beb-2f798499d60e 25345 0 2020-04-01 09:11:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-5mff status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:11:11 +0000 UTC 2020-04-01 09:11:11 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a719876ce79a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a719876ce79a 02144907-baa4-4b5a-b88c-fd1a903a1ba4 25346 0 2020-04-01 09:11:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-5mff status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:11:11 +0000 UTC 2020-04-01 09:11:11 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a7198a583eb6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a7198a583eb6 ab7c5c4c-3731-4f8e-8262-835495a24af8 25347 0 2020-04-01 09:11:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeNotReady Node bootstrap-e2e-minion-group-5mff status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:11:11 +0000 UTC 2020-04-01 09:11:11 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a719998d2af7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a719998d2af7 43e2c396-8aa3-43d8-899d-84d75fa1705b 25348 0 2020-04-01 09:11:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:11:12 +0000 UTC 2020-04-01 09:11:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a7199ff89f88  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a7199ff89f88 56b1e7b6-301e-429f-abf3-df5f1b4fed94 25349 0 2020-04-01 09:11:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeReady Node bootstrap-e2e-minion-group-5mff status is now: NodeReady {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:11:12 +0000 UTC 2020-04-01 09:11:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a73a1725342e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a73a1725342e 67d69f41-61e7-4f83-acaf-e1ed0cb343d8 25378 0 2020-04-01 09:13:31 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-5mff} 2020-04-01 09:13:31 +0000 UTC 2020-04-01 09:13:31 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a73a172551f2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a73a172551f2 50f0423e-894e-4f76-8754-9f4f8f7f20e3 25377 0 2020-04-01 09:13:31 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-5mff} 2020-04-01 09:13:31 +0000 UTC 2020-04-01 09:13:31 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.160195db7ac865fa  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.160195db7ac865fa 04a563bc-b0ad-45d2-8814-f3ecacc327ee 24163 0 2020-04-01 07:31:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl bootstrap-e2e-minion-group-5ngl   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-5ngl} 2020-04-01 03:55:13 +0000 UTC 2020-04-01 08:35:45 +0000 UTC 7 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601993ce42f6fb7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601993ce42f6fb7 4cd8a475-d78d-4594-a738-04380a27103c 25031 0 2020-04-01 09:00:58 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl 9b36ad5c-eecd-4f51-82aa-c085be45e853   } NodeNotReady Node bootstrap-e2e-minion-group-5ngl status is now: NodeNotReady {node-controller } 2020-04-01 04:57:10 +0000 UTC 2020-04-01 09:00:58 +0000 UTC 4 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601a52a6715e1c6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601a52a6715e1c6 598da4b9-b503-4cef-9480-d700d5e56462 24164 0 2020-04-01 08:35:45 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl bootstrap-e2e-minion-group-5ngl   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-5ngl} 2020-04-01 08:35:45 +0000 UTC 2020-04-01 08:35:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601a52a71299099  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601a52a71299099 8bbedfd5-9a8d-4bc7-8de6-806c744b8ff8 24165 0 2020-04-01 08:35:45 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl bootstrap-e2e-minion-group-5ngl   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-5ngl status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-5ngl} 2020-04-01 08:35:45 +0000 UTC 2020-04-01 08:35:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601a52a7129c74c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601a52a7129c74c 4fa56e42-e260-479d-ae7b-82c2a94c4791 24166 0 2020-04-01 08:35:45 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl bootstrap-e2e-minion-group-5ngl   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-5ngl status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-5ngl} 2020-04-01 08:35:45 +0000 UTC 2020-04-01 08:35:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601a52a7129f578  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601a52a7129f578 1a5e228e-1b36-4a6b-8e44-ece68bb087e9 24167 0 2020-04-01 08:35:45 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl bootstrap-e2e-minion-group-5ngl   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-5ngl status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-5ngl} 2020-04-01 08:35:45 +0000 UTC 2020-04-01 08:35:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601a52a7504daa2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601a52a7504daa2 3ba18b74-ace4-47b1-a04d-04f0878eac62 24168 0 2020-04-01 08:35:45 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl bootstrap-e2e-minion-group-5ngl   } NodeNotReady Node bootstrap-e2e-minion-group-5ngl status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-5ngl} 2020-04-01 08:35:45 +0000 UTC 2020-04-01 08:35:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601a52a88abdf2d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601a52a88abdf2d 85c173b2-f235-4494-8a8f-8ed908d68c29 24169 0 2020-04-01 08:35:45 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl bootstrap-e2e-minion-group-5ngl   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-5ngl} 2020-04-01 08:35:45 +0000 UTC 2020-04-01 08:35:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601a52a8a6f6551  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601a52a8a6f6551 902522dd-a2bb-4798-8821-92832847a58f 24170 0 2020-04-01 08:35:45 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl bootstrap-e2e-minion-group-5ngl   } NodeReady Node bootstrap-e2e-minion-group-5ngl status is now: NodeReady {kubelet bootstrap-e2e-minion-group-5ngl} 2020-04-01 08:35:45 +0000 UTC 2020-04-01 08:35:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601a6960e04a952  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601a6960e04a952 a96f2f33-20ed-4140-90c0-ee0a8cc6f5d4 25032 0 2020-04-01 09:01:47 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl 9b36ad5c-eecd-4f51-82aa-c085be45e853   } Deleting node bootstrap-e2e-minion-group-5ngl because it does not exist in the cloud provider Node bootstrap-e2e-minion-group-5ngl event: DeletingNode {cloud-node-lifecycle-controller } 2020-04-01 09:01:47 +0000 UTC 2020-04-01 09:01:47 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601a69655be01dc  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601a69655be01dc 423a5fef-8717-4bba-a737-0afcfd2efc95 25033 0 2020-04-01 09:01:48 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl 9b36ad5c-eecd-4f51-82aa-c085be45e853   } RemovingNode Node bootstrap-e2e-minion-group-5ngl event: Removing Node bootstrap-e2e-minion-group-5ngl from Controller {node-controller } 2020-04-01 09:01:48 +0000 UTC 2020-04-01 09:01:48 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.160182a6ca3b77a4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.160182a6ca3b77a4 83a51b63-6d4a-45a9-aed6-e5cd1d642b42 25152 0 2020-04-01 07:54:42 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-m1r0} 2020-03-31 22:03:16 +0000 UTC 2020-04-01 09:07:11 +0000 UTC 12 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.160184c1a245c015  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.160184c1a245c015 77c377a7-1540-459c-9eaa-da43527e5d6a 25151 0 2020-04-01 08:37:47 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 6c6fd381-d0b7-4e96-9d7d-5a71ff45850b   } NodeNotReady Node bootstrap-e2e-minion-group-m1r0 status is now: NodeNotReady {node-controller } 2020-03-31 22:41:50 +0000 UTC 2020-04-01 09:07:08 +0000 UTC 6 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a5479619abf8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a5479619abf8 47e9d1fc-898f-4a7c-86a3-c361a3faab60 24205 0 2020-04-01 08:37:50 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 08:37:50 +0000 UTC 2020-04-01 08:37:50 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a547a0607337  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a547a0607337 30c269bf-6f5e-4fb9-84ee-c31fc6a78999 24209 0 2020-04-01 08:37:50 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-m1r0 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 08:37:50 +0000 UTC 2020-04-01 08:37:50 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a547a060c662  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a547a060c662 f1891a37-2ef1-4da3-b3e1-d9baed4140f3 24210 0 2020-04-01 08:37:50 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-m1r0 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 08:37:50 +0000 UTC 2020-04-01 08:37:50 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a547a061001f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a547a061001f 88d0b67b-7d68-4634-8463-af6d41f73e5c 24211 0 2020-04-01 08:37:50 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-m1r0 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 08:37:50 +0000 UTC 2020-04-01 08:37:50 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a547a2ed24fb  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a547a2ed24fb eec3fbe0-009d-423a-bd03-384537e5af26 24212 0 2020-04-01 08:37:50 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeNotReady Node bootstrap-e2e-minion-group-m1r0 status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 08:37:50 +0000 UTC 2020-04-01 08:37:50 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a547bd0a5170  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a547bd0a5170 8bc42474-07a4-418a-a06c-fe19c6f719c5 24213 0 2020-04-01 08:37:51 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 08:37:51 +0000 UTC 2020-04-01 08:37:51 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a547bfa3853a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a547bfa3853a e0f57e5c-507e-4e7a-b4a5-a6a9d95cb613 24214 0 2020-04-01 08:37:51 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeReady Node bootstrap-e2e-minion-group-m1r0 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 08:37:51 +0000 UTC 2020-04-01 08:37:51 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6bb02adc312  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6bb02adc312 3114bae0-30b9-4151-948b-f99ff0f161fe 25081 0 2020-04-01 09:04:25 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:04:25 +0000 UTC 2020-04-01 09:04:25 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6bb0b3e553a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6bb0b3e553a 2638f89b-8e88-4213-946e-e0ff6d0c7dd0 25086 0 2020-04-01 09:04:26 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-m1r0 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:04:26 +0000 UTC 2020-04-01 09:04:26 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6bb0b3e9051  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6bb0b3e9051 e8804eeb-8a2a-4ace-85d0-1bd85c0c83ac 25087 0 2020-04-01 09:04:26 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-m1r0 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:04:26 +0000 UTC 2020-04-01 09:04:26 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6bb0b3ec424  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6bb0b3ec424 6b801061-ee4c-45b6-b005-cb7aa9ad9fc5 25088 0 2020-04-01 09:04:26 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-m1r0 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:04:26 +0000 UTC 2020-04-01 09:04:26 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6bb0f6ab601  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6bb0f6ab601 9fc5f417-fcd7-4e35-b680-7241a491f113 25085 0 2020-04-01 09:04:26 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeNotReady Node bootstrap-e2e-minion-group-m1r0 status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:04:26 +0000 UTC 2020-04-01 09:04:26 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6bb369bca66  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6bb369bca66 aea3a1e6-5e72-4b49-9f63-014b84e7297f 25089 0 2020-04-01 09:04:26 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:04:26 +0000 UTC 2020-04-01 09:04:26 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6bb3b4078bc  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6bb3b4078bc bd087980-f78f-44d9-a5cc-22bf34b9a5da 25090 0 2020-04-01 09:04:26 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeReady Node bootstrap-e2e-minion-group-m1r0 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:04:26 +0000 UTC 2020-04-01 09:04:26 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6e18497feb8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6e18497feb8 2c941223-6fba-44bc-8d33-7d26acd4b9df 25153 0 2020-04-01 09:07:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:07:11 +0000 UTC 2020-04-01 09:07:11 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6e18d14f047  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6e18d14f047 3b98aa46-be17-4f7c-8d8f-9ad60a331a59 25157 0 2020-04-01 09:07:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-m1r0 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:07:11 +0000 UTC 2020-04-01 09:07:11 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6e18d152b58  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6e18d152b58 7fac6fbe-7f11-40f6-adfe-188a60eee6ee 25158 0 2020-04-01 09:07:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-m1r0 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:07:11 +0000 UTC 2020-04-01 09:07:11 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6e18d155d92  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6e18d155d92 2751debd-4dc9-4c51-b695-483d4a52a8c2 25159 0 2020-04-01 09:07:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-m1r0 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:07:11 +0000 UTC 2020-04-01 09:07:11 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6e1902579ec  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6e1902579ec 3767cb0d-6248-4e67-8ade-aa671babb588 25160 0 2020-04-01 09:07:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeNotReady Node bootstrap-e2e-minion-group-m1r0 status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:07:11 +0000 UTC 2020-04-01 09:07:11 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6e1ac9101ea  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6e1ac9101ea 4fd4fc41-859d-4489-aebf-e454bed62fc7 25161 0 2020-04-01 09:07:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:07:12 +0000 UTC 2020-04-01 09:07:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6e1afe01ad7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6e1afe01ad7 1ba88c9d-179b-4268-ab63-4d55284c363b 25162 0 2020-04-01 09:07:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeReady Node bootstrap-e2e-minion-group-m1r0 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:07:12 +0000 UTC 2020-04-01 09:07:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a73aa752445f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a73aa752445f 06f61486-ad67-4bf7-be11-9d22a2faa848 25380 0 2020-04-01 09:13:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:13:34 +0000 UTC 2020-04-01 09:13:34 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a73aa752636c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a73aa752636c e0c46122-08ba-4043-af07-a89c19ac86b3 25379 0 2020-04-01 09:13:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:13:34 +0000 UTC 2020-04-01 09:13:34 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-sghl.1601a73b3e15df5b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-sghl.1601a73b3e15df5b 0d61fcb5-4346-4f80-aaad-19a89ef76d3a 25382 0 2020-04-01 09:13:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-sghl bootstrap-e2e-minion-group-sghl   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-sghl} 2020-04-01 09:13:36 +0000 UTC 2020-04-01 09:13:36 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-sghl.1601a73b3e160433  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-sghl.1601a73b3e160433 e5892a90-7fa6-44a7-ac0c-df965e4182d9 25381 0 2020-04-01 09:13:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-sghl bootstrap-e2e-minion-group-sghl   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-sghl} 2020-04-01 09:13:36 +0000 UTC 2020-04-01 09:13:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]",
    }
    Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-5mff.1601a6a67b7dd6e4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a67b7dd6e4 6b8675b0-76ae-43c1-97c5-e79eda6c93b3 25035 0 2020-04-01 09:02:57 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:02:57 +0000 UTC 2020-04-01 09:02:57 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a683bcd168  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a683bcd168 e0e0804a-a7f2-4d59-9a95-12e92fab8edd 25036 0 2020-04-01 09:02:57 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-5mff status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:02:57 +0000 UTC 2020-04-01 09:02:57 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a683bd2027  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a683bd2027 2bfa15a2-6444-4adc-840e-8fcf667f31ec 25037 0 2020-04-01 09:02:57 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-5mff status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:02:57 +0000 UTC 2020-04-01 09:02:57 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a683bd5b51  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a683bd5b51 a99138ce-e23e-42aa-b6ca-e8a0c1d1fb8e 25038 0 2020-04-01 09:02:57 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-5mff status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:02:57 +0000 UTC 2020-04-01 09:02:57 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a68799b6e1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a68799b6e1 a8ec75b0-4881-4350-ad82-893f7f9a49ff 25039 0 2020-04-01 09:02:57 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:02:57 +0000 UTC 2020-04-01 09:02:57 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a68b106da8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a68b106da8 b2a8a674-8352-49fb-b0cd-8a941cbf3162 25042 0 2020-04-01 09:02:58 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeReady Node bootstrap-e2e-minion-group-5mff status is now: NodeReady {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:02:58 +0000 UTC 2020-04-01 09:02:58 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a6a2650e9f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a6a2650e9f 3744d7a5-421a-4789-a898-07c600d26082 25045 0 2020-04-01 09:02:58 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff 5a388080-9a9e-4bc9-b399-cdf941578762   } RegisteredNode Node bootstrap-e2e-minion-group-5mff event: Registered Node bootstrap-e2e-minion-group-5mff in Controller {node-controller } 2020-04-01 09:02:58 +0000 UTC 2020-04-01 09:02:58 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a6fc4ca956  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a6fc4ca956 054c06ec-ff10-490c-a7c3-73487a893cd1 25050 0 2020-04-01 09:02:59 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } Starting Starting kube-proxy. {kube-proxy bootstrap-e2e-minion-group-5mff} 2020-04-01 09:02:59 +0000 UTC 2020-04-01 09:02:59 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a785e90814  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a785e90814 d84ab960-da7a-4a8d-9559-24dd087167e5 25054 0 2020-04-01 09:03:02 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } ContainerdStart Starting containerd container runtime... {systemd-monitor bootstrap-e2e-minion-group-5mff} 2020-04-01 09:03:02 +0000 UTC 2020-04-01 09:03:02 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a785e97a73  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a785e97a73 acd1db4e-46b5-4a05-844c-b36d02d3e259 25056 0 2020-04-01 09:03:02 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } DockerStart Starting Docker Application Container Engine... {systemd-monitor bootstrap-e2e-minion-group-5mff} 2020-04-01 09:03:02 +0000 UTC 2020-04-01 09:03:02 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a6a7860cd7e1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a6a7860cd7e1 a70d1b29-e6e3-4123-b217-7f6ceb9f55aa 25339 0 2020-04-01 09:03:02 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-5mff} 2020-04-01 09:03:02 +0000 UTC 2020-04-01 09:11:11 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a718e3a07192  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a718e3a07192 8d6d83c5-b4c9-4dd1-b556-c8f34bb95f19 25338 0 2020-04-01 09:11:09 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff 5a388080-9a9e-4bc9-b399-cdf941578762   } NodeNotReady Node bootstrap-e2e-minion-group-5mff status is now: NodeNotReady {node-controller } 2020-04-01 09:11:09 +0000 UTC 2020-04-01 09:11:09 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a7197d38bf30  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a7197d38bf30 ab4e1bdb-904b-42b5-b21d-0298650171a2 25340 0 2020-04-01 09:11:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:11:11 +0000 UTC 2020-04-01 09:11:11 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a719876c8514  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a719876c8514 3adf9f1d-31d0-42e4-8078-01dac23ef13f 25344 0 2020-04-01 09:11:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-5mff status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:11:11 +0000 UTC 2020-04-01 09:11:11 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a719876cbdbb  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a719876cbdbb 576dbe42-b866-47f1-8beb-2f798499d60e 25345 0 2020-04-01 09:11:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-5mff status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:11:11 +0000 UTC 2020-04-01 09:11:11 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a719876ce79a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a719876ce79a 02144907-baa4-4b5a-b88c-fd1a903a1ba4 25346 0 2020-04-01 09:11:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-5mff status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:11:11 +0000 UTC 2020-04-01 09:11:11 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a7198a583eb6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a7198a583eb6 ab7c5c4c-3731-4f8e-8262-835495a24af8 25347 0 2020-04-01 09:11:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeNotReady Node bootstrap-e2e-minion-group-5mff status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:11:11 +0000 UTC 2020-04-01 09:11:11 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a719998d2af7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a719998d2af7 43e2c396-8aa3-43d8-899d-84d75fa1705b 25348 0 2020-04-01 09:11:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:11:12 +0000 UTC 2020-04-01 09:11:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a7199ff89f88  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a7199ff89f88 56b1e7b6-301e-429f-abf3-df5f1b4fed94 25349 0 2020-04-01 09:11:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } NodeReady Node bootstrap-e2e-minion-group-5mff status is now: NodeReady {kubelet bootstrap-e2e-minion-group-5mff} 2020-04-01 09:11:12 +0000 UTC 2020-04-01 09:11:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a73a1725342e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a73a1725342e 67d69f41-61e7-4f83-acaf-e1ed0cb343d8 25378 0 2020-04-01 09:13:31 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-5mff} 2020-04-01 09:13:31 +0000 UTC 2020-04-01 09:13:31 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5mff.1601a73a172551f2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5mff.1601a73a172551f2 50f0423e-894e-4f76-8754-9f4f8f7f20e3 25377 0 2020-04-01 09:13:31 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5mff bootstrap-e2e-minion-group-5mff   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-5mff} 2020-04-01 09:13:31 +0000 UTC 2020-04-01 09:13:31 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.160195db7ac865fa  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.160195db7ac865fa 04a563bc-b0ad-45d2-8814-f3ecacc327ee 24163 0 2020-04-01 07:31:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl bootstrap-e2e-minion-group-5ngl   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-5ngl} 2020-04-01 03:55:13 +0000 UTC 2020-04-01 08:35:45 +0000 UTC 7 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601993ce42f6fb7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601993ce42f6fb7 4cd8a475-d78d-4594-a738-04380a27103c 25031 0 2020-04-01 09:00:58 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl 9b36ad5c-eecd-4f51-82aa-c085be45e853   } NodeNotReady Node bootstrap-e2e-minion-group-5ngl status is now: NodeNotReady {node-controller } 2020-04-01 04:57:10 +0000 UTC 2020-04-01 09:00:58 +0000 UTC 4 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601a52a6715e1c6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601a52a6715e1c6 598da4b9-b503-4cef-9480-d700d5e56462 24164 0 2020-04-01 08:35:45 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl bootstrap-e2e-minion-group-5ngl   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-5ngl} 2020-04-01 08:35:45 +0000 UTC 2020-04-01 08:35:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601a52a71299099  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601a52a71299099 8bbedfd5-9a8d-4bc7-8de6-806c744b8ff8 24165 0 2020-04-01 08:35:45 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl bootstrap-e2e-minion-group-5ngl   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-5ngl status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-5ngl} 2020-04-01 08:35:45 +0000 UTC 2020-04-01 08:35:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601a52a7129c74c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601a52a7129c74c 4fa56e42-e260-479d-ae7b-82c2a94c4791 24166 0 2020-04-01 08:35:45 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl bootstrap-e2e-minion-group-5ngl   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-5ngl status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-5ngl} 2020-04-01 08:35:45 +0000 UTC 2020-04-01 08:35:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601a52a7129f578  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601a52a7129f578 1a5e228e-1b36-4a6b-8e44-ece68bb087e9 24167 0 2020-04-01 08:35:45 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl bootstrap-e2e-minion-group-5ngl   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-5ngl status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-5ngl} 2020-04-01 08:35:45 +0000 UTC 2020-04-01 08:35:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601a52a7504daa2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601a52a7504daa2 3ba18b74-ace4-47b1-a04d-04f0878eac62 24168 0 2020-04-01 08:35:45 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl bootstrap-e2e-minion-group-5ngl   } NodeNotReady Node bootstrap-e2e-minion-group-5ngl status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-5ngl} 2020-04-01 08:35:45 +0000 UTC 2020-04-01 08:35:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601a52a88abdf2d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601a52a88abdf2d 85c173b2-f235-4494-8a8f-8ed908d68c29 24169 0 2020-04-01 08:35:45 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl bootstrap-e2e-minion-group-5ngl   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-5ngl} 2020-04-01 08:35:45 +0000 UTC 2020-04-01 08:35:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601a52a8a6f6551  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601a52a8a6f6551 902522dd-a2bb-4798-8821-92832847a58f 24170 0 2020-04-01 08:35:45 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl bootstrap-e2e-minion-group-5ngl   } NodeReady Node bootstrap-e2e-minion-group-5ngl status is now: NodeReady {kubelet bootstrap-e2e-minion-group-5ngl} 2020-04-01 08:35:45 +0000 UTC 2020-04-01 08:35:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601a6960e04a952  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601a6960e04a952 a96f2f33-20ed-4140-90c0-ee0a8cc6f5d4 25032 0 2020-04-01 09:01:47 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl 9b36ad5c-eecd-4f51-82aa-c085be45e853   } Deleting node bootstrap-e2e-minion-group-5ngl because it does not exist in the cloud provider Node bootstrap-e2e-minion-group-5ngl event: DeletingNode {cloud-node-lifecycle-controller } 2020-04-01 09:01:47 +0000 UTC 2020-04-01 09:01:47 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-5ngl.1601a69655be01dc  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-5ngl.1601a69655be01dc 423a5fef-8717-4bba-a737-0afcfd2efc95 25033 0 2020-04-01 09:01:48 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-5ngl 9b36ad5c-eecd-4f51-82aa-c085be45e853   } RemovingNode Node bootstrap-e2e-minion-group-5ngl event: Removing Node bootstrap-e2e-minion-group-5ngl from Controller {node-controller } 2020-04-01 09:01:48 +0000 UTC 2020-04-01 09:01:48 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.160182a6ca3b77a4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.160182a6ca3b77a4 83a51b63-6d4a-45a9-aed6-e5cd1d642b42 25152 0 2020-04-01 07:54:42 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-m1r0} 2020-03-31 22:03:16 +0000 UTC 2020-04-01 09:07:11 +0000 UTC 12 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.160184c1a245c015  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.160184c1a245c015 77c377a7-1540-459c-9eaa-da43527e5d6a 25151 0 2020-04-01 08:37:47 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 6c6fd381-d0b7-4e96-9d7d-5a71ff45850b   } NodeNotReady Node bootstrap-e2e-minion-group-m1r0 status is now: NodeNotReady {node-controller } 2020-03-31 22:41:50 +0000 UTC 2020-04-01 09:07:08 +0000 UTC 6 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a5479619abf8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a5479619abf8 47e9d1fc-898f-4a7c-86a3-c361a3faab60 24205 0 2020-04-01 08:37:50 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 08:37:50 +0000 UTC 2020-04-01 08:37:50 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a547a0607337  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a547a0607337 30c269bf-6f5e-4fb9-84ee-c31fc6a78999 24209 0 2020-04-01 08:37:50 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-m1r0 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 08:37:50 +0000 UTC 2020-04-01 08:37:50 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a547a060c662  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a547a060c662 f1891a37-2ef1-4da3-b3e1-d9baed4140f3 24210 0 2020-04-01 08:37:50 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-m1r0 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 08:37:50 +0000 UTC 2020-04-01 08:37:50 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a547a061001f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a547a061001f 88d0b67b-7d68-4634-8463-af6d41f73e5c 24211 0 2020-04-01 08:37:50 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-m1r0 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 08:37:50 +0000 UTC 2020-04-01 08:37:50 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a547a2ed24fb  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a547a2ed24fb eec3fbe0-009d-423a-bd03-384537e5af26 24212 0 2020-04-01 08:37:50 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeNotReady Node bootstrap-e2e-minion-group-m1r0 status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 08:37:50 +0000 UTC 2020-04-01 08:37:50 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a547bd0a5170  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a547bd0a5170 8bc42474-07a4-418a-a06c-fe19c6f719c5 24213 0 2020-04-01 08:37:51 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 08:37:51 +0000 UTC 2020-04-01 08:37:51 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a547bfa3853a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a547bfa3853a e0f57e5c-507e-4e7a-b4a5-a6a9d95cb613 24214 0 2020-04-01 08:37:51 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeReady Node bootstrap-e2e-minion-group-m1r0 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 08:37:51 +0000 UTC 2020-04-01 08:37:51 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6bb02adc312  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6bb02adc312 3114bae0-30b9-4151-948b-f99ff0f161fe 25081 0 2020-04-01 09:04:25 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:04:25 +0000 UTC 2020-04-01 09:04:25 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6bb0b3e553a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6bb0b3e553a 2638f89b-8e88-4213-946e-e0ff6d0c7dd0 25086 0 2020-04-01 09:04:26 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-m1r0 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:04:26 +0000 UTC 2020-04-01 09:04:26 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6bb0b3e9051  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6bb0b3e9051 e8804eeb-8a2a-4ace-85d0-1bd85c0c83ac 25087 0 2020-04-01 09:04:26 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-m1r0 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:04:26 +0000 UTC 2020-04-01 09:04:26 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6bb0b3ec424  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6bb0b3ec424 6b801061-ee4c-45b6-b005-cb7aa9ad9fc5 25088 0 2020-04-01 09:04:26 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-m1r0 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:04:26 +0000 UTC 2020-04-01 09:04:26 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6bb0f6ab601  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6bb0f6ab601 9fc5f417-fcd7-4e35-b680-7241a491f113 25085 0 2020-04-01 09:04:26 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeNotReady Node bootstrap-e2e-minion-group-m1r0 status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:04:26 +0000 UTC 2020-04-01 09:04:26 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6bb369bca66  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6bb369bca66 aea3a1e6-5e72-4b49-9f63-014b84e7297f 25089 0 2020-04-01 09:04:26 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:04:26 +0000 UTC 2020-04-01 09:04:26 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6bb3b4078bc  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6bb3b4078bc bd087980-f78f-44d9-a5cc-22bf34b9a5da 25090 0 2020-04-01 09:04:26 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeReady Node bootstrap-e2e-minion-group-m1r0 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:04:26 +0000 UTC 2020-04-01 09:04:26 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6e18497feb8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6e18497feb8 2c941223-6fba-44bc-8d33-7d26acd4b9df 25153 0 2020-04-01 09:07:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:07:11 +0000 UTC 2020-04-01 09:07:11 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6e18d14f047  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6e18d14f047 3b98aa46-be17-4f7c-8d8f-9ad60a331a59 25157 0 2020-04-01 09:07:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-m1r0 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:07:11 +0000 UTC 2020-04-01 09:07:11 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6e18d152b58  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6e18d152b58 7fac6fbe-7f11-40f6-adfe-188a60eee6ee 25158 0 2020-04-01 09:07:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-m1r0 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:07:11 +0000 UTC 2020-04-01 09:07:11 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6e18d155d92  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6e18d155d92 2751debd-4dc9-4c51-b695-483d4a52a8c2 25159 0 2020-04-01 09:07:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-m1r0 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:07:11 +0000 UTC 2020-04-01 09:07:11 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6e1902579ec  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6e1902579ec 3767cb0d-6248-4e67-8ade-aa671babb588 25160 0 2020-04-01 09:07:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeNotReady Node bootstrap-e2e-minion-group-m1r0 status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:07:11 +0000 UTC 2020-04-01 09:07:11 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6e1ac9101ea  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6e1ac9101ea 4fd4fc41-859d-4489-aebf-e454bed62fc7 25161 0 2020-04-01 09:07:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:07:12 +0000 UTC 2020-04-01 09:07:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a6e1afe01ad7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a6e1afe01ad7 1ba88c9d-179b-4268-ab63-4d55284c363b 25162 0 2020-04-01 09:07:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } NodeReady Node bootstrap-e2e-minion-group-m1r0 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:07:12 +0000 UTC 2020-04-01 09:07:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a73aa752445f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a73aa752445f 06f61486-ad67-4bf7-be11-9d22a2faa848 25380 0 2020-04-01 09:13:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:13:34 +0000 UTC 2020-04-01 09:13:34 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-m1r0.1601a73aa752636c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-m1r0.1601a73aa752636c e0c46122-08ba-4043-af07-a89c19ac86b3 25379 0 2020-04-01 09:13:34 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-m1r0 bootstrap-e2e-minion-group-m1r0   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-m1r0} 2020-04-01 09:13:34 +0000 UTC 2020-04-01 09:13:34 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-sghl.1601a73b3e15df5b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-sghl.1601a73b3e15df5b 0d61fcb5-4346-4f80-aaad-19a89ef76d3a 25382 0 2020-04-01 09:13:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-sghl bootstrap-e2e-minion-group-sghl   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-sghl} 2020-04-01 09:13:36 +0000 UTC 2020-04-01 09:13:36 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-sghl.1601a73b3e160433  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-sghl.1601a73b3e160433 e5892a90-7fa6-44a7-ac0c-df965e4182d9 25381 0 2020-04-01 09:13:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-sghl bootstrap-e2e-minion-group-sghl   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-sghl} 2020-04-01 09:13:36 +0000 UTC 2020-04-01 09:13:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:141
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Inline-volume (default fs)] subPath should support restarting containers using directory as subpath [Slow] 1m14s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sIn\-tree\sVolumes\s\[Driver\:\shostPathSymlink\]\s\[Testpattern\:\sInline\-volume\s\(default\sfs\)\]\ssubPath\sshould\ssupport\srestarting\scontainers\susing\sdirectory\sas\ssubpath\s\[Slow\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:303
Apr  1 12:55:59.800: while waiting for container to stabilize
Unexpected error:
    <*errors.StatusError | 0xc001ef3cc0>: {
        ErrStatus: {
            TypeMeta: {Kind: "", APIVersion: ""},
            ListMeta: {
                SelfLink: "",
                ResourceVersion: "",
                Continue: "",
                RemainingItemCount: nil,
            },
            Status: "Failure",
            Message: "pods \"pod-subpath-test-hostpathsymlink-dn74\" not found",
            Reason: "NotFound",
            Details: {
                Name: "pod-subpath-test-hostpathsymlink-dn74",
                Group: "",
                Kind: "pods",
                UID: "",
                Causes: nil,
                RetryAfterSeconds: 0,
            },
            Code: 404,
        },
    }
    pods "pod-subpath-test-hostpathsymlink-dn74" not found
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:874