This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 22 failed / 1182 succeeded
Started2020-10-21 04:13
Elapsed14h51m
Revision
Builderafcbb946-1353-11eb-a3c5-629ea79d0103
infra-commit5c86f7035
job-versionv1.17.14-rc.0.7+a70c45e3b1926e
master_os_imagecos-77-12371-175-0
node_os_imagecos-77-12371-175-0
revisionv1.17.14-rc.0.7+a70c45e3b1926e

Test Failures


Cluster upgrade [sig-cloud-provider-gcp] cluster-upgrade 4m37s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Cluster\supgrade\s\[sig\-cloud\-provider\-gcp\]\scluster\-upgrade$'
Oct 21 04:27:00.547: Unexpected error:
    <*errors.errorString | 0xc001c34050>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.18.11-rc.0.7+c194df43db09e4]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-j6pn\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-qjz7\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-r4gs\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.7+c194df43db09e4/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n..........................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Applying the latest default CoreDNS configuration ==\\nserviceaccount/coredns unchanged\\nclusterrole.rbac.authorization.k8s.io/system:coredns unchanged\\nclusterrolebinding.rbac.authorization.k8s.io/system:coredns configured\\nconfigmap/coredns configured\\ndeployment.apps/coredns unchanged\\nservice/kube-dns unchanged\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE     VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m24s   v1.18.11-rc.0.7+c194df43db09e4\\nbootstrap-e2e-minion-group-j6pn   Ready                      <none>   8m25s   v1.17.14-rc.0.7+a70c45e3b1926e\\nbootstrap-e2e-minion-group-qjz7   Ready                      <none>   8m24s   v1.17.14-rc.0.7+a70c45e3b1926e\\nbootstrap-e2e-minion-group-r4gs   Ready                      <none>   8m24s   v1.17.14-rc.0.7+a70c45e3b1926e\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\nscheduler            Healthy   ok                  \\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\ncontroller-manager   Healthy   ok                  \\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.18.11-rc.0.7+c194df43db09e4\\\"\\nname: \\\"bootstrap-e2e-minion-group-j6pn\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-qjz7\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-r4gs\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\n\", stderr \"Project: k8s-jkns-e2e-protobuf\\nNetwork Project: k8s-jkns-e2e-protobuf\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-j6pn bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-r4gs\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 35.227.189.238; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-protobuf/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-protobuf/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP     STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.227.189.238  RUNNING\\nWarning: Permanently added 'compute.843704936865859856' (ED25519) to the list of known hosts.\\r\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: k8s-jkns-e2e-protobuf\\nNetwork Project: k8s-jkns-e2e-protobuf\\nZone: us-west1-b\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.18.11-rc.0.7+c194df43db09e4]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-j6pn\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-qjz7\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-r4gs\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.7+c194df43db09e4/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n..........................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Applying the latest default CoreDNS configuration ==\nserviceaccount/coredns unchanged\nclusterrole.rbac.authorization.k8s.io/system:coredns unchanged\nclusterrolebinding.rbac.authorization.k8s.io/system:coredns configured\nconfigmap/coredns configured\ndeployment.apps/coredns unchanged\nservice/kube-dns unchanged\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE     VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m24s   v1.18.11-rc.0.7+c194df43db09e4\nbootstrap-e2e-minion-group-j6pn   Ready                      <none>   8m25s   v1.17.14-rc.0.7+a70c45e3b1926e\nbootstrap-e2e-minion-group-qjz7   Ready                      <none>   8m24s   v1.17.14-rc.0.7+a70c45e3b1926e\nbootstrap-e2e-minion-group-r4gs   Ready                      <none>   8m24s   v1.17.14-rc.0.7+a70c45e3b1926e\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\nscheduler            Healthy   ok                  \netcd-1               Healthy   {\"health\":\"true\"}   \ncontroller-manager   Healthy   ok                  \netcd-0               Healthy   {\"health\":\"true\"}   \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.18.11-rc.0.7+c194df43db09e4\"\nname: \"bootstrap-e2e-minion-group-j6pn\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-qjz7\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-r4gs\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\n", stderr "Project: k8s-jkns-e2e-protobuf\nNetwork Project: k8s-jkns-e2e-protobuf\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-j6pn bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-r4gs\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 35.227.189.238; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-protobuf/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-protobuf/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP     STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.227.189.238  RUNNING\nWarning: Permanently added 'compute.843704936865859856' (ED25519) to the list of known hosts.\r\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: k8s-jkns-e2e-protobuf\nNetwork Project: k8s-jkns-e2e-protobuf\nZone: us-west1-b\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred

k8s.io/kubernetes/test/e2e/cloud/gcp.glob..func2.3.1.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:153 +0x132
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do(0xc003b391e8)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:111 +0x38a
k8s.io/kubernetes/test/e2e/cloud/gcp.runUpgradeSuite(0xc000b39a20, 0x799a240, 0xc, 0xc, 0xc00087fe30, 0xc003328000, 0x2, 0xc00332c000)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:485 +0x47a
k8s.io/kubernetes/test/e2e/cloud/gcp.glob..func2.3.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:158 +0x222
k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001736600)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:125 +0x324
k8s.io/kubernetes/test/e2e.TestE2E(0xc001736600)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:111 +0x2b
testing.tRunner(0xc001736600, 0x4af5d58)
	/usr/local/go/src/testing/testing.go:909 +0xc9
created by testing.(*T).Run
	/usr/local/go/src/testing/testing.go:960 +0x350
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] [sig-cloud-provider-gcp] Upgrade [Feature:Upgrade] cluster upgrade should maintain a functioning cluster [Feature:ClusterUpgrade] 16m42s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-cloud\-provider\-gcp\]\sUpgrade\s\[Feature\:Upgrade\]\scluster\supgrade\sshould\smaintain\sa\sfunctioning\scluster\s\[Feature\:ClusterUpgrade\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:142
Oct 21 04:27:00.547: Unexpected error:
    <*errors.errorString | 0xc001c34050>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.18.11-rc.0.7+c194df43db09e4]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-j6pn\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-qjz7\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-r4gs\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.7+c194df43db09e4/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n..........................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Applying the latest default CoreDNS configuration ==\\nserviceaccount/coredns unchanged\\nclusterrole.rbac.authorization.k8s.io/system:coredns unchanged\\nclusterrolebinding.rbac.authorization.k8s.io/system:coredns configured\\nconfigmap/coredns configured\\ndeployment.apps/coredns unchanged\\nservice/kube-dns unchanged\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE     VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m24s   v1.18.11-rc.0.7+c194df43db09e4\\nbootstrap-e2e-minion-group-j6pn   Ready                      <none>   8m25s   v1.17.14-rc.0.7+a70c45e3b1926e\\nbootstrap-e2e-minion-group-qjz7   Ready                      <none>   8m24s   v1.17.14-rc.0.7+a70c45e3b1926e\\nbootstrap-e2e-minion-group-r4gs   Ready                      <none>   8m24s   v1.17.14-rc.0.7+a70c45e3b1926e\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\nscheduler            Healthy   ok                  \\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\ncontroller-manager   Healthy   ok                  \\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.18.11-rc.0.7+c194df43db09e4\\\"\\nname: \\\"bootstrap-e2e-minion-group-j6pn\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-qjz7\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-r4gs\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\n\", stderr \"Project: k8s-jkns-e2e-protobuf\\nNetwork Project: k8s-jkns-e2e-protobuf\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-j6pn bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-r4gs\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 35.227.189.238; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-protobuf/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-protobuf/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP     STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.227.189.238  RUNNING\\nWarning: Permanently added 'compute.843704936865859856' (ED25519) to the list of known hosts.\\r\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: k8s-jkns-e2e-protobuf\\nNetwork Project: k8s-jkns-e2e-protobuf\\nZone: us-west1-b\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.18.11-rc.0.7+c194df43db09e4]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-j6pn\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-qjz7\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-r4gs\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.7+c194df43db09e4/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n..........................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Applying the latest default CoreDNS configuration ==\nserviceaccount/coredns unchanged\nclusterrole.rbac.authorization.k8s.io/system:coredns unchanged\nclusterrolebinding.rbac.authorization.k8s.io/system:coredns configured\nconfigmap/coredns configured\ndeployment.apps/coredns unchanged\nservice/kube-dns unchanged\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE     VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m24s   v1.18.11-rc.0.7+c194df43db09e4\nbootstrap-e2e-minion-group-j6pn   Ready                      <none>   8m25s   v1.17.14-rc.0.7+a70c45e3b1926e\nbootstrap-e2e-minion-group-qjz7   Ready                      <none>   8m24s   v1.17.14-rc.0.7+a70c45e3b1926e\nbootstrap-e2e-minion-group-r4gs   Ready                      <none>   8m24s   v1.17.14-rc.0.7+a70c45e3b1926e\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\nscheduler            Healthy   ok                  \netcd-1               Healthy   {\"health\":\"true\"}   \ncontroller-manager   Healthy   ok                  \netcd-0               Healthy   {\"health\":\"true\"}   \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.18.11-rc.0.7+c194df43db09e4\"\nname: \"bootstrap-e2e-minion-group-j6pn\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-qjz7\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-r4gs\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\n", stderr "Project: k8s-jkns-e2e-protobuf\nNetwork Project: k8s-jkns-e2e-protobuf\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-j6pn bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-r4gs\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 35.227.189.238; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-protobuf/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-protobuf/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP     STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.227.189.238  RUNNING\nWarning: Permanently added 'compute.843704936865859856' (ED25519) to the list of known hosts.\r\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: k8s-jkns-e2e-protobuf\nNetwork Project: k8s-jkns-e2e-protobuf\nZone: us-west1-b\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:153
				
				Click to see stdout/stderrfrom junit_upgrade01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] [sig-node] NodeProblemDetector [DisabledForLargeClusters] should run without error 2m9s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sNodeProblemDetector\s\[DisabledForLargeClusters\]\sshould\srun\swithout\serror$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:57
Oct 21 07:25:23.222: Timed out after 60.002s.
Expected success, but got an error:
    <*errors.errorString | 0xc003594140>: {
        s: "Event KubeletStart does not exist: [{{ } {bootstrap-e2e-master.163fedf16566179a  default /api/v1/namespaces/default/events/bootstrap-e2e-master.163fedf16566179a e3e2e509-22b4-4aa6-816f-7f6ba6b8c2f3 7690 0 2020-10-21 06:26:53 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-21 06:26:53 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-master 947edecf-e10b-408e-a1cc-4358ff8ca8f0 v1  } RegisteredNode Node bootstrap-e2e-master event: Registered Node bootstrap-e2e-master in Controller {node-controller } 2020-10-21 06:26:53 +0000 UTC 2020-10-21 06:26:53 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-j6pn.163fedf16566f25d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-j6pn.163fedf16566f25d 1fdf0340-43ca-4125-ad48-baa8e385feee 7691 0 2020-10-21 06:26:53 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-21 06:26:53 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-j6pn f3ca2890-ea91-4a9c-be2b-627f07ed38ab v1  } RegisteredNode Node bootstrap-e2e-minion-group-j6pn event: Registered Node bootstrap-e2e-minion-group-j6pn in Controller {node-controller } 2020-10-21 06:26:53 +0000 UTC 2020-10-21 06:26:53 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-j6pn.163ff11370494d3d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-j6pn.163ff11370494d3d 037d1988-fd59-40da-a487-bdecb2c1f8e7 10814 0 2020-10-21 07:24:18 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 07:24:18 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-j6pn bootstrap-e2e-minion-group-j6pn   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-j6pn} 2020-10-21 07:24:18 +0000 UTC 2020-10-21 07:24:18 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-j6pn.163ff11370496a72  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-j6pn.163ff11370496a72 d1c89fdf-4df7-4ab9-956a-6bf90fc85ed3 10813 0 2020-10-21 07:24:18 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 07:24:18 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-j6pn bootstrap-e2e-minion-group-j6pn   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-j6pn} 2020-10-21 07:24:18 +0000 UTC 2020-10-21 07:24:18 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163fe6f11f6363c6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163fe6f11f6363c6 21de472e-ecec-465c-8eca-eee6aed0576d 10252 0 2020-10-21 06:14:13 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 07:12:31 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-qjz7} 2020-10-21 04:18:35 +0000 UTC 2020-10-21 07:12:31 +0000 UTC 5 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163fedf16567275c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163fedf16567275c 3b9d7fce-e66d-4711-b551-c19eb8f280ec 7692 0 2020-10-21 06:26:53 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-21 06:26:53 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 a14934c6-f63b-4487-9fa9-b79d75757170 v1  } RegisteredNode Node bootstrap-e2e-minion-group-qjz7 event: Registered Node bootstrap-e2e-minion-group-qjz7 in Controller {node-controller } 2020-10-21 06:26:53 +0000 UTC 2020-10-21 06:26:53 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff06e5e7298f2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff06e5e7298f2 4ecff995-43cd-472e-b1f9-8a30495de95d 10251 0 2020-10-21 07:12:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-21 07:12:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 a14934c6-f63b-4487-9fa9-b79d75757170 v1  } NodeNotReady Node bootstrap-e2e-minion-group-qjz7 status is now: NodeNotReady {node-controller } 2020-10-21 07:12:29 +0000 UTC 2020-10-21 07:12:29 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff06f09b711ba  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff06f09b711ba 5a5d1482-fbcf-450b-a543-b05962ed3a18 10253 0 2020-10-21 07:12:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:12:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-qjz7} 2020-10-21 07:12:32 +0000 UTC 2020-10-21 07:12:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff06f16887f33  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff06f16887f33 8cf39d19-f713-4fec-a490-60be9993d5dd 10257 0 2020-10-21 07:12:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:12:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-qjz7 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-qjz7} 2020-10-21 07:12:32 +0000 UTC 2020-10-21 07:12:32 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff06f1688c259  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff06f1688c259 4e99546d-7240-4e12-88fb-6f54ac47bf7f 10258 0 2020-10-21 07:12:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:12:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-qjz7 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-qjz7} 2020-10-21 07:12:32 +0000 UTC 2020-10-21 07:12:32 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff06f16894c97  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff06f16894c97 cf78b8e8-66c6-4f37-a2d8-baa6143c7ab5 10259 0 2020-10-21 07:12:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:12:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-qjz7 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-qjz7} 2020-10-21 07:12:32 +0000 UTC 2020-10-21 07:12:32 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff06f25e0efe8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff06f25e0efe8 9a5f6679-2f91-4973-8c5b-ac8327536f00 10260 0 2020-10-21 07:12:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:12:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } NodeNotReady Node bootstrap-e2e-minion-group-qjz7 status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-qjz7} 2020-10-21 07:12:32 +0000 UTC 2020-10-21 07:12:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff06f3f35d8b8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff06f3f35d8b8 19bd79a8-2e90-4235-aa51-62bfc0b8ec85 10261 0 2020-10-21 07:12:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:12:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-qjz7} 2020-10-21 07:12:32 +0000 UTC 2020-10-21 07:12:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff06f4565807d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff06f4565807d 280d60ee-8b1d-4bdb-8b39-8e6cf72e6dd4 10262 0 2020-10-21 07:12:33 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:12:33 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } NodeReady Node bootstrap-e2e-minion-group-qjz7 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-qjz7} 2020-10-21 07:12:33 +0000 UTC 2020-10-21 07:12:33 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff113ff0c813d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff113ff0c813d da2d5581-4ca9-4f21-91ef-aae1084f167a 10816 0 2020-10-21 07:24:20 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 07:24:20 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-qjz7} 2020-10-21 07:24:20 +0000 UTC 2020-10-21 07:24:20 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff113ff0ca0b3  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff113ff0ca0b3 881cba7c-e3e5-4b85-9b95-bd178df6ea92 10815 0 2020-10-21 07:24:20 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 07:24:20 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-qjz7} 2020-10-21 07:24:20 +0000 UTC 2020-10-21 07:24:20 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fe6f21b6b5b87  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fe6f21b6b5b87 1196cb8c-015f-4163-939a-19738b30593e 10746 0 2020-10-21 04:18:40 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-r4gs} 2020-10-21 04:18:39 +0000 UTC 2020-10-21 07:22:00 +0000 UTC 11 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fedf16567582e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fedf16567582e 7e3037e3-5f43-44fb-8e8e-2aebca9ac8c5 7689 0 2020-10-21 06:26:53 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-21 06:26:53 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bce1b33e-b5a7-4df7-abff-7fa117f8eecb v1  } RegisteredNode Node bootstrap-e2e-minion-group-r4gs event: Registered Node bootstrap-e2e-minion-group-r4gs in Controller {node-controller } 2020-10-21 06:26:53 +0000 UTC 2020-10-21 06:26:53 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fee16a8a33ae2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fee16a8a33ae2 067bc9da-3b5c-412f-92e6-821a4a23cb90 10418 0 2020-10-21 06:29:33 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-21 07:15:15 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bce1b33e-b5a7-4df7-abff-7fa117f8eecb v1  } NodeNotReady Node bootstrap-e2e-minion-group-r4gs status is now: NodeNotReady {node-controller } 2020-10-21 06:29:33 +0000 UTC 2020-10-21 07:15:15 +0000 UTC 3 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fee1746918541  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fee1746918541 f06011d5-40c0-4a89-916e-bcc481a1a7ca 7887 0 2020-10-21 06:29:36 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 06:29:36 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 06:29:36 +0000 UTC 2020-10-21 06:29:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fee17540a7466  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fee17540a7466 21d0c7c8-d5f7-45b9-8cb8-b0ba8f25ed5c 7891 0 2020-10-21 06:29:36 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 06:29:36 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 06:29:36 +0000 UTC 2020-10-21 06:29:36 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fee17540ab9b1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fee17540ab9b1 37a1236f-aaa2-440c-bbb9-985b2d92ea09 7892 0 2020-10-21 06:29:36 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 06:29:36 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 06:29:36 +0000 UTC 2020-10-21 06:29:36 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fee17540ae997  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fee17540ae997 ac82936d-8b73-4eff-81e5-1d1899618045 7893 0 2020-10-21 06:29:36 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 06:29:36 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 06:29:36 +0000 UTC 2020-10-21 06:29:36 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fee175ce5db21  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fee175ce5db21 f17f0502-3962-45fe-949a-7ee5ea98b35d 7894 0 2020-10-21 06:29:36 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 06:29:36 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeNotReady Node bootstrap-e2e-minion-group-r4gs status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 06:29:36 +0000 UTC 2020-10-21 06:29:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fee1761655279  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fee1761655279 d1d6c120-60e7-4e3b-8091-b14e81443f91 7895 0 2020-10-21 06:29:36 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 06:29:36 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 06:29:36 +0000 UTC 2020-10-21 06:29:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fee17662c44d4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fee17662c44d4 fbf74817-d7ed-4095-88ff-a706eea11ffd 7896 0 2020-10-21 06:29:36 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 06:29:36 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeReady Node bootstrap-e2e-minion-group-r4gs status is now: NodeReady {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 06:29:36 +0000 UTC 2020-10-21 06:29:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0559e3815da  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0559e3815da a1555718-eaac-4dd8-8e2f-5dddbe1c93f1 10123 0 2020-10-21 07:10:42 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:10:42 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:10:42 +0000 UTC 2020-10-21 07:10:42 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff055aab8b7bf  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff055aab8b7bf b24ff3f6-b496-48e0-8ec5-982ffd24de8e 10128 0 2020-10-21 07:10:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:10:43 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:10:43 +0000 UTC 2020-10-21 07:10:43 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff055aab8f97c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff055aab8f97c 113aebdd-9ff4-4265-8602-137d875fc49f 10129 0 2020-10-21 07:10:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:10:43 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:10:43 +0000 UTC 2020-10-21 07:10:43 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff055aab93d2b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff055aab93d2b a742a8c7-55b0-4b70-8f99-4b33ade88895 10130 0 2020-10-21 07:10:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:10:43 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:10:43 +0000 UTC 2020-10-21 07:10:43 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff055c2dd4c8a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff055c2dd4c8a 4c163e91-2468-4939-ab44-b5d5c54b2d47 10127 0 2020-10-21 07:10:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:10:43 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeNotReady Node bootstrap-e2e-minion-group-r4gs status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:10:43 +0000 UTC 2020-10-21 07:10:43 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff055cda12f71  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff055cda12f71 6eb447e0-b06f-4aab-bdfb-f917695e77f9 10131 0 2020-10-21 07:10:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:10:43 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:10:43 +0000 UTC 2020-10-21 07:10:43 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff055d9a99b87  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff055d9a99b87 1012657e-f586-4cf0-a95d-2ba2b7e89fb4 10139 0 2020-10-21 07:10:44 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:10:44 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeReady Node bootstrap-e2e-minion-group-r4gs status is now: NodeReady {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:10:43 +0000 UTC 2020-10-21 07:10:43 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff09583091bf0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff09583091bf0 7c82f7fc-ea22-4ca2-adc1-7f39979f698f 10420 0 2020-10-21 07:15:17 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:15:17 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:15:17 +0000 UTC 2020-10-21 07:15:17 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0959211d4ca  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0959211d4ca 6fe256c6-3666-40ae-9555-2b6ffcb947f6 10424 0 2020-10-21 07:15:17 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:15:17 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:15:17 +0000 UTC 2020-10-21 07:15:17 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff09592135b4e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff09592135b4e c0255d24-0f1a-4e56-adce-ae8e74cf6016 10425 0 2020-10-21 07:15:17 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:15:17 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:15:17 +0000 UTC 2020-10-21 07:15:17 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0959214b057  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0959214b057 7e7b977e-9d2f-4efa-a48b-fc333acc4755 10426 0 2020-10-21 07:15:17 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:15:17 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:15:17 +0000 UTC 2020-10-21 07:15:17 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff095978fdec1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff095978fdec1 b791b000-1231-47bd-9d79-4c17efcbc302 10427 0 2020-10-21 07:15:17 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:15:17 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeNotReady Node bootstrap-e2e-minion-group-r4gs status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:15:17 +0000 UTC 2020-10-21 07:15:17 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0959bf1cc83  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0959bf1cc83 8d95e858-2684-474d-95f8-06778b88c8d2 10428 0 2020-10-21 07:15:17 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:15:17 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:15:17 +0000 UTC 2020-10-21 07:15:17 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff095a28f327c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff095a28f327c 134f658f-26c8-4cc1-b72b-421b6059a944 10429 0 2020-10-21 07:15:17 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:15:17 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeReady Node bootstrap-e2e-minion-group-r4gs status is now: NodeReady {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:15:17 +0000 UTC 2020-10-21 07:15:17 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0f38970dc6b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0f38970dc6b 9cd726d2-04ac-4e3c-85a7-8e0948d47eba 10747 0 2020-10-21 07:22:01 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:22:01 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:22:01 +0000 UTC 2020-10-21 07:22:01 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0f39703ef76  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0f39703ef76 56097e38-5773-4fda-859f-de5dc0b824fb 10748 0 2020-10-21 07:22:01 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:22:01 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:22:01 +0000 UTC 2020-10-21 07:22:01 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0f3970438b1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0f3970438b1 db5766d6-0a8c-4ad2-9fcd-e8e2c88948c9 10749 0 2020-10-21 07:22:01 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:22:01 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:22:01 +0000 UTC 2020-10-21 07:22:01 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0f39704618a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0f39704618a 90cfb64d-a413-46a1-8262-8280e6051dbd 10750 0 2020-10-21 07:22:01 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:22:01 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:22:01 +0000 UTC 2020-10-21 07:22:01 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0f3a2ef93ee  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0f3a2ef93ee accec44b-87fe-493a-9160-a19839d5291f 10751 0 2020-10-21 07:22:01 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:22:01 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeNotReady Node bootstrap-e2e-minion-group-r4gs status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:22:01 +0000 UTC 2020-10-21 07:22:01 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0f3acb6bf66  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0f3acb6bf66 f1e5a2d6-0d91-463a-8b06-fa60745f66b4 10752 0 2020-10-21 07:22:01 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:22:01 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:22:01 +0000 UTC 2020-10-21 07:22:01 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0f3b44d1f84  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0f3b44d1f84 e6ca7f4e-4c66-478c-9eda-7d9605f54e7c 10753 0 2020-10-21 07:22:01 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:22:01 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeReady Node bootstrap-e2e-minion-group-r4gs status is now: NodeReady {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:22:01 +0000 UTC 2020-10-21 07:22:01 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff114946da5b3  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff114946da5b3 dc3d93b8-d057-44b4-972b-9ba811e6acd8 10818 0 2020-10-21 07:24:23 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 07:24:23 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:24:23 +0000 UTC 2020-10-21 07:24:23 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff114946dbfcf  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff114946dbfcf 78e5883e-84ae-4287-a925-ed9f05bd3199 10817 0 2020-10-21 07:24:23 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 07:24:23 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:24:23 +0000 UTC 2020-10-21 07:24:23 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]",
    }
    Event KubeletStart does not exist: [{{ } {bootstrap-e2e-master.163fedf16566179a  default /api/v1/namespaces/default/events/bootstrap-e2e-master.163fedf16566179a e3e2e509-22b4-4aa6-816f-7f6ba6b8c2f3 7690 0 2020-10-21 06:26:53 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-21 06:26:53 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-master 947edecf-e10b-408e-a1cc-4358ff8ca8f0 v1  } RegisteredNode Node bootstrap-e2e-master event: Registered Node bootstrap-e2e-master in Controller {node-controller } 2020-10-21 06:26:53 +0000 UTC 2020-10-21 06:26:53 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-j6pn.163fedf16566f25d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-j6pn.163fedf16566f25d 1fdf0340-43ca-4125-ad48-baa8e385feee 7691 0 2020-10-21 06:26:53 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-21 06:26:53 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-j6pn f3ca2890-ea91-4a9c-be2b-627f07ed38ab v1  } RegisteredNode Node bootstrap-e2e-minion-group-j6pn event: Registered Node bootstrap-e2e-minion-group-j6pn in Controller {node-controller } 2020-10-21 06:26:53 +0000 UTC 2020-10-21 06:26:53 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-j6pn.163ff11370494d3d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-j6pn.163ff11370494d3d 037d1988-fd59-40da-a487-bdecb2c1f8e7 10814 0 2020-10-21 07:24:18 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 07:24:18 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-j6pn bootstrap-e2e-minion-group-j6pn   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-j6pn} 2020-10-21 07:24:18 +0000 UTC 2020-10-21 07:24:18 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-j6pn.163ff11370496a72  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-j6pn.163ff11370496a72 d1c89fdf-4df7-4ab9-956a-6bf90fc85ed3 10813 0 2020-10-21 07:24:18 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 07:24:18 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-j6pn bootstrap-e2e-minion-group-j6pn   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-j6pn} 2020-10-21 07:24:18 +0000 UTC 2020-10-21 07:24:18 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163fe6f11f6363c6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163fe6f11f6363c6 21de472e-ecec-465c-8eca-eee6aed0576d 10252 0 2020-10-21 06:14:13 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 07:12:31 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-qjz7} 2020-10-21 04:18:35 +0000 UTC 2020-10-21 07:12:31 +0000 UTC 5 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163fedf16567275c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163fedf16567275c 3b9d7fce-e66d-4711-b551-c19eb8f280ec 7692 0 2020-10-21 06:26:53 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-21 06:26:53 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 a14934c6-f63b-4487-9fa9-b79d75757170 v1  } RegisteredNode Node bootstrap-e2e-minion-group-qjz7 event: Registered Node bootstrap-e2e-minion-group-qjz7 in Controller {node-controller } 2020-10-21 06:26:53 +0000 UTC 2020-10-21 06:26:53 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff06e5e7298f2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff06e5e7298f2 4ecff995-43cd-472e-b1f9-8a30495de95d 10251 0 2020-10-21 07:12:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-21 07:12:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 a14934c6-f63b-4487-9fa9-b79d75757170 v1  } NodeNotReady Node bootstrap-e2e-minion-group-qjz7 status is now: NodeNotReady {node-controller } 2020-10-21 07:12:29 +0000 UTC 2020-10-21 07:12:29 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff06f09b711ba  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff06f09b711ba 5a5d1482-fbcf-450b-a543-b05962ed3a18 10253 0 2020-10-21 07:12:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:12:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-qjz7} 2020-10-21 07:12:32 +0000 UTC 2020-10-21 07:12:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff06f16887f33  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff06f16887f33 8cf39d19-f713-4fec-a490-60be9993d5dd 10257 0 2020-10-21 07:12:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:12:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-qjz7 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-qjz7} 2020-10-21 07:12:32 +0000 UTC 2020-10-21 07:12:32 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff06f1688c259  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff06f1688c259 4e99546d-7240-4e12-88fb-6f54ac47bf7f 10258 0 2020-10-21 07:12:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:12:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-qjz7 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-qjz7} 2020-10-21 07:12:32 +0000 UTC 2020-10-21 07:12:32 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff06f16894c97  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff06f16894c97 cf78b8e8-66c6-4f37-a2d8-baa6143c7ab5 10259 0 2020-10-21 07:12:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:12:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-qjz7 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-qjz7} 2020-10-21 07:12:32 +0000 UTC 2020-10-21 07:12:32 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff06f25e0efe8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff06f25e0efe8 9a5f6679-2f91-4973-8c5b-ac8327536f00 10260 0 2020-10-21 07:12:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:12:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } NodeNotReady Node bootstrap-e2e-minion-group-qjz7 status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-qjz7} 2020-10-21 07:12:32 +0000 UTC 2020-10-21 07:12:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff06f3f35d8b8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff06f3f35d8b8 19bd79a8-2e90-4235-aa51-62bfc0b8ec85 10261 0 2020-10-21 07:12:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:12:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-qjz7} 2020-10-21 07:12:32 +0000 UTC 2020-10-21 07:12:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff06f4565807d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff06f4565807d 280d60ee-8b1d-4bdb-8b39-8e6cf72e6dd4 10262 0 2020-10-21 07:12:33 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:12:33 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } NodeReady Node bootstrap-e2e-minion-group-qjz7 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-qjz7} 2020-10-21 07:12:33 +0000 UTC 2020-10-21 07:12:33 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff113ff0c813d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff113ff0c813d da2d5581-4ca9-4f21-91ef-aae1084f167a 10816 0 2020-10-21 07:24:20 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 07:24:20 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-qjz7} 2020-10-21 07:24:20 +0000 UTC 2020-10-21 07:24:20 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qjz7.163ff113ff0ca0b3  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qjz7.163ff113ff0ca0b3 881cba7c-e3e5-4b85-9b95-bd178df6ea92 10815 0 2020-10-21 07:24:20 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 07:24:20 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-qjz7 bootstrap-e2e-minion-group-qjz7   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-qjz7} 2020-10-21 07:24:20 +0000 UTC 2020-10-21 07:24:20 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fe6f21b6b5b87  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fe6f21b6b5b87 1196cb8c-015f-4163-939a-19738b30593e 10746 0 2020-10-21 04:18:40 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-r4gs} 2020-10-21 04:18:39 +0000 UTC 2020-10-21 07:22:00 +0000 UTC 11 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fedf16567582e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fedf16567582e 7e3037e3-5f43-44fb-8e8e-2aebca9ac8c5 7689 0 2020-10-21 06:26:53 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-21 06:26:53 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bce1b33e-b5a7-4df7-abff-7fa117f8eecb v1  } RegisteredNode Node bootstrap-e2e-minion-group-r4gs event: Registered Node bootstrap-e2e-minion-group-r4gs in Controller {node-controller } 2020-10-21 06:26:53 +0000 UTC 2020-10-21 06:26:53 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fee16a8a33ae2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fee16a8a33ae2 067bc9da-3b5c-412f-92e6-821a4a23cb90 10418 0 2020-10-21 06:29:33 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-21 07:15:15 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bce1b33e-b5a7-4df7-abff-7fa117f8eecb v1  } NodeNotReady Node bootstrap-e2e-minion-group-r4gs status is now: NodeNotReady {node-controller } 2020-10-21 06:29:33 +0000 UTC 2020-10-21 07:15:15 +0000 UTC 3 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fee1746918541  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fee1746918541 f06011d5-40c0-4a89-916e-bcc481a1a7ca 7887 0 2020-10-21 06:29:36 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 06:29:36 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 06:29:36 +0000 UTC 2020-10-21 06:29:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fee17540a7466  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fee17540a7466 21d0c7c8-d5f7-45b9-8cb8-b0ba8f25ed5c 7891 0 2020-10-21 06:29:36 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 06:29:36 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 06:29:36 +0000 UTC 2020-10-21 06:29:36 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fee17540ab9b1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fee17540ab9b1 37a1236f-aaa2-440c-bbb9-985b2d92ea09 7892 0 2020-10-21 06:29:36 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 06:29:36 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 06:29:36 +0000 UTC 2020-10-21 06:29:36 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fee17540ae997  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fee17540ae997 ac82936d-8b73-4eff-81e5-1d1899618045 7893 0 2020-10-21 06:29:36 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 06:29:36 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 06:29:36 +0000 UTC 2020-10-21 06:29:36 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fee175ce5db21  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fee175ce5db21 f17f0502-3962-45fe-949a-7ee5ea98b35d 7894 0 2020-10-21 06:29:36 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 06:29:36 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeNotReady Node bootstrap-e2e-minion-group-r4gs status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 06:29:36 +0000 UTC 2020-10-21 06:29:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fee1761655279  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fee1761655279 d1d6c120-60e7-4e3b-8091-b14e81443f91 7895 0 2020-10-21 06:29:36 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 06:29:36 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 06:29:36 +0000 UTC 2020-10-21 06:29:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163fee17662c44d4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163fee17662c44d4 fbf74817-d7ed-4095-88ff-a706eea11ffd 7896 0 2020-10-21 06:29:36 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 06:29:36 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeReady Node bootstrap-e2e-minion-group-r4gs status is now: NodeReady {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 06:29:36 +0000 UTC 2020-10-21 06:29:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0559e3815da  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0559e3815da a1555718-eaac-4dd8-8e2f-5dddbe1c93f1 10123 0 2020-10-21 07:10:42 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:10:42 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:10:42 +0000 UTC 2020-10-21 07:10:42 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff055aab8b7bf  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff055aab8b7bf b24ff3f6-b496-48e0-8ec5-982ffd24de8e 10128 0 2020-10-21 07:10:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:10:43 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:10:43 +0000 UTC 2020-10-21 07:10:43 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff055aab8f97c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff055aab8f97c 113aebdd-9ff4-4265-8602-137d875fc49f 10129 0 2020-10-21 07:10:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:10:43 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:10:43 +0000 UTC 2020-10-21 07:10:43 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff055aab93d2b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff055aab93d2b a742a8c7-55b0-4b70-8f99-4b33ade88895 10130 0 2020-10-21 07:10:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:10:43 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:10:43 +0000 UTC 2020-10-21 07:10:43 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff055c2dd4c8a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff055c2dd4c8a 4c163e91-2468-4939-ab44-b5d5c54b2d47 10127 0 2020-10-21 07:10:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:10:43 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeNotReady Node bootstrap-e2e-minion-group-r4gs status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:10:43 +0000 UTC 2020-10-21 07:10:43 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff055cda12f71  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff055cda12f71 6eb447e0-b06f-4aab-bdfb-f917695e77f9 10131 0 2020-10-21 07:10:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:10:43 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:10:43 +0000 UTC 2020-10-21 07:10:43 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff055d9a99b87  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff055d9a99b87 1012657e-f586-4cf0-a95d-2ba2b7e89fb4 10139 0 2020-10-21 07:10:44 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:10:44 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeReady Node bootstrap-e2e-minion-group-r4gs status is now: NodeReady {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:10:43 +0000 UTC 2020-10-21 07:10:43 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff09583091bf0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff09583091bf0 7c82f7fc-ea22-4ca2-adc1-7f39979f698f 10420 0 2020-10-21 07:15:17 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:15:17 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:15:17 +0000 UTC 2020-10-21 07:15:17 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0959211d4ca  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0959211d4ca 6fe256c6-3666-40ae-9555-2b6ffcb947f6 10424 0 2020-10-21 07:15:17 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:15:17 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:15:17 +0000 UTC 2020-10-21 07:15:17 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff09592135b4e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff09592135b4e c0255d24-0f1a-4e56-adce-ae8e74cf6016 10425 0 2020-10-21 07:15:17 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:15:17 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:15:17 +0000 UTC 2020-10-21 07:15:17 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0959214b057  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0959214b057 7e7b977e-9d2f-4efa-a48b-fc333acc4755 10426 0 2020-10-21 07:15:17 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:15:17 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:15:17 +0000 UTC 2020-10-21 07:15:17 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff095978fdec1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff095978fdec1 b791b000-1231-47bd-9d79-4c17efcbc302 10427 0 2020-10-21 07:15:17 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:15:17 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeNotReady Node bootstrap-e2e-minion-group-r4gs status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:15:17 +0000 UTC 2020-10-21 07:15:17 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0959bf1cc83  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0959bf1cc83 8d95e858-2684-474d-95f8-06778b88c8d2 10428 0 2020-10-21 07:15:17 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:15:17 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:15:17 +0000 UTC 2020-10-21 07:15:17 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff095a28f327c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff095a28f327c 134f658f-26c8-4cc1-b72b-421b6059a944 10429 0 2020-10-21 07:15:17 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:15:17 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeReady Node bootstrap-e2e-minion-group-r4gs status is now: NodeReady {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:15:17 +0000 UTC 2020-10-21 07:15:17 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0f38970dc6b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0f38970dc6b 9cd726d2-04ac-4e3c-85a7-8e0948d47eba 10747 0 2020-10-21 07:22:01 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:22:01 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:22:01 +0000 UTC 2020-10-21 07:22:01 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0f39703ef76  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0f39703ef76 56097e38-5773-4fda-859f-de5dc0b824fb 10748 0 2020-10-21 07:22:01 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:22:01 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:22:01 +0000 UTC 2020-10-21 07:22:01 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0f3970438b1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0f3970438b1 db5766d6-0a8c-4ad2-9fcd-e8e2c88948c9 10749 0 2020-10-21 07:22:01 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:22:01 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:22:01 +0000 UTC 2020-10-21 07:22:01 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0f39704618a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0f39704618a 90cfb64d-a413-46a1-8262-8280e6051dbd 10750 0 2020-10-21 07:22:01 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:22:01 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-r4gs status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:22:01 +0000 UTC 2020-10-21 07:22:01 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0f3a2ef93ee  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0f3a2ef93ee accec44b-87fe-493a-9160-a19839d5291f 10751 0 2020-10-21 07:22:01 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:22:01 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeNotReady Node bootstrap-e2e-minion-group-r4gs status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:22:01 +0000 UTC 2020-10-21 07:22:01 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0f3acb6bf66  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0f3acb6bf66 f1e5a2d6-0d91-463a-8b06-fa60745f66b4 10752 0 2020-10-21 07:22:01 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:22:01 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:22:01 +0000 UTC 2020-10-21 07:22:01 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff0f3b44d1f84  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff0f3b44d1f84 e6ca7f4e-4c66-478c-9eda-7d9605f54e7c 10753 0 2020-10-21 07:22:01 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 07:22:01 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } NodeReady Node bootstrap-e2e-minion-group-r4gs status is now: NodeReady {kubelet bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:22:01 +0000 UTC 2020-10-21 07:22:01 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff114946da5b3  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff114946da5b3 dc3d93b8-d057-44b4-972b-9ba811e6acd8 10818 0 2020-10-21 07:24:23 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 07:24:23 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:24:23 +0000 UTC 2020-10-21 07:24:23 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r4gs.163ff114946dbfcf  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r4gs.163ff114946dbfcf 78e5883e-84ae-4287-a925-ed9f05bd3199 10817 0 2020-10-21 07:24:23 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 07:24:23 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r4gs bootstrap-e2e-minion-group-r4gs   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-r4gs} 2020-10-21 07:24:23 +0000 UTC 2020-10-21 07:24:23 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:140