This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 20 failed / 1184 succeeded
Started2020-10-21 19:06
Elapsed14h41m
Revision
Builder7058b2ae-13d0-11eb-a3c5-629ea79d0103
infra-commitb39f868be
job-versionv1.17.14-rc.0.7+a70c45e3b1926e
master_os_imagecos-77-12371-175-0
node_os_imagecos-77-12371-175-0
revisionv1.17.14-rc.0.7+a70c45e3b1926e

Test Failures


Cluster upgrade [sig-cloud-provider-gcp] cluster-upgrade 4m27s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Cluster\supgrade\s\[sig\-cloud\-provider\-gcp\]\scluster\-upgrade$'
Oct 21 19:20:05.735: Unexpected error:
    <*errors.errorString | 0xc0021230d0>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.18.11-rc.0.7+c194df43db09e4]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-5zt3\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-hbq0\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-wrb4\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.7+c194df43db09e4/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n.......................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Applying the latest default CoreDNS configuration ==\\nserviceaccount/coredns unchanged\\nclusterrole.rbac.authorization.k8s.io/system:coredns unchanged\\nclusterrolebinding.rbac.authorization.k8s.io/system:coredns configured\\nconfigmap/coredns configured\\ndeployment.apps/coredns unchanged\\nservice/kube-dns unchanged\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE     VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m15s   v1.18.11-rc.0.7+c194df43db09e4\\nbootstrap-e2e-minion-group-5zt3   Ready                      <none>   8m16s   v1.17.14-rc.0.7+a70c45e3b1926e\\nbootstrap-e2e-minion-group-hbq0   Ready                      <none>   8m15s   v1.17.14-rc.0.7+a70c45e3b1926e\\nbootstrap-e2e-minion-group-wrb4   Ready                      <none>   8m15s   v1.17.14-rc.0.7+a70c45e3b1926e\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\ncontroller-manager   Healthy   ok                  \\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\nscheduler            Healthy   ok                  \\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.18.11-rc.0.7+c194df43db09e4\\\"\\nname: \\\"bootstrap-e2e-minion-group-5zt3\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-hbq0\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-wrb4\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\n\", stderr \"Project: k8s-jkns-gci-gce-serial-1-3\\nNetwork Project: k8s-jkns-gci-gce-serial-1-3\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-5zt3 bootstrap-e2e-minion-group-hbq0 bootstrap-e2e-minion-group-wrb4\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 104.198.7.39; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP   STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   104.198.7.39  RUNNING\\nWarning: Permanently added 'compute.1003426485613967287' (ED25519) to the list of known hosts.\\r\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: k8s-jkns-gci-gce-serial-1-3\\nNetwork Project: k8s-jkns-gci-gce-serial-1-3\\nZone: us-west1-b\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.18.11-rc.0.7+c194df43db09e4]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-5zt3\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-hbq0\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-wrb4\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.7+c194df43db09e4/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n.......................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Applying the latest default CoreDNS configuration ==\nserviceaccount/coredns unchanged\nclusterrole.rbac.authorization.k8s.io/system:coredns unchanged\nclusterrolebinding.rbac.authorization.k8s.io/system:coredns configured\nconfigmap/coredns configured\ndeployment.apps/coredns unchanged\nservice/kube-dns unchanged\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE     VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m15s   v1.18.11-rc.0.7+c194df43db09e4\nbootstrap-e2e-minion-group-5zt3   Ready                      <none>   8m16s   v1.17.14-rc.0.7+a70c45e3b1926e\nbootstrap-e2e-minion-group-hbq0   Ready                      <none>   8m15s   v1.17.14-rc.0.7+a70c45e3b1926e\nbootstrap-e2e-minion-group-wrb4   Ready                      <none>   8m15s   v1.17.14-rc.0.7+a70c45e3b1926e\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\ncontroller-manager   Healthy   ok                  \netcd-1               Healthy   {\"health\":\"true\"}   \nscheduler            Healthy   ok                  \netcd-0               Healthy   {\"health\":\"true\"}   \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.18.11-rc.0.7+c194df43db09e4\"\nname: \"bootstrap-e2e-minion-group-5zt3\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-hbq0\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-wrb4\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\n", stderr "Project: k8s-jkns-gci-gce-serial-1-3\nNetwork Project: k8s-jkns-gci-gce-serial-1-3\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-5zt3 bootstrap-e2e-minion-group-hbq0 bootstrap-e2e-minion-group-wrb4\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 104.198.7.39; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP   STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   104.198.7.39  RUNNING\nWarning: Permanently added 'compute.1003426485613967287' (ED25519) to the list of known hosts.\r\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: k8s-jkns-gci-gce-serial-1-3\nNetwork Project: k8s-jkns-gci-gce-serial-1-3\nZone: us-west1-b\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred

k8s.io/kubernetes/test/e2e/cloud/gcp.glob..func2.3.1.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:153 +0x132
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do(0xc002bf71e8)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:111 +0x38a
k8s.io/kubernetes/test/e2e/cloud/gcp.runUpgradeSuite(0xc000afc840, 0x799a240, 0xc, 0xc, 0xc0008a6e10, 0xc00055a000, 0x2, 0xc002020020)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:485 +0x47a
k8s.io/kubernetes/test/e2e/cloud/gcp.glob..func2.3.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:158 +0x222
k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001cba300)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:125 +0x324
k8s.io/kubernetes/test/e2e.TestE2E(0xc001cba300)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:111 +0x2b
testing.tRunner(0xc001cba300, 0x4af5d58)
	/usr/local/go/src/testing/testing.go:909 +0xc9
created by testing.(*T).Run
	/usr/local/go/src/testing/testing.go:960 +0x350
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] [sig-cloud-provider-gcp] Upgrade [Feature:Upgrade] cluster upgrade should maintain a functioning cluster [Feature:ClusterUpgrade] 16m26s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-cloud\-provider\-gcp\]\sUpgrade\s\[Feature\:Upgrade\]\scluster\supgrade\sshould\smaintain\sa\sfunctioning\scluster\s\[Feature\:ClusterUpgrade\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:142
Oct 21 19:20:05.735: Unexpected error:
    <*errors.errorString | 0xc0021230d0>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.18.11-rc.0.7+c194df43db09e4]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-5zt3\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-hbq0\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-wrb4\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.7+c194df43db09e4/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n.......................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Applying the latest default CoreDNS configuration ==\\nserviceaccount/coredns unchanged\\nclusterrole.rbac.authorization.k8s.io/system:coredns unchanged\\nclusterrolebinding.rbac.authorization.k8s.io/system:coredns configured\\nconfigmap/coredns configured\\ndeployment.apps/coredns unchanged\\nservice/kube-dns unchanged\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE     VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m15s   v1.18.11-rc.0.7+c194df43db09e4\\nbootstrap-e2e-minion-group-5zt3   Ready                      <none>   8m16s   v1.17.14-rc.0.7+a70c45e3b1926e\\nbootstrap-e2e-minion-group-hbq0   Ready                      <none>   8m15s   v1.17.14-rc.0.7+a70c45e3b1926e\\nbootstrap-e2e-minion-group-wrb4   Ready                      <none>   8m15s   v1.17.14-rc.0.7+a70c45e3b1926e\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\ncontroller-manager   Healthy   ok                  \\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\nscheduler            Healthy   ok                  \\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.18.11-rc.0.7+c194df43db09e4\\\"\\nname: \\\"bootstrap-e2e-minion-group-5zt3\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-hbq0\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\nname: \\\"bootstrap-e2e-minion-group-wrb4\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.7+a70c45e3b1926e\\\"\\n\", stderr \"Project: k8s-jkns-gci-gce-serial-1-3\\nNetwork Project: k8s-jkns-gci-gce-serial-1-3\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-5zt3 bootstrap-e2e-minion-group-hbq0 bootstrap-e2e-minion-group-wrb4\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 104.198.7.39; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP   STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   104.198.7.39  RUNNING\\nWarning: Permanently added 'compute.1003426485613967287' (ED25519) to the list of known hosts.\\r\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: k8s-jkns-gci-gce-serial-1-3\\nNetwork Project: k8s-jkns-gci-gce-serial-1-3\\nZone: us-west1-b\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.18.11-rc.0.7+c194df43db09e4]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-5zt3\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-hbq0\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-wrb4\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.7+c194df43db09e4/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n.......................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Applying the latest default CoreDNS configuration ==\nserviceaccount/coredns unchanged\nclusterrole.rbac.authorization.k8s.io/system:coredns unchanged\nclusterrolebinding.rbac.authorization.k8s.io/system:coredns configured\nconfigmap/coredns configured\ndeployment.apps/coredns unchanged\nservice/kube-dns unchanged\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE     VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m15s   v1.18.11-rc.0.7+c194df43db09e4\nbootstrap-e2e-minion-group-5zt3   Ready                      <none>   8m16s   v1.17.14-rc.0.7+a70c45e3b1926e\nbootstrap-e2e-minion-group-hbq0   Ready                      <none>   8m15s   v1.17.14-rc.0.7+a70c45e3b1926e\nbootstrap-e2e-minion-group-wrb4   Ready                      <none>   8m15s   v1.17.14-rc.0.7+a70c45e3b1926e\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\ncontroller-manager   Healthy   ok                  \netcd-1               Healthy   {\"health\":\"true\"}   \nscheduler            Healthy   ok                  \netcd-0               Healthy   {\"health\":\"true\"}   \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.18.11-rc.0.7+c194df43db09e4\"\nname: \"bootstrap-e2e-minion-group-5zt3\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-hbq0\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\nname: \"bootstrap-e2e-minion-group-wrb4\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.7+a70c45e3b1926e\"\n", stderr "Project: k8s-jkns-gci-gce-serial-1-3\nNetwork Project: k8s-jkns-gci-gce-serial-1-3\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-5zt3 bootstrap-e2e-minion-group-hbq0 bootstrap-e2e-minion-group-wrb4\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 104.198.7.39; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-3/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP   STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   104.198.7.39  RUNNING\nWarning: Permanently added 'compute.1003426485613967287' (ED25519) to the list of known hosts.\r\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: k8s-jkns-gci-gce-serial-1-3\nNetwork Project: k8s-jkns-gci-gce-serial-1-3\nZone: us-west1-b\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:153
				
				Click to see stdout/stderrfrom junit_upgrade01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] [sig-node] NodeProblemDetector [DisabledForLargeClusters] should run without error 2m9s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sNodeProblemDetector\s\[DisabledForLargeClusters\]\sshould\srun\swithout\serror$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:57
Oct 21 22:54:00.724: Timed out after 60.002s.
Expected success, but got an error:
    <*errors.errorString | 0xc002c150b0>: {
        s: "Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-6t5n.16401ae88c5e710f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.16401ae88c5e710f 83a6d03f-176b-4a99-a26f-8277302ce959 12117 0 2020-10-21 20:10:53 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 22:45:40 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-6t5n} 2020-10-21 20:10:53 +0000 UTC 2020-10-21 22:45:40 +0000 UTC 8 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.16401e7bf335be2b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.16401e7bf335be2b c0814573-ce40-4a30-92bf-80b87daa2d7e 11655 0 2020-10-21 21:16:25 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-21 22:37:11 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n 355cc552-68b8-4eca-b60a-f1928659c96c v1  } NodeNotReady Node bootstrap-e2e-minion-group-6t5n status is now: NodeNotReady {node-controller } 2020-10-21 21:16:25 +0000 UTC 2020-10-21 22:37:11 +0000 UTC 3 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.16402232d7f1843e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.16402232d7f1843e d6332f2b-d991-4cc7-944a-cff8ba0ae085 11175 0 2020-10-21 22:24:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:24:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:24:29 +0000 UTC 2020-10-21 22:24:29 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.16402232eb1e6ffc  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.16402232eb1e6ffc 1fd3a516-49f4-432c-927b-1725ae29b5d0 11180 0 2020-10-21 22:24:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:24:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:24:29 +0000 UTC 2020-10-21 22:24:29 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.16402232eb26cf56  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.16402232eb26cf56 28ecc099-8253-49e6-bfd4-7d7111ee8f26 11179 0 2020-10-21 22:24:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:24:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:24:29 +0000 UTC 2020-10-21 22:24:29 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.16402232eb38964e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.16402232eb38964e 0478bf90-0576-4a92-aef1-32ec4757477a 11181 0 2020-10-21 22:24:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:24:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:24:29 +0000 UTC 2020-10-21 22:24:29 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.16402232f7b6a231  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.16402232f7b6a231 968a9c2a-ab16-4a3c-9a84-26b6a0e1d301 11182 0 2020-10-21 22:24:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:24:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeNotReady Node bootstrap-e2e-minion-group-6t5n status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:24:29 +0000 UTC 2020-10-21 22:24:29 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.16402233052c641b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.16402233052c641b 9906308b-e999-4cc3-9488-978309d56f89 11183 0 2020-10-21 22:24:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:24:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:24:29 +0000 UTC 2020-10-21 22:24:29 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022330bdaaad1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022330bdaaad1 3d80b28e-3982-4aff-95b9-9fd3d20092fb 11184 0 2020-10-21 22:24:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:24:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeReady Node bootstrap-e2e-minion-group-6t5n status is now: NodeReady {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:24:29 +0000 UTC 2020-10-21 22:24:29 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022c7fc2fdd77  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022c7fc2fdd77 202fc358-fe47-4a86-81e3-a91a07c50408 11470 0 2020-10-21 22:35:09 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:35:09 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:35:09 +0000 UTC 2020-10-21 22:35:09 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022c80e40a557  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022c80e40a557 f3280e60-b2f7-4e1f-934d-37a8067fda2f 11471 0 2020-10-21 22:35:09 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:35:09 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:35:09 +0000 UTC 2020-10-21 22:35:09 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022c80e422ad0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022c80e422ad0 74b88428-4aa0-48a8-87a9-e38c28baaa7f 11472 0 2020-10-21 22:35:09 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:35:09 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:35:09 +0000 UTC 2020-10-21 22:35:09 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022c80e438412  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022c80e438412 10087895-a433-4e48-b0e4-90b3437be72d 11473 0 2020-10-21 22:35:09 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:35:09 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:35:09 +0000 UTC 2020-10-21 22:35:09 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022c816ec8495  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022c816ec8495 f8c833f0-6e91-4cf9-a642-0aa8dc964469 11474 0 2020-10-21 22:35:10 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:35:10 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeNotReady Node bootstrap-e2e-minion-group-6t5n status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:35:10 +0000 UTC 2020-10-21 22:35:10 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022c8329e963d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022c8329e963d bd89c8d0-4619-438a-ace7-4361121176f1 11475 0 2020-10-21 22:35:10 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:35:10 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:35:10 +0000 UTC 2020-10-21 22:35:10 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022c83df285a0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022c83df285a0 3a0c9087-b3de-4982-8498-52a215c067dc 11476 0 2020-10-21 22:35:10 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:35:10 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeReady Node bootstrap-e2e-minion-group-6t5n status is now: NodeReady {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:35:10 +0000 UTC 2020-10-21 22:35:10 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022e4e57cfe30  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022e4e57cfe30 952bb092-4bf5-4ec5-b0d7-7f83ba9457d3 11657 0 2020-10-21 22:37:13 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:37:13 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:37:13 +0000 UTC 2020-10-21 22:37:13 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022e4f45ddd24  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022e4f45ddd24 c1457b51-1543-4c95-a907-5fae86e9c974 11661 0 2020-10-21 22:37:14 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:37:14 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:37:14 +0000 UTC 2020-10-21 22:37:14 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022e4f45f2ff9  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022e4f45f2ff9 1154178f-de21-4945-901c-53299cd88183 11662 0 2020-10-21 22:37:14 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:37:14 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:37:14 +0000 UTC 2020-10-21 22:37:14 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022e4f46068e7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022e4f46068e7 447e93f2-9757-4b6c-b337-6fdde9577ecf 11663 0 2020-10-21 22:37:14 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:37:14 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:37:14 +0000 UTC 2020-10-21 22:37:14 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022e5058e7541  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022e5058e7541 21da0b41-83de-40ff-bea4-493de4e6206d 11664 0 2020-10-21 22:37:14 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:37:14 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeNotReady Node bootstrap-e2e-minion-group-6t5n status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:37:14 +0000 UTC 2020-10-21 22:37:14 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022e511c02934  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022e511c02934 ff042cb4-9ac2-4d52-b0a6-756cf81db5b7 11665 0 2020-10-21 22:37:14 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:37:14 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:37:14 +0000 UTC 2020-10-21 22:37:14 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022e517fca01d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022e517fca01d 6b543729-ccc7-4ae4-a17d-6d39576e75aa 11666 0 2020-10-21 22:37:14 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:37:14 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeReady Node bootstrap-e2e-minion-group-6t5n status is now: NodeReady {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:37:14 +0000 UTC 2020-10-21 22:37:14 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.1640235adaed7c1d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.1640235adaed7c1d 4c383afe-e803-4e56-b0c6-ecd872c51e55 12118 0 2020-10-21 22:45:40 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:45:40 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:45:40 +0000 UTC 2020-10-21 22:45:40 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.1640235ae9ac2e32  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.1640235ae9ac2e32 8a2cae7a-f78a-4aed-aafa-6f2da2c70b94 12119 0 2020-10-21 22:45:40 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:45:40 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:45:40 +0000 UTC 2020-10-21 22:45:40 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.1640235ae9ac8272  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.1640235ae9ac8272 2d01ee39-908a-4230-95cc-eb541bdab37a 12120 0 2020-10-21 22:45:40 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:45:40 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:45:40 +0000 UTC 2020-10-21 22:45:40 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.1640235ae9acbb19  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.1640235ae9acbb19 5fef03d5-4587-4aae-ad53-7f6363e159f2 12121 0 2020-10-21 22:45:40 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:45:40 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:45:40 +0000 UTC 2020-10-21 22:45:40 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.1640235af1791521  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.1640235af1791521 31d9987c-b98f-46d7-965f-a633232ff9c9 12122 0 2020-10-21 22:45:40 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:45:40 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeNotReady Node bootstrap-e2e-minion-group-6t5n status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:45:40 +0000 UTC 2020-10-21 22:45:40 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.1640235af7b74bd4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.1640235af7b74bd4 3558e286-6b3c-4deb-a397-0b2d101e94dd 12123 0 2020-10-21 22:45:40 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:45:40 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:45:40 +0000 UTC 2020-10-21 22:45:40 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.1640235afc676cb1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.1640235afc676cb1 53b3ae5f-acdf-4c14-b8a4-6871217c8297 12124 0 2020-10-21 22:45:41 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:45:41 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeReady Node bootstrap-e2e-minion-group-6t5n status is now: NodeReady {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:45:41 +0000 UTC 2020-10-21 22:45:41 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164023c02cf3483d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164023c02cf3483d f36406c3-d8b9-4a0a-a869-7b269c6bf3ac 12477 0 2020-10-21 22:52:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 22:52:55 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:52:55 +0000 UTC 2020-10-21 22:52:55 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164023c02cf38aea  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164023c02cf38aea c8e5feaf-f31e-46f7-b690-fc2539ff62ff 12478 0 2020-10-21 22:52:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 22:52:55 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:52:55 +0000 UTC 2020-10-21 22:52:55 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-hbq0.164023c0beae5a2d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-hbq0.164023c0beae5a2d d38fb540-8589-4914-a046-8e685ecc05dd 12480 0 2020-10-21 22:52:58 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 22:52:58 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-hbq0 bootstrap-e2e-minion-group-hbq0   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-hbq0} 2020-10-21 22:52:58 +0000 UTC 2020-10-21 22:52:58 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-hbq0.164023c0beae7ce3  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-hbq0.164023c0beae7ce3 9b15df11-fe2a-4e61-94d1-7b83cee8f5cf 12479 0 2020-10-21 22:52:58 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 22:52:58 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-hbq0 bootstrap-e2e-minion-group-hbq0   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-hbq0} 2020-10-21 22:52:58 +0000 UTC 2020-10-21 22:52:58 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wrb4.164023c14d824b9c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wrb4.164023c14d824b9c 93cd211a-81cf-4878-ac0d-2589bebc0d56 12482 0 2020-10-21 22:53:00 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 22:53:00 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-wrb4 bootstrap-e2e-minion-group-wrb4   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-wrb4} 2020-10-21 22:53:00 +0000 UTC 2020-10-21 22:53:00 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wrb4.164023c14d826965  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wrb4.164023c14d826965 37c173b3-6e4a-4381-863c-6a19f31148b5 12481 0 2020-10-21 22:53:00 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 22:53:00 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-wrb4 bootstrap-e2e-minion-group-wrb4   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-wrb4} 2020-10-21 22:53:00 +0000 UTC 2020-10-21 22:53:00 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]",
    }
    Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-6t5n.16401ae88c5e710f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.16401ae88c5e710f 83a6d03f-176b-4a99-a26f-8277302ce959 12117 0 2020-10-21 20:10:53 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 22:45:40 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-6t5n} 2020-10-21 20:10:53 +0000 UTC 2020-10-21 22:45:40 +0000 UTC 8 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.16401e7bf335be2b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.16401e7bf335be2b c0814573-ce40-4a30-92bf-80b87daa2d7e 11655 0 2020-10-21 21:16:25 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-21 22:37:11 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n 355cc552-68b8-4eca-b60a-f1928659c96c v1  } NodeNotReady Node bootstrap-e2e-minion-group-6t5n status is now: NodeNotReady {node-controller } 2020-10-21 21:16:25 +0000 UTC 2020-10-21 22:37:11 +0000 UTC 3 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.16402232d7f1843e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.16402232d7f1843e d6332f2b-d991-4cc7-944a-cff8ba0ae085 11175 0 2020-10-21 22:24:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:24:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:24:29 +0000 UTC 2020-10-21 22:24:29 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.16402232eb1e6ffc  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.16402232eb1e6ffc 1fd3a516-49f4-432c-927b-1725ae29b5d0 11180 0 2020-10-21 22:24:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:24:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:24:29 +0000 UTC 2020-10-21 22:24:29 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.16402232eb26cf56  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.16402232eb26cf56 28ecc099-8253-49e6-bfd4-7d7111ee8f26 11179 0 2020-10-21 22:24:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:24:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:24:29 +0000 UTC 2020-10-21 22:24:29 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.16402232eb38964e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.16402232eb38964e 0478bf90-0576-4a92-aef1-32ec4757477a 11181 0 2020-10-21 22:24:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:24:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:24:29 +0000 UTC 2020-10-21 22:24:29 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.16402232f7b6a231  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.16402232f7b6a231 968a9c2a-ab16-4a3c-9a84-26b6a0e1d301 11182 0 2020-10-21 22:24:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:24:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeNotReady Node bootstrap-e2e-minion-group-6t5n status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:24:29 +0000 UTC 2020-10-21 22:24:29 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.16402233052c641b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.16402233052c641b 9906308b-e999-4cc3-9488-978309d56f89 11183 0 2020-10-21 22:24:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:24:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:24:29 +0000 UTC 2020-10-21 22:24:29 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022330bdaaad1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022330bdaaad1 3d80b28e-3982-4aff-95b9-9fd3d20092fb 11184 0 2020-10-21 22:24:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:24:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeReady Node bootstrap-e2e-minion-group-6t5n status is now: NodeReady {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:24:29 +0000 UTC 2020-10-21 22:24:29 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022c7fc2fdd77  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022c7fc2fdd77 202fc358-fe47-4a86-81e3-a91a07c50408 11470 0 2020-10-21 22:35:09 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:35:09 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:35:09 +0000 UTC 2020-10-21 22:35:09 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022c80e40a557  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022c80e40a557 f3280e60-b2f7-4e1f-934d-37a8067fda2f 11471 0 2020-10-21 22:35:09 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:35:09 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:35:09 +0000 UTC 2020-10-21 22:35:09 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022c80e422ad0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022c80e422ad0 74b88428-4aa0-48a8-87a9-e38c28baaa7f 11472 0 2020-10-21 22:35:09 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:35:09 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:35:09 +0000 UTC 2020-10-21 22:35:09 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022c80e438412  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022c80e438412 10087895-a433-4e48-b0e4-90b3437be72d 11473 0 2020-10-21 22:35:09 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:35:09 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:35:09 +0000 UTC 2020-10-21 22:35:09 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022c816ec8495  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022c816ec8495 f8c833f0-6e91-4cf9-a642-0aa8dc964469 11474 0 2020-10-21 22:35:10 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:35:10 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeNotReady Node bootstrap-e2e-minion-group-6t5n status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:35:10 +0000 UTC 2020-10-21 22:35:10 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022c8329e963d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022c8329e963d bd89c8d0-4619-438a-ace7-4361121176f1 11475 0 2020-10-21 22:35:10 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:35:10 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:35:10 +0000 UTC 2020-10-21 22:35:10 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022c83df285a0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022c83df285a0 3a0c9087-b3de-4982-8498-52a215c067dc 11476 0 2020-10-21 22:35:10 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:35:10 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeReady Node bootstrap-e2e-minion-group-6t5n status is now: NodeReady {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:35:10 +0000 UTC 2020-10-21 22:35:10 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022e4e57cfe30  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022e4e57cfe30 952bb092-4bf5-4ec5-b0d7-7f83ba9457d3 11657 0 2020-10-21 22:37:13 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:37:13 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:37:13 +0000 UTC 2020-10-21 22:37:13 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022e4f45ddd24  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022e4f45ddd24 c1457b51-1543-4c95-a907-5fae86e9c974 11661 0 2020-10-21 22:37:14 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:37:14 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:37:14 +0000 UTC 2020-10-21 22:37:14 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022e4f45f2ff9  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022e4f45f2ff9 1154178f-de21-4945-901c-53299cd88183 11662 0 2020-10-21 22:37:14 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:37:14 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:37:14 +0000 UTC 2020-10-21 22:37:14 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022e4f46068e7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022e4f46068e7 447e93f2-9757-4b6c-b337-6fdde9577ecf 11663 0 2020-10-21 22:37:14 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:37:14 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:37:14 +0000 UTC 2020-10-21 22:37:14 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022e5058e7541  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022e5058e7541 21da0b41-83de-40ff-bea4-493de4e6206d 11664 0 2020-10-21 22:37:14 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:37:14 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeNotReady Node bootstrap-e2e-minion-group-6t5n status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:37:14 +0000 UTC 2020-10-21 22:37:14 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022e511c02934  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022e511c02934 ff042cb4-9ac2-4d52-b0a6-756cf81db5b7 11665 0 2020-10-21 22:37:14 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:37:14 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:37:14 +0000 UTC 2020-10-21 22:37:14 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164022e517fca01d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164022e517fca01d 6b543729-ccc7-4ae4-a17d-6d39576e75aa 11666 0 2020-10-21 22:37:14 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:37:14 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeReady Node bootstrap-e2e-minion-group-6t5n status is now: NodeReady {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:37:14 +0000 UTC 2020-10-21 22:37:14 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.1640235adaed7c1d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.1640235adaed7c1d 4c383afe-e803-4e56-b0c6-ecd872c51e55 12118 0 2020-10-21 22:45:40 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:45:40 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:45:40 +0000 UTC 2020-10-21 22:45:40 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.1640235ae9ac2e32  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.1640235ae9ac2e32 8a2cae7a-f78a-4aed-aafa-6f2da2c70b94 12119 0 2020-10-21 22:45:40 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:45:40 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:45:40 +0000 UTC 2020-10-21 22:45:40 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.1640235ae9ac8272  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.1640235ae9ac8272 2d01ee39-908a-4230-95cc-eb541bdab37a 12120 0 2020-10-21 22:45:40 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:45:40 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:45:40 +0000 UTC 2020-10-21 22:45:40 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.1640235ae9acbb19  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.1640235ae9acbb19 5fef03d5-4587-4aae-ad53-7f6363e159f2 12121 0 2020-10-21 22:45:40 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:45:40 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-6t5n status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:45:40 +0000 UTC 2020-10-21 22:45:40 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.1640235af1791521  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.1640235af1791521 31d9987c-b98f-46d7-965f-a633232ff9c9 12122 0 2020-10-21 22:45:40 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:45:40 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeNotReady Node bootstrap-e2e-minion-group-6t5n status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:45:40 +0000 UTC 2020-10-21 22:45:40 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.1640235af7b74bd4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.1640235af7b74bd4 3558e286-6b3c-4deb-a397-0b2d101e94dd 12123 0 2020-10-21 22:45:40 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:45:40 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:45:40 +0000 UTC 2020-10-21 22:45:40 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.1640235afc676cb1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.1640235afc676cb1 53b3ae5f-acdf-4c14-b8a4-6871217c8297 12124 0 2020-10-21 22:45:41 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-21 22:45:41 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } NodeReady Node bootstrap-e2e-minion-group-6t5n status is now: NodeReady {kubelet bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:45:41 +0000 UTC 2020-10-21 22:45:41 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164023c02cf3483d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164023c02cf3483d f36406c3-d8b9-4a0a-a869-7b269c6bf3ac 12477 0 2020-10-21 22:52:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 22:52:55 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:52:55 +0000 UTC 2020-10-21 22:52:55 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-6t5n.164023c02cf38aea  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-6t5n.164023c02cf38aea c8e5feaf-f31e-46f7-b690-fc2539ff62ff 12478 0 2020-10-21 22:52:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 22:52:55 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-6t5n bootstrap-e2e-minion-group-6t5n   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-6t5n} 2020-10-21 22:52:55 +0000 UTC 2020-10-21 22:52:55 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-hbq0.164023c0beae5a2d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-hbq0.164023c0beae5a2d d38fb540-8589-4914-a046-8e685ecc05dd 12480 0 2020-10-21 22:52:58 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 22:52:58 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-hbq0 bootstrap-e2e-minion-group-hbq0   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-hbq0} 2020-10-21 22:52:58 +0000 UTC 2020-10-21 22:52:58 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-hbq0.164023c0beae7ce3  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-hbq0.164023c0beae7ce3 9b15df11-fe2a-4e61-94d1-7b83cee8f5cf 12479 0 2020-10-21 22:52:58 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 22:52:58 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-hbq0 bootstrap-e2e-minion-group-hbq0   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-hbq0} 2020-10-21 22:52:58 +0000 UTC 2020-10-21 22:52:58 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wrb4.164023c14d824b9c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wrb4.164023c14d824b9c 93cd211a-81cf-4878-ac0d-2589bebc0d56 12482 0 2020-10-21 22:53:00 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 22:53:00 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-wrb4 bootstrap-e2e-minion-group-wrb4   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-wrb4} 2020-10-21 22:53:00 +0000 UTC 2020-10-21 22:53:00 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wrb4.164023c14d826965  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wrb4.164023c14d826965 37c173b3-6e4a-4381-863c-6a19f31148b5 12481 0 2020-10-21 22:53:00 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-21 22:53:00 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-wrb4 bootstrap-e2e-minion-group-wrb4   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-wrb4} 2020-10-21 22:53:00 +0000 UTC 2020-10-21 22:53:00 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:140