This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 19 failed / 1185 succeeded
Started2020-10-26 03:25
Elapsed15h0m
Revision
Buildere15a67c6-173a-11eb-b256-6ee25ea2e440
infra-commitd88010efd
job-versionv1.17.14-rc.0.15+54f3c097502f5b
master_os_imagecos-77-12371-175-0
node_os_imagecos-77-12371-175-0
revisionv1.17.14-rc.0.15+54f3c097502f5b

Test Failures


Cluster upgrade [sig-cloud-provider-gcp] cluster-upgrade 4m29s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Cluster\supgrade\s\[sig\-cloud\-provider\-gcp\]\scluster\-upgrade$'
Oct 26 03:40:48.169: Unexpected error:
    <*errors.errorString | 0xc0028e6100>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.18.11-rc.0.13+806617c8cf1f0d]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.15+54f3c097502f5b\\\"\\nname: \\\"bootstrap-e2e-minion-group-1k98\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.15+54f3c097502f5b\\\"\\nname: \\\"bootstrap-e2e-minion-group-krj5\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.15+54f3c097502f5b\\\"\\nname: \\\"bootstrap-e2e-minion-group-n5k0\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.15+54f3c097502f5b\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.13+806617c8cf1f0d/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n.....................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Applying the latest default CoreDNS configuration ==\\nserviceaccount/coredns unchanged\\nclusterrole.rbac.authorization.k8s.io/system:coredns unchanged\\nclusterrolebinding.rbac.authorization.k8s.io/system:coredns configured\\nconfigmap/coredns configured\\ndeployment.apps/coredns unchanged\\nservice/kube-dns unchanged\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE     VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   9m23s   v1.18.11-rc.0.13+806617c8cf1f0d\\nbootstrap-e2e-minion-group-1k98   Ready                      <none>   9m13s   v1.17.14-rc.0.15+54f3c097502f5b\\nbootstrap-e2e-minion-group-krj5   Ready                      <none>   9m23s   v1.17.14-rc.0.15+54f3c097502f5b\\nbootstrap-e2e-minion-group-n5k0   Ready                      <none>   9m23s   v1.17.14-rc.0.15+54f3c097502f5b\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\ncontroller-manager   Healthy   ok                  \\nscheduler            Healthy   ok                  \\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.18.11-rc.0.13+806617c8cf1f0d\\\"\\nname: \\\"bootstrap-e2e-minion-group-1k98\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.15+54f3c097502f5b\\\"\\nname: \\\"bootstrap-e2e-minion-group-krj5\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.15+54f3c097502f5b\\\"\\nname: \\\"bootstrap-e2e-minion-group-n5k0\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.15+54f3c097502f5b\\\"\\n\", stderr \"Project: e2e-gce-gci-ci-master-slow\\nNetwork Project: e2e-gce-gci-ci-master-slow\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-1k98 bootstrap-e2e-minion-group-krj5 bootstrap-e2e-minion-group-n5k0\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 34.83.38.90; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-master-slow/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-master-slow/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP  STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   34.83.38.90  RUNNING\\nWarning: Permanently added 'compute.3796726150957103708' (ED25519) to the list of known hosts.\\r\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: e2e-gce-gci-ci-master-slow\\nNetwork Project: e2e-gce-gci-ci-master-slow\\nZone: us-west1-b\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.18.11-rc.0.13+806617c8cf1f0d]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.15+54f3c097502f5b\"\nname: \"bootstrap-e2e-minion-group-1k98\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.15+54f3c097502f5b\"\nname: \"bootstrap-e2e-minion-group-krj5\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.15+54f3c097502f5b\"\nname: \"bootstrap-e2e-minion-group-n5k0\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.15+54f3c097502f5b\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.13+806617c8cf1f0d/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n.....................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Applying the latest default CoreDNS configuration ==\nserviceaccount/coredns unchanged\nclusterrole.rbac.authorization.k8s.io/system:coredns unchanged\nclusterrolebinding.rbac.authorization.k8s.io/system:coredns configured\nconfigmap/coredns configured\ndeployment.apps/coredns unchanged\nservice/kube-dns unchanged\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE     VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   9m23s   v1.18.11-rc.0.13+806617c8cf1f0d\nbootstrap-e2e-minion-group-1k98   Ready                      <none>   9m13s   v1.17.14-rc.0.15+54f3c097502f5b\nbootstrap-e2e-minion-group-krj5   Ready                      <none>   9m23s   v1.17.14-rc.0.15+54f3c097502f5b\nbootstrap-e2e-minion-group-n5k0   Ready                      <none>   9m23s   v1.17.14-rc.0.15+54f3c097502f5b\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\ncontroller-manager   Healthy   ok                  \nscheduler            Healthy   ok                  \netcd-1               Healthy   {\"health\":\"true\"}   \netcd-0               Healthy   {\"health\":\"true\"}   \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.18.11-rc.0.13+806617c8cf1f0d\"\nname: \"bootstrap-e2e-minion-group-1k98\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.15+54f3c097502f5b\"\nname: \"bootstrap-e2e-minion-group-krj5\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.15+54f3c097502f5b\"\nname: \"bootstrap-e2e-minion-group-n5k0\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.15+54f3c097502f5b\"\n", stderr "Project: e2e-gce-gci-ci-master-slow\nNetwork Project: e2e-gce-gci-ci-master-slow\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-1k98 bootstrap-e2e-minion-group-krj5 bootstrap-e2e-minion-group-n5k0\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 34.83.38.90; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-master-slow/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-master-slow/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP  STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   34.83.38.90  RUNNING\nWarning: Permanently added 'compute.3796726150957103708' (ED25519) to the list of known hosts.\r\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: e2e-gce-gci-ci-master-slow\nNetwork Project: e2e-gce-gci-ci-master-slow\nZone: us-west1-b\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred

k8s.io/kubernetes/test/e2e/cloud/gcp.glob..func2.3.1.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:153 +0x132
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do(0xc0039cf1e8)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:111 +0x38a
k8s.io/kubernetes/test/e2e/cloud/gcp.runUpgradeSuite(0xc000c26840, 0x799a240, 0xc, 0xc, 0xc000763bc0, 0xc00199a1e0, 0x2, 0xc00239dce0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:485 +0x47a
k8s.io/kubernetes/test/e2e/cloud/gcp.glob..func2.3.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:158 +0x222
k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002a87200)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:125 +0x324
k8s.io/kubernetes/test/e2e.TestE2E(0xc002a87200)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:111 +0x2b
testing.tRunner(0xc002a87200, 0x4af5d58)
	/usr/local/go/src/testing/testing.go:909 +0xc9
created by testing.(*T).Run
	/usr/local/go/src/testing/testing.go:960 +0x350
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] [sig-cloud-provider-gcp] Upgrade [Feature:Upgrade] cluster upgrade should maintain a functioning cluster [Feature:ClusterUpgrade] 17m19s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-cloud\-provider\-gcp\]\sUpgrade\s\[Feature\:Upgrade\]\scluster\supgrade\sshould\smaintain\sa\sfunctioning\scluster\s\[Feature\:ClusterUpgrade\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:142
Oct 26 03:40:48.169: Unexpected error:
    <*errors.errorString | 0xc0028e6100>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.18.11-rc.0.13+806617c8cf1f0d]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.15+54f3c097502f5b\\\"\\nname: \\\"bootstrap-e2e-minion-group-1k98\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.15+54f3c097502f5b\\\"\\nname: \\\"bootstrap-e2e-minion-group-krj5\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.15+54f3c097502f5b\\\"\\nname: \\\"bootstrap-e2e-minion-group-n5k0\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.15+54f3c097502f5b\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.13+806617c8cf1f0d/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n.....................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Applying the latest default CoreDNS configuration ==\\nserviceaccount/coredns unchanged\\nclusterrole.rbac.authorization.k8s.io/system:coredns unchanged\\nclusterrolebinding.rbac.authorization.k8s.io/system:coredns configured\\nconfigmap/coredns configured\\ndeployment.apps/coredns unchanged\\nservice/kube-dns unchanged\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE     VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   9m23s   v1.18.11-rc.0.13+806617c8cf1f0d\\nbootstrap-e2e-minion-group-1k98   Ready                      <none>   9m13s   v1.17.14-rc.0.15+54f3c097502f5b\\nbootstrap-e2e-minion-group-krj5   Ready                      <none>   9m23s   v1.17.14-rc.0.15+54f3c097502f5b\\nbootstrap-e2e-minion-group-n5k0   Ready                      <none>   9m23s   v1.17.14-rc.0.15+54f3c097502f5b\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\ncontroller-manager   Healthy   ok                  \\nscheduler            Healthy   ok                  \\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.18.11-rc.0.13+806617c8cf1f0d\\\"\\nname: \\\"bootstrap-e2e-minion-group-1k98\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.15+54f3c097502f5b\\\"\\nname: \\\"bootstrap-e2e-minion-group-krj5\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.15+54f3c097502f5b\\\"\\nname: \\\"bootstrap-e2e-minion-group-n5k0\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.14-rc.0.15+54f3c097502f5b\\\"\\n\", stderr \"Project: e2e-gce-gci-ci-master-slow\\nNetwork Project: e2e-gce-gci-ci-master-slow\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-1k98 bootstrap-e2e-minion-group-krj5 bootstrap-e2e-minion-group-n5k0\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 34.83.38.90; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-master-slow/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-master-slow/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP  STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   34.83.38.90  RUNNING\\nWarning: Permanently added 'compute.3796726150957103708' (ED25519) to the list of known hosts.\\r\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: e2e-gce-gci-ci-master-slow\\nNetwork Project: e2e-gce-gci-ci-master-slow\\nZone: us-west1-b\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.18.11-rc.0.13+806617c8cf1f0d]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.15+54f3c097502f5b\"\nname: \"bootstrap-e2e-minion-group-1k98\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.15+54f3c097502f5b\"\nname: \"bootstrap-e2e-minion-group-krj5\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.15+54f3c097502f5b\"\nname: \"bootstrap-e2e-minion-group-n5k0\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.15+54f3c097502f5b\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.11-rc.0.13+806617c8cf1f0d/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n.....................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Applying the latest default CoreDNS configuration ==\nserviceaccount/coredns unchanged\nclusterrole.rbac.authorization.k8s.io/system:coredns unchanged\nclusterrolebinding.rbac.authorization.k8s.io/system:coredns configured\nconfigmap/coredns configured\ndeployment.apps/coredns unchanged\nservice/kube-dns unchanged\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE     VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   9m23s   v1.18.11-rc.0.13+806617c8cf1f0d\nbootstrap-e2e-minion-group-1k98   Ready                      <none>   9m13s   v1.17.14-rc.0.15+54f3c097502f5b\nbootstrap-e2e-minion-group-krj5   Ready                      <none>   9m23s   v1.17.14-rc.0.15+54f3c097502f5b\nbootstrap-e2e-minion-group-n5k0   Ready                      <none>   9m23s   v1.17.14-rc.0.15+54f3c097502f5b\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\ncontroller-manager   Healthy   ok                  \nscheduler            Healthy   ok                  \netcd-1               Healthy   {\"health\":\"true\"}   \netcd-0               Healthy   {\"health\":\"true\"}   \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.18.11-rc.0.13+806617c8cf1f0d\"\nname: \"bootstrap-e2e-minion-group-1k98\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.15+54f3c097502f5b\"\nname: \"bootstrap-e2e-minion-group-krj5\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.15+54f3c097502f5b\"\nname: \"bootstrap-e2e-minion-group-n5k0\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.14-rc.0.15+54f3c097502f5b\"\n", stderr "Project: e2e-gce-gci-ci-master-slow\nNetwork Project: e2e-gce-gci-ci-master-slow\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-1k98 bootstrap-e2e-minion-group-krj5 bootstrap-e2e-minion-group-n5k0\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 34.83.38.90; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-master-slow/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/e2e-gce-gci-ci-master-slow/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP  STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   34.83.38.90  RUNNING\nWarning: Permanently added 'compute.3796726150957103708' (ED25519) to the list of known hosts.\r\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: e2e-gce-gci-ci-master-slow\nNetwork Project: e2e-gce-gci-ci-master-slow\nZone: us-west1-b\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:153
				
				Click to see stdout/stderrfrom junit_upgrade01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] [sig-node] NodeProblemDetector [DisabledForLargeClusters] should run without error 2m9s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sNodeProblemDetector\s\[DisabledForLargeClusters\]\sshould\srun\swithout\serror$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:57
Oct 26 05:07:08.559: Timed out after 60.001s.
Expected success, but got an error:
    <*errors.errorString | 0xc0024459b0>: {
        s: "Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-1k98.16416fa7dc8ef593  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-1k98.16416fa7dc8ef593 d8a15691-cc0d-4f60-b0e0-39bc53b7de21 2549 0 2020-10-26 04:15:09 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-26 04:15:09 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-1k98 66d32cb4-d6f7-413c-9f95-c06779387d75 v1  } NodeNotReady Node bootstrap-e2e-minion-group-1k98 status is now: NodeNotReady {node-controller } 2020-10-26 04:15:09 +0000 UTC 2020-10-26 04:15:09 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-1k98.16416fb8d890e95b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-1k98.16416fb8d890e95b a337d9b0-c892-46e3-9f42-7209bdd8f4a2 2551 0 2020-10-26 04:16:22 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-26 04:16:22 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-1k98 66d32cb4-d6f7-413c-9f95-c06779387d75   } Deleting node bootstrap-e2e-minion-group-1k98 because it does not exist in the cloud provider Node bootstrap-e2e-minion-group-1k98 event: DeletingNode {cloud-node-lifecycle-controller } 2020-10-26 04:16:22 +0000 UTC 2020-10-26 04:16:22 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-1k98.16416fb960b8865a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-1k98.16416fb960b8865a 31d055df-be7c-48a1-8adc-b47a011ca898 2552 0 2020-10-26 04:16:24 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-26 04:16:24 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-1k98 66d32cb4-d6f7-413c-9f95-c06779387d75 v1  } RemovingNode Node bootstrap-e2e-minion-group-1k98 event: Removing Node bootstrap-e2e-minion-group-1k98 from Controller {node-controller } 2020-10-26 04:16:24 +0000 UTC 2020-10-26 04:16:24 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcbabe5452d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcbabe5452d 4294020b-a6fe-4eb1-abde-dcdddb3d8e3b 2584 0 2020-10-26 04:17:42 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:17:42 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:42 +0000 UTC 2020-10-26 04:17:42 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcbb80ab95e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcbb80ab95e 94ff1bde-c3a6-406a-b319-be61c99b6ff6 2597 0 2020-10-26 04:17:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:17:43 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-ctt0 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:43 +0000 UTC 2020-10-26 04:17:43 +0000 UTC 4 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcbb81325b6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcbb81325b6 a84b46ed-159b-43f7-a717-6077e24bf123 2595 0 2020-10-26 04:17:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:17:43 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-ctt0 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:43 +0000 UTC 2020-10-26 04:17:43 +0000 UTC 4 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcbb8138662  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcbb8138662 27d41c93-5b0f-4b8d-b986-97b1d08bab15 2596 0 2020-10-26 04:17:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:17:43 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-ctt0 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:43 +0000 UTC 2020-10-26 04:17:43 +0000 UTC 4 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcbbbb7e689  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcbbbb7e689 cd852d63-b237-4daf-b7a1-3dee42eeb228 2591 0 2020-10-26 04:17:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:17:43 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:43 +0000 UTC 2020-10-26 04:17:43 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcc01868879  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcc01868879 88e669be-1324-4da5-be5b-0a600152901c 2602 0 2020-10-26 04:17:44 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-26 04:17:44 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 b50ee73e-d392-46f3-bc6a-2c59054fbabe v1  } RegisteredNode Node bootstrap-e2e-minion-group-ctt0 event: Registered Node bootstrap-e2e-minion-group-ctt0 in Controller {node-controller } 2020-10-26 04:17:44 +0000 UTC 2020-10-26 04:17:44 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcc33e1812d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcc33e1812d 8bc88d71-1f97-4c94-ac79-42a07dcffce3 2607 0 2020-10-26 04:17:45 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-proxy Update v1 2020-10-26 04:17:45 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } Starting Starting kube-proxy. {kube-proxy bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:45 +0000 UTC 2020-10-26 04:17:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcca2adb745  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcca2adb745 e449586e-de50-4564-b529-1b6af3a75408 2611 0 2020-10-26 04:17:47 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-26 04:17:47 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } ContainerdStart Starting containerd container runtime... {systemd-monitor bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:47 +0000 UTC 2020-10-26 04:17:47 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcca2adf621  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcca2adf621 0ace92b4-3dd3-46c0-8a8f-c56cb418022a 2613 0 2020-10-26 04:17:47 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-26 04:17:47 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } DockerStart Starting Docker Application Container Engine... {systemd-monitor bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:47 +0000 UTC 2020-10-26 04:17:47 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcca2d58b94  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcca2d58b94 72d569e1-f02f-45ca-bb28-a599b26db8c8 4343 0 2020-10-26 04:17:47 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-26 04:52:31 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:47 +0000 UTC 2020-10-26 04:52:31 +0000 UTC 3 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fce35c4a861  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fce35c4a861 0f4896e3-624c-4a95-8d94-68006d6864bd 2625 0 2020-10-26 04:17:53 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:17:53 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeReady Node bootstrap-e2e-minion-group-ctt0 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:53 +0000 UTC 2020-10-26 04:17:53 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.1641717f74f81026  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.1641717f74f81026 ab682f49-9429-4479-a412-aaf68bbc8739 4342 0 2020-10-26 04:48:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-26 04:52:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 b50ee73e-d392-46f3-bc6a-2c59054fbabe v1  } NodeNotReady Node bootstrap-e2e-minion-group-ctt0 status is now: NodeNotReady {node-controller } 2020-10-26 04:48:54 +0000 UTC 2020-10-26 04:52:29 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.1641717ff6adc6ca  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.1641717ff6adc6ca 8394a9be-465c-4a42-8ab7-096decccb48e 4219 0 2020-10-26 04:48:56 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:48:56 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:48:56 +0000 UTC 2020-10-26 04:48:56 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.1641718002e86206  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.1641718002e86206 af19b1c5-8ced-4068-9a16-63207250eab5 4223 0 2020-10-26 04:48:56 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:48:57 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-ctt0 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:48:56 +0000 UTC 2020-10-26 04:48:57 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.1641718002e89f19  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.1641718002e89f19 eb0ef2fa-32cd-4235-9121-a4aefa86e8df 4224 0 2020-10-26 04:48:56 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:48:57 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-ctt0 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:48:56 +0000 UTC 2020-10-26 04:48:57 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.1641718002e8ce64  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.1641718002e8ce64 968b760d-2c6b-416d-96d8-6d14a283b02e 4225 0 2020-10-26 04:48:56 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:48:57 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-ctt0 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:48:56 +0000 UTC 2020-10-26 04:48:57 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.164171801ed739b7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.164171801ed739b7 d6dfedaa-96af-4da8-a2d0-f68cb140615e 4226 0 2020-10-26 04:48:57 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:48:57 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeNotReady Node bootstrap-e2e-minion-group-ctt0 status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:48:57 +0000 UTC 2020-10-26 04:48:57 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.164171802b85ad21  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.164171802b85ad21 f7eba2df-d65c-42a6-b7ea-6caaf2828d50 4227 0 2020-10-26 04:48:57 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:48:57 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:48:57 +0000 UTC 2020-10-26 04:48:57 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16417180363f2354  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16417180363f2354 805b132d-e9fc-4bce-ad76-e2e0d04a65e5 4228 0 2020-10-26 04:48:57 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:48:57 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeReady Node bootstrap-e2e-minion-group-ctt0 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:48:57 +0000 UTC 2020-10-26 04:48:57 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.164171b20ed46c81  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.164171b20ed46c81 bbc8c2b6-46c8-4930-9e8b-5a2cd52722ec 4344 0 2020-10-26 04:52:31 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:52:31 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:52:31 +0000 UTC 2020-10-26 04:52:31 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.164171b21da33619  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.164171b21da33619 1c71d0ac-d46d-4bec-8814-9ca308da55cc 4349 0 2020-10-26 04:52:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:52:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-ctt0 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:52:32 +0000 UTC 2020-10-26 04:52:32 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.164171b21da48bb3  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.164171b21da48bb3 d6c2d5b7-88bc-4f61-ac7c-a60f239c03e3 4348 0 2020-10-26 04:52:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:52:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-ctt0 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:52:32 +0000 UTC 2020-10-26 04:52:32 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.164171b21da60b37  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.164171b21da60b37 de238194-478b-4bfe-b673-969f04eb8f69 4350 0 2020-10-26 04:52:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:52:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-ctt0 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:52:32 +0000 UTC 2020-10-26 04:52:32 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.164171b2293ccc15  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.164171b2293ccc15 f87dff69-6cc6-459a-b21b-eceaa980aa31 4351 0 2020-10-26 04:52:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:52:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeNotReady Node bootstrap-e2e-minion-group-ctt0 status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:52:32 +0000 UTC 2020-10-26 04:52:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.164171b2354e796f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.164171b2354e796f 83df0fa3-1cfa-4765-8ec5-389d13653f53 4352 0 2020-10-26 04:52:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:52:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:52:32 +0000 UTC 2020-10-26 04:52:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.164171b23a507d22  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.164171b23a507d22 9f47cfcf-4d8e-4bba-ba37-77ac7f14cdda 4353 0 2020-10-26 04:52:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:52:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeReady Node bootstrap-e2e-minion-group-ctt0 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:52:32 +0000 UTC 2020-10-26 04:52:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.1641726f01a55fb6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.1641726f01a55fb6 541443dd-3ee4-4196-8a8e-215773eef71e 4874 0 2020-10-26 05:06:03 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-26 05:06:03 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-ctt0} 2020-10-26 05:06:03 +0000 UTC 2020-10-26 05:06:03 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.1641726f01a588b6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.1641726f01a588b6 b99093c1-48be-40ca-ba7a-42b48ebe239b 4873 0 2020-10-26 05:06:03 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-26 05:06:03 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-ctt0} 2020-10-26 05:06:03 +0000 UTC 2020-10-26 05:06:03 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-krj5.1641726f92b189c3  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-krj5.1641726f92b189c3 62706ce2-5bb7-4176-b8bd-364e72b74a20 4876 0 2020-10-26 05:06:05 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-26 05:06:05 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-krj5 bootstrap-e2e-minion-group-krj5   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-krj5} 2020-10-26 05:06:05 +0000 UTC 2020-10-26 05:06:05 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-krj5.1641726f92b1a825  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-krj5.1641726f92b1a825 22dd5690-5118-475e-9902-fb09f8a118e1 4875 0 2020-10-26 05:06:05 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-26 05:06:05 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-krj5 bootstrap-e2e-minion-group-krj5   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-krj5} 2020-10-26 05:06:05 +0000 UTC 2020-10-26 05:06:05 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-n5k0.16417270255dec89  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-n5k0.16417270255dec89 e38506ad-a7be-46c1-9de7-070b28e4d94a 4878 0 2020-10-26 05:06:08 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-26 05:06:08 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-n5k0 bootstrap-e2e-minion-group-n5k0   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-n5k0} 2020-10-26 05:06:08 +0000 UTC 2020-10-26 05:06:08 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-n5k0.16417270255e0ea5  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-n5k0.16417270255e0ea5 97e737ec-ed4d-4c11-b8a1-1423916be562 4877 0 2020-10-26 05:06:08 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-26 05:06:08 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-n5k0 bootstrap-e2e-minion-group-n5k0   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-n5k0} 2020-10-26 05:06:08 +0000 UTC 2020-10-26 05:06:08 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]",
    }
    Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-1k98.16416fa7dc8ef593  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-1k98.16416fa7dc8ef593 d8a15691-cc0d-4f60-b0e0-39bc53b7de21 2549 0 2020-10-26 04:15:09 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-26 04:15:09 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-1k98 66d32cb4-d6f7-413c-9f95-c06779387d75 v1  } NodeNotReady Node bootstrap-e2e-minion-group-1k98 status is now: NodeNotReady {node-controller } 2020-10-26 04:15:09 +0000 UTC 2020-10-26 04:15:09 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-1k98.16416fb8d890e95b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-1k98.16416fb8d890e95b a337d9b0-c892-46e3-9f42-7209bdd8f4a2 2551 0 2020-10-26 04:16:22 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-26 04:16:22 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-1k98 66d32cb4-d6f7-413c-9f95-c06779387d75   } Deleting node bootstrap-e2e-minion-group-1k98 because it does not exist in the cloud provider Node bootstrap-e2e-minion-group-1k98 event: DeletingNode {cloud-node-lifecycle-controller } 2020-10-26 04:16:22 +0000 UTC 2020-10-26 04:16:22 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-1k98.16416fb960b8865a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-1k98.16416fb960b8865a 31d055df-be7c-48a1-8adc-b47a011ca898 2552 0 2020-10-26 04:16:24 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-26 04:16:24 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-1k98 66d32cb4-d6f7-413c-9f95-c06779387d75 v1  } RemovingNode Node bootstrap-e2e-minion-group-1k98 event: Removing Node bootstrap-e2e-minion-group-1k98 from Controller {node-controller } 2020-10-26 04:16:24 +0000 UTC 2020-10-26 04:16:24 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcbabe5452d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcbabe5452d 4294020b-a6fe-4eb1-abde-dcdddb3d8e3b 2584 0 2020-10-26 04:17:42 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:17:42 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:42 +0000 UTC 2020-10-26 04:17:42 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcbb80ab95e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcbb80ab95e 94ff1bde-c3a6-406a-b319-be61c99b6ff6 2597 0 2020-10-26 04:17:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:17:43 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-ctt0 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:43 +0000 UTC 2020-10-26 04:17:43 +0000 UTC 4 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcbb81325b6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcbb81325b6 a84b46ed-159b-43f7-a717-6077e24bf123 2595 0 2020-10-26 04:17:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:17:43 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-ctt0 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:43 +0000 UTC 2020-10-26 04:17:43 +0000 UTC 4 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcbb8138662  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcbb8138662 27d41c93-5b0f-4b8d-b986-97b1d08bab15 2596 0 2020-10-26 04:17:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:17:43 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-ctt0 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:43 +0000 UTC 2020-10-26 04:17:43 +0000 UTC 4 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcbbbb7e689  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcbbbb7e689 cd852d63-b237-4daf-b7a1-3dee42eeb228 2591 0 2020-10-26 04:17:43 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:17:43 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:43 +0000 UTC 2020-10-26 04:17:43 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcc01868879  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcc01868879 88e669be-1324-4da5-be5b-0a600152901c 2602 0 2020-10-26 04:17:44 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-26 04:17:44 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 b50ee73e-d392-46f3-bc6a-2c59054fbabe v1  } RegisteredNode Node bootstrap-e2e-minion-group-ctt0 event: Registered Node bootstrap-e2e-minion-group-ctt0 in Controller {node-controller } 2020-10-26 04:17:44 +0000 UTC 2020-10-26 04:17:44 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcc33e1812d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcc33e1812d 8bc88d71-1f97-4c94-ac79-42a07dcffce3 2607 0 2020-10-26 04:17:45 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-proxy Update v1 2020-10-26 04:17:45 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } Starting Starting kube-proxy. {kube-proxy bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:45 +0000 UTC 2020-10-26 04:17:45 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcca2adb745  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcca2adb745 e449586e-de50-4564-b529-1b6af3a75408 2611 0 2020-10-26 04:17:47 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-26 04:17:47 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } ContainerdStart Starting containerd container runtime... {systemd-monitor bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:47 +0000 UTC 2020-10-26 04:17:47 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcca2adf621  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcca2adf621 0ace92b4-3dd3-46c0-8a8f-c56cb418022a 2613 0 2020-10-26 04:17:47 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-26 04:17:47 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } DockerStart Starting Docker Application Container Engine... {systemd-monitor bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:47 +0000 UTC 2020-10-26 04:17:47 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fcca2d58b94  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fcca2d58b94 72d569e1-f02f-45ca-bb28-a599b26db8c8 4343 0 2020-10-26 04:17:47 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-26 04:52:31 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:47 +0000 UTC 2020-10-26 04:52:31 +0000 UTC 3 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16416fce35c4a861  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16416fce35c4a861 0f4896e3-624c-4a95-8d94-68006d6864bd 2625 0 2020-10-26 04:17:53 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:17:53 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeReady Node bootstrap-e2e-minion-group-ctt0 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:17:53 +0000 UTC 2020-10-26 04:17:53 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.1641717f74f81026  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.1641717f74f81026 ab682f49-9429-4479-a412-aaf68bbc8739 4342 0 2020-10-26 04:48:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-26 04:52:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 b50ee73e-d392-46f3-bc6a-2c59054fbabe v1  } NodeNotReady Node bootstrap-e2e-minion-group-ctt0 status is now: NodeNotReady {node-controller } 2020-10-26 04:48:54 +0000 UTC 2020-10-26 04:52:29 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.1641717ff6adc6ca  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.1641717ff6adc6ca 8394a9be-465c-4a42-8ab7-096decccb48e 4219 0 2020-10-26 04:48:56 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:48:56 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:48:56 +0000 UTC 2020-10-26 04:48:56 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.1641718002e86206  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.1641718002e86206 af19b1c5-8ced-4068-9a16-63207250eab5 4223 0 2020-10-26 04:48:56 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:48:57 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-ctt0 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:48:56 +0000 UTC 2020-10-26 04:48:57 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.1641718002e89f19  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.1641718002e89f19 eb0ef2fa-32cd-4235-9121-a4aefa86e8df 4224 0 2020-10-26 04:48:56 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:48:57 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-ctt0 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:48:56 +0000 UTC 2020-10-26 04:48:57 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.1641718002e8ce64  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.1641718002e8ce64 968b760d-2c6b-416d-96d8-6d14a283b02e 4225 0 2020-10-26 04:48:56 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:48:57 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-ctt0 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:48:56 +0000 UTC 2020-10-26 04:48:57 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.164171801ed739b7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.164171801ed739b7 d6dfedaa-96af-4da8-a2d0-f68cb140615e 4226 0 2020-10-26 04:48:57 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:48:57 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeNotReady Node bootstrap-e2e-minion-group-ctt0 status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:48:57 +0000 UTC 2020-10-26 04:48:57 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.164171802b85ad21  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.164171802b85ad21 f7eba2df-d65c-42a6-b7ea-6caaf2828d50 4227 0 2020-10-26 04:48:57 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:48:57 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:48:57 +0000 UTC 2020-10-26 04:48:57 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.16417180363f2354  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.16417180363f2354 805b132d-e9fc-4bce-ad76-e2e0d04a65e5 4228 0 2020-10-26 04:48:57 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:48:57 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeReady Node bootstrap-e2e-minion-group-ctt0 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:48:57 +0000 UTC 2020-10-26 04:48:57 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.164171b20ed46c81  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.164171b20ed46c81 bbc8c2b6-46c8-4930-9e8b-5a2cd52722ec 4344 0 2020-10-26 04:52:31 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:52:31 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:52:31 +0000 UTC 2020-10-26 04:52:31 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.164171b21da33619  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.164171b21da33619 1c71d0ac-d46d-4bec-8814-9ca308da55cc 4349 0 2020-10-26 04:52:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:52:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-ctt0 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:52:32 +0000 UTC 2020-10-26 04:52:32 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.164171b21da48bb3  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.164171b21da48bb3 d6c2d5b7-88bc-4f61-ac7c-a60f239c03e3 4348 0 2020-10-26 04:52:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:52:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-ctt0 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:52:32 +0000 UTC 2020-10-26 04:52:32 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.164171b21da60b37  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.164171b21da60b37 de238194-478b-4bfe-b673-969f04eb8f69 4350 0 2020-10-26 04:52:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:52:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-ctt0 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:52:32 +0000 UTC 2020-10-26 04:52:32 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.164171b2293ccc15  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.164171b2293ccc15 f87dff69-6cc6-459a-b21b-eceaa980aa31 4351 0 2020-10-26 04:52:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:52:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeNotReady Node bootstrap-e2e-minion-group-ctt0 status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:52:32 +0000 UTC 2020-10-26 04:52:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.164171b2354e796f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.164171b2354e796f 83df0fa3-1cfa-4765-8ec5-389d13653f53 4352 0 2020-10-26 04:52:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:52:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:52:32 +0000 UTC 2020-10-26 04:52:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.164171b23a507d22  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.164171b23a507d22 9f47cfcf-4d8e-4bba-ba37-77ac7f14cdda 4353 0 2020-10-26 04:52:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-26 04:52:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } NodeReady Node bootstrap-e2e-minion-group-ctt0 status is now: NodeReady {kubelet bootstrap-e2e-minion-group-ctt0} 2020-10-26 04:52:32 +0000 UTC 2020-10-26 04:52:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.1641726f01a55fb6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.1641726f01a55fb6 541443dd-3ee4-4196-8a8e-215773eef71e 4874 0 2020-10-26 05:06:03 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-26 05:06:03 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-ctt0} 2020-10-26 05:06:03 +0000 UTC 2020-10-26 05:06:03 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-ctt0.1641726f01a588b6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-ctt0.1641726f01a588b6 b99093c1-48be-40ca-ba7a-42b48ebe239b 4873 0 2020-10-26 05:06:03 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-26 05:06:03 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-ctt0 bootstrap-e2e-minion-group-ctt0   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-ctt0} 2020-10-26 05:06:03 +0000 UTC 2020-10-26 05:06:03 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-krj5.1641726f92b189c3  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-krj5.1641726f92b189c3 62706ce2-5bb7-4176-b8bd-364e72b74a20 4876 0 2020-10-26 05:06:05 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-26 05:06:05 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-krj5 bootstrap-e2e-minion-group-krj5   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-krj5} 2020-10-26 05:06:05 +0000 UTC 2020-10-26 05:06:05 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-krj5.1641726f92b1a825  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-krj5.1641726f92b1a825 22dd5690-5118-475e-9902-fb09f8a118e1 4875 0 2020-10-26 05:06:05 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-26 05:06:05 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-krj5 bootstrap-e2e-minion-group-krj5   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-krj5} 2020-10-26 05:06:05 +0000 UTC 2020-10-26 05:06:05 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-n5k0.16417270255dec89  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-n5k0.16417270255dec89 e38506ad-a7be-46c1-9de7-070b28e4d94a 4878 0 2020-10-26 05:06:08 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-26 05:06:08 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-n5k0 bootstrap-e2e-minion-group-n5k0   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-n5k0} 2020-10-26 05:06:08 +0000 UTC 2020-10-26 05:06:08 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-n5k0.16417270255e0ea5  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-n5k0.16417270255e0ea5 97e737ec-ed4d-4c11-b8a1-1423916be562 4877 0 2020-10-26 05:06:08 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-26 05:06:08 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-n5k0 bootstrap-e2e-minion-group-n5k0   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-n5k0} 2020-10-26 05:06:08 +0000 UTC 2020-10-26 05:06:08 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:140