This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 88 failed / 640 succeeded
Started2020-10-15 13:48
Elapsed15h12m
Revision
Builder1639c3fa-0eed-11eb-b384-ce16c16e5d30
infra-commit564d0896d
job-versionv1.17.13-rc.0.25+4a28e05c652659
master_os_imagecos-77-12371-175-0
node_os_imagecos-77-12371-175-0
revisionv1.17.13-rc.0.25+4a28e05c652659

Test Failures


Cluster upgrade [sig-cloud-provider-gcp] cluster-upgrade 4m32s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Cluster\supgrade\s\[sig\-cloud\-provider\-gcp\]\scluster\-upgrade$'
Oct 15 14:02:25.004: Unexpected error:
    <*errors.errorString | 0xc00239d360>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.18.10-rc.0.43+cc9a451a45036b]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.13-rc.0.25+4a28e05c652659\\\"\\nname: \\\"bootstrap-e2e-minion-group-6vzt\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.13-rc.0.25+4a28e05c652659\\\"\\nname: \\\"bootstrap-e2e-minion-group-nrn1\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.13-rc.0.25+4a28e05c652659\\\"\\nname: \\\"bootstrap-e2e-minion-group-wp6q\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.13-rc.0.25+4a28e05c652659\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.10-rc.0.43+cc9a451a45036b/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n.........................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Applying the latest default CoreDNS configuration ==\\nserviceaccount/coredns unchanged\\nclusterrole.rbac.authorization.k8s.io/system:coredns unchanged\\nclusterrolebinding.rbac.authorization.k8s.io/system:coredns configured\\nconfigmap/coredns configured\\ndeployment.apps/coredns unchanged\\nservice/kube-dns unchanged\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE     VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m20s   v1.18.10-rc.0.43+cc9a451a45036b\\nbootstrap-e2e-minion-group-6vzt   Ready                      <none>   8m20s   v1.17.13-rc.0.25+4a28e05c652659\\nbootstrap-e2e-minion-group-nrn1   Ready                      <none>   8m20s   v1.17.13-rc.0.25+4a28e05c652659\\nbootstrap-e2e-minion-group-wp6q   Ready                      <none>   8m20s   v1.17.13-rc.0.25+4a28e05c652659\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\ncontroller-manager   Healthy   ok                  \\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\nscheduler            Healthy   ok                  \\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.18.10-rc.0.43+cc9a451a45036b\\\"\\nname: \\\"bootstrap-e2e-minion-group-6vzt\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.13-rc.0.25+4a28e05c652659\\\"\\nname: \\\"bootstrap-e2e-minion-group-nrn1\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.13-rc.0.25+4a28e05c652659\\\"\\nname: \\\"bootstrap-e2e-minion-group-wp6q\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.13-rc.0.25+4a28e05c652659\\\"\\n\", stderr \"Project: k8s-jenkins-cvm\\nNetwork Project: k8s-jenkins-cvm\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-6vzt bootstrap-e2e-minion-group-nrn1 bootstrap-e2e-minion-group-wp6q\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 34.83.149.24; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jenkins-cvm/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jenkins-cvm/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP   STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   34.83.149.24  RUNNING\\nWarning: Permanently added 'compute.3309705236438182669' (ED25519) to the list of known hosts.\\r\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: k8s-jenkins-cvm\\nNetwork Project: k8s-jenkins-cvm\\nZone: us-west1-b\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.18.10-rc.0.43+cc9a451a45036b]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.13-rc.0.25+4a28e05c652659\"\nname: \"bootstrap-e2e-minion-group-6vzt\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.13-rc.0.25+4a28e05c652659\"\nname: \"bootstrap-e2e-minion-group-nrn1\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.13-rc.0.25+4a28e05c652659\"\nname: \"bootstrap-e2e-minion-group-wp6q\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.13-rc.0.25+4a28e05c652659\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.10-rc.0.43+cc9a451a45036b/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n.........................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Applying the latest default CoreDNS configuration ==\nserviceaccount/coredns unchanged\nclusterrole.rbac.authorization.k8s.io/system:coredns unchanged\nclusterrolebinding.rbac.authorization.k8s.io/system:coredns configured\nconfigmap/coredns configured\ndeployment.apps/coredns unchanged\nservice/kube-dns unchanged\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE     VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m20s   v1.18.10-rc.0.43+cc9a451a45036b\nbootstrap-e2e-minion-group-6vzt   Ready                      <none>   8m20s   v1.17.13-rc.0.25+4a28e05c652659\nbootstrap-e2e-minion-group-nrn1   Ready                      <none>   8m20s   v1.17.13-rc.0.25+4a28e05c652659\nbootstrap-e2e-minion-group-wp6q   Ready                      <none>   8m20s   v1.17.13-rc.0.25+4a28e05c652659\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\ncontroller-manager   Healthy   ok                  \netcd-0               Healthy   {\"health\":\"true\"}   \nscheduler            Healthy   ok                  \netcd-1               Healthy   {\"health\":\"true\"}   \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.18.10-rc.0.43+cc9a451a45036b\"\nname: \"bootstrap-e2e-minion-group-6vzt\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.13-rc.0.25+4a28e05c652659\"\nname: \"bootstrap-e2e-minion-group-nrn1\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.13-rc.0.25+4a28e05c652659\"\nname: \"bootstrap-e2e-minion-group-wp6q\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.13-rc.0.25+4a28e05c652659\"\n", stderr "Project: k8s-jenkins-cvm\nNetwork Project: k8s-jenkins-cvm\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-6vzt bootstrap-e2e-minion-group-nrn1 bootstrap-e2e-minion-group-wp6q\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 34.83.149.24; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jenkins-cvm/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jenkins-cvm/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP   STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   34.83.149.24  RUNNING\nWarning: Permanently added 'compute.3309705236438182669' (ED25519) to the list of known hosts.\r\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: k8s-jenkins-cvm\nNetwork Project: k8s-jenkins-cvm\nZone: us-west1-b\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred

k8s.io/kubernetes/test/e2e/cloud/gcp.glob..func2.3.1.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:153 +0x132
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do(0xc0036231e8)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:111 +0x38a
k8s.io/kubernetes/test/e2e/cloud/gcp.runUpgradeSuite(0xc000aabe40, 0x799a240, 0xc, 0xc, 0xc000512870, 0xc0037ed680, 0x2, 0xc00202efe0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:485 +0x47a
k8s.io/kubernetes/test/e2e/cloud/gcp.glob..func2.3.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:158 +0x222
k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002cc2100)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:125 +0x324
k8s.io/kubernetes/test/e2e.TestE2E(0xc002cc2100)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:111 +0x2b
testing.tRunner(0xc002cc2100, 0x4af5d18)
	/usr/local/go/src/testing/testing.go:909 +0xc9
created by testing.(*T).Run
	/usr/local/go/src/testing/testing.go:960 +0x350
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite AfterSuite 0.00s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\sAfterSuite$'
_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:72
Oct 16 04:51:42.375: All nodes should be ready after test, Not ready nodes: ", bootstrap-e2e-minion-group-nrn1"
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:418
				from junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] Container Lifecycle Hook when create a pod with lifecycle hook should execute prestop exec hook properly [NodeConformance] [Conformance] 3m22s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\sprestop\sexec\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:152
Oct 16 00:47:45.712: All nodes should be ready after test, Not ready nodes: ", bootstrap-e2e-minion-group-nrn1"
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:418
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] from file when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance] 3m3s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sContainer\sRuntime\sblackbox\stest\son\sterminated\scontainer\sshould\sreport\stermination\smessage\s\[LinuxOnly\]\sfrom\sfile\swhen\spod\ssucceeds\sand\sTerminationMessagePolicy\sFallbackToLogsOnError\sis\sset\s\[NodeConformance\]\s\[Conformance\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:152
Oct 15 23:05:19.744: All nodes should be ready after test, Not ready nodes: ", bootstrap-e2e-minion-group-nrn1"
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:418
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] Security Context when creating containers with AllowPrivilegeEscalation should not allow privilege escalation when false [LinuxOnly] [NodeConformance] [Conformance] 3m4s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\sSecurity\sContext\swhen\screating\scontainers\swith\sAllowPrivilegeEscalation\sshould\snot\sallow\sprivilege\sescalation\swhen\sfalse\s\[LinuxOnly\]\s\[NodeConformance\]\s\[Conformance\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:152
Oct 16 00:30:03.678: All nodes should be ready after test, Not ready nodes: ", bootstrap-e2e-minion-group-nrn1"
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:418
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] [sig-cloud-provider-gcp] Addon update should propagate add-on file changes [Slow] 5m30s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-cloud\-provider\-gcp\]\sAddon\supdate\sshould\spropagate\sadd\-on\sfile\schanges\s\[Slow\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:152
Oct 15 23:48:35.174: All nodes should be ready after test, Not ready nodes: ", bootstrap-e2e-minion-group-nrn1"
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:418
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] [sig-cloud-provider-gcp] Upgrade [Feature:Upgrade] cluster upgrade should maintain a functioning cluster [Feature:ClusterUpgrade] 16m25s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-cloud\-provider\-gcp\]\sUpgrade\s\[Feature\:Upgrade\]\scluster\supgrade\sshould\smaintain\sa\sfunctioning\scluster\s\[Feature\:ClusterUpgrade\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:142
Oct 15 14:02:25.004: Unexpected error:
    <*errors.errorString | 0xc00239d360>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.18.10-rc.0.43+cc9a451a45036b]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.13-rc.0.25+4a28e05c652659\\\"\\nname: \\\"bootstrap-e2e-minion-group-6vzt\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.13-rc.0.25+4a28e05c652659\\\"\\nname: \\\"bootstrap-e2e-minion-group-nrn1\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.13-rc.0.25+4a28e05c652659\\\"\\nname: \\\"bootstrap-e2e-minion-group-wp6q\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.13-rc.0.25+4a28e05c652659\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.10-rc.0.43+cc9a451a45036b/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n.........................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Applying the latest default CoreDNS configuration ==\\nserviceaccount/coredns unchanged\\nclusterrole.rbac.authorization.k8s.io/system:coredns unchanged\\nclusterrolebinding.rbac.authorization.k8s.io/system:coredns configured\\nconfigmap/coredns configured\\ndeployment.apps/coredns unchanged\\nservice/kube-dns unchanged\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE     VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m20s   v1.18.10-rc.0.43+cc9a451a45036b\\nbootstrap-e2e-minion-group-6vzt   Ready                      <none>   8m20s   v1.17.13-rc.0.25+4a28e05c652659\\nbootstrap-e2e-minion-group-nrn1   Ready                      <none>   8m20s   v1.17.13-rc.0.25+4a28e05c652659\\nbootstrap-e2e-minion-group-wp6q   Ready                      <none>   8m20s   v1.17.13-rc.0.25+4a28e05c652659\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\ncontroller-manager   Healthy   ok                  \\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\nscheduler            Healthy   ok                  \\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.18.10-rc.0.43+cc9a451a45036b\\\"\\nname: \\\"bootstrap-e2e-minion-group-6vzt\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.13-rc.0.25+4a28e05c652659\\\"\\nname: \\\"bootstrap-e2e-minion-group-nrn1\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.13-rc.0.25+4a28e05c652659\\\"\\nname: \\\"bootstrap-e2e-minion-group-wp6q\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.13-rc.0.25+4a28e05c652659\\\"\\n\", stderr \"Project: k8s-jenkins-cvm\\nNetwork Project: k8s-jenkins-cvm\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-6vzt bootstrap-e2e-minion-group-nrn1 bootstrap-e2e-minion-group-wp6q\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 34.83.149.24; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jenkins-cvm/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jenkins-cvm/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP   STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   34.83.149.24  RUNNING\\nWarning: Permanently added 'compute.3309705236438182669' (ED25519) to the list of known hosts.\\r\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: k8s-jenkins-cvm\\nNetwork Project: k8s-jenkins-cvm\\nZone: us-west1-b\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.18.10-rc.0.43+cc9a451a45036b]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.13-rc.0.25+4a28e05c652659\"\nname: \"bootstrap-e2e-minion-group-6vzt\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.13-rc.0.25+4a28e05c652659\"\nname: \"bootstrap-e2e-minion-group-nrn1\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.13-rc.0.25+4a28e05c652659\"\nname: \"bootstrap-e2e-minion-group-wp6q\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.13-rc.0.25+4a28e05c652659\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.18.10-rc.0.43+cc9a451a45036b/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n.........................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Applying the latest default CoreDNS configuration ==\nserviceaccount/coredns unchanged\nclusterrole.rbac.authorization.k8s.io/system:coredns unchanged\nclusterrolebinding.rbac.authorization.k8s.io/system:coredns configured\nconfigmap/coredns configured\ndeployment.apps/coredns unchanged\nservice/kube-dns unchanged\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE     VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m20s   v1.18.10-rc.0.43+cc9a451a45036b\nbootstrap-e2e-minion-group-6vzt   Ready                      <none>   8m20s   v1.17.13-rc.0.25+4a28e05c652659\nbootstrap-e2e-minion-group-nrn1   Ready                      <none>   8m20s   v1.17.13-rc.0.25+4a28e05c652659\nbootstrap-e2e-minion-group-wp6q   Ready                      <none>   8m20s   v1.17.13-rc.0.25+4a28e05c652659\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\ncontroller-manager   Healthy   ok                  \netcd-0               Healthy   {\"health\":\"true\"}   \nscheduler            Healthy   ok                  \netcd-1               Healthy   {\"health\":\"true\"}   \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.18.10-rc.0.43+cc9a451a45036b\"\nname: \"bootstrap-e2e-minion-group-6vzt\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.13-rc.0.25+4a28e05c652659\"\nname: \"bootstrap-e2e-minion-group-nrn1\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.13-rc.0.25+4a28e05c652659\"\nname: \"bootstrap-e2e-minion-group-wp6q\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.13-rc.0.25+4a28e05c652659\"\n", stderr "Project: k8s-jenkins-cvm\nNetwork Project: k8s-jenkins-cvm\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-6vzt bootstrap-e2e-minion-group-nrn1 bootstrap-e2e-minion-group-wp6q\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 34.83.149.24; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jenkins-cvm/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jenkins-cvm/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP   STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   34.83.149.24  RUNNING\nWarning: Permanently added 'compute.3309705236438182669' (ED25519) to the list of known hosts.\r\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: k8s-jenkins-cvm\nNetwork Project: k8s-jenkins-cvm\nZone: us-west1-b\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:153
				
				Click to see stdout/stderrfrom junit_upgrade01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] [sig-node] NodeProblemDetector [DisabledForLargeClusters] should run without error 2m9s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sNodeProblemDetector\s\[DisabledForLargeClusters\]\sshould\srun\swithout\serror$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:57
Oct 15 17:48:33.076: Timed out after 60.001s.
Expected success, but got an error:
    <*errors.errorString | 0xc00558c450>: {
        s: "Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-nrn1.163e3b998b505649  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-nrn1.163e3b998b505649 80049882-8597-4485-9790-9e63c52566be 13827 0 2020-10-15 17:47:28 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-15 17:47:28 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-nrn1 bootstrap-e2e-minion-group-nrn1   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-nrn1} 2020-10-15 17:47:28 +0000 UTC 2020-10-15 17:47:28 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-nrn1.163e3b998b507a3f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-nrn1.163e3b998b507a3f a6671ca0-964a-4523-a402-d5fb2a476510 13826 0 2020-10-15 17:47:28 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-15 17:47:28 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-nrn1 bootstrap-e2e-minion-group-nrn1   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-nrn1} 2020-10-15 17:47:28 +0000 UTC 2020-10-15 17:47:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e34ca81cd2ca9  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e34ca81cd2ca9 55abad7d-b6a5-4ac5-8b2f-a4f7de85e0bd 12333 0 2020-10-15 17:02:11 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-15 17:12:28 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-r7pv} 2020-10-15 15:42:41 +0000 UTC 2020-10-15 17:12:28 +0000 UTC 4 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e3923b22a298c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e3923b22a298c 0d1acec9-bc39-4bc9-a1f6-f00f47c2fcd2 11964 0 2020-10-15 17:02:22 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:02:22 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:02:22 +0000 UTC 2020-10-15 17:02:22 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e3923bf000692  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e3923bf000692 49fde7cd-c746-4d6a-a097-3e512a077215 11965 0 2020-10-15 17:02:23 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:02:23 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-r7pv status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:02:23 +0000 UTC 2020-10-15 17:02:23 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e3923bf1146c1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e3923bf1146c1 6490a32b-65b8-4a1f-aad5-5d0946d8f5a9 11966 0 2020-10-15 17:02:23 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:02:23 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-r7pv status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:02:23 +0000 UTC 2020-10-15 17:02:23 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e3923bf1aaaef  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e3923bf1aaaef d43cebcd-714d-41e2-877c-bf8f4c2e5f7f 11967 0 2020-10-15 17:02:23 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:02:23 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-r7pv status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:02:23 +0000 UTC 2020-10-15 17:02:23 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e3923c5f82a3d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e3923c5f82a3d bdf25db2-eca3-4dfc-9030-6df2507dc988 11968 0 2020-10-15 17:02:23 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:02:23 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeNotReady Node bootstrap-e2e-minion-group-r7pv status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:02:23 +0000 UTC 2020-10-15 17:02:23 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e3923cffb10bf  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e3923cffb10bf 97872534-e2de-4eb0-9488-c9c53d3a0def 11969 0 2020-10-15 17:02:23 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:02:23 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:02:23 +0000 UTC 2020-10-15 17:02:23 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e3923d50d480b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e3923d50d480b d2fd3ad7-5dd4-4fda-8399-9e2cf3ae0055 11970 0 2020-10-15 17:02:23 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:02:23 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeReady Node bootstrap-e2e-minion-group-r7pv status is now: NodeReady {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:02:23 +0000 UTC 2020-10-15 17:02:23 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e39b017a6c3b4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e39b017a6c3b4 e9fb685a-5abc-4eae-8b22-07d8a62c0ccd 12332 0 2020-10-15 17:12:25 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-15 17:12:25 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv f4129af9-1a11-4a96-930f-dfdb179ff5ea v1  } NodeNotReady Node bootstrap-e2e-minion-group-r7pv status is now: NodeNotReady {node-controller } 2020-10-15 17:12:25 +0000 UTC 2020-10-15 17:12:25 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e39b0b387ffa8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e39b0b387ffa8 7a5f2e77-6efd-4f11-ac4b-103eba15c411 12334 0 2020-10-15 17:12:28 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:12:28 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:12:28 +0000 UTC 2020-10-15 17:12:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e39b0c1011d52  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e39b0c1011d52 5dcc9e99-b793-4c39-ba44-9f408ecda0f2 12338 0 2020-10-15 17:12:28 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:12:28 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-r7pv status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:12:28 +0000 UTC 2020-10-15 17:12:28 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e39b0c102a4ee  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e39b0c102a4ee 4ff83cdb-a9dc-4011-a871-f547ceb17398 12339 0 2020-10-15 17:12:28 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:12:28 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-r7pv status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:12:28 +0000 UTC 2020-10-15 17:12:28 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e39b0c103e28f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e39b0c103e28f 9765fa6e-8562-411b-af8b-487f40e6be24 12340 0 2020-10-15 17:12:28 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:12:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-r7pv status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:12:28 +0000 UTC 2020-10-15 17:12:28 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e39b0cfae8896  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e39b0cfae8896 19844bf8-9985-451a-ae07-65073106d569 12341 0 2020-10-15 17:12:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:12:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeNotReady Node bootstrap-e2e-minion-group-r7pv status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:12:28 +0000 UTC 2020-10-15 17:12:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e39b0dcc2491e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e39b0dcc2491e 5faf7179-aae8-403b-b45b-bd2dd56b82db 12342 0 2020-10-15 17:12:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:12:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:12:29 +0000 UTC 2020-10-15 17:12:29 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e39b0e2e60001  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e39b0e2e60001 66e9a8ea-a882-47dd-8383-8c3918afa095 12343 0 2020-10-15 17:12:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:12:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeReady Node bootstrap-e2e-minion-group-r7pv status is now: NodeReady {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:12:29 +0000 UTC 2020-10-15 17:12:29 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e3b9a1c0bc7e7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e3b9a1c0bc7e7 37f8c298-ae8e-4403-8ebb-71ccfab26070 13829 0 2020-10-15 17:47:30 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-15 17:47:30 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:47:30 +0000 UTC 2020-10-15 17:47:30 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e3b9a1c0c0428  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e3b9a1c0c0428 49f47761-fa32-4263-ac89-e8cd6dd6aa01 13828 0 2020-10-15 17:47:30 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-15 17:47:30 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:47:30 +0000 UTC 2020-10-15 17:47:30 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wp6q.163e31040b1aace0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wp6q.163e31040b1aace0 5db1cbcc-a6a5-4462-8cf1-58f29b4cbc65 13213 0 2020-10-15 17:29:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-15 17:29:54 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-wp6q bootstrap-e2e-minion-group-wp6q   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-wp6q} 2020-10-15 14:33:30 +0000 UTC 2020-10-15 17:29:54 +0000 UTC 4 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wp6q.163e3aa375e5536a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wp6q.163e3aa375e5536a ea74a5ba-4f93-47f4-a047-ebf77616c539 13212 0 2020-10-15 17:29:51 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-15 17:29:51 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-wp6q 6d01ac6e-348f-4367-ba4c-904e4e085c74 v1  } NodeNotReady Node bootstrap-e2e-minion-group-wp6q status is now: NodeNotReady {node-controller } 2020-10-15 17:29:51 +0000 UTC 2020-10-15 17:29:51 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wp6q.163e3aa4490dfbac  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wp6q.163e3aa4490dfbac 13e2313e-da8f-4cdd-8083-76c985f9e4b3 13214 0 2020-10-15 17:29:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:29:54 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-wp6q bootstrap-e2e-minion-group-wp6q   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-wp6q} 2020-10-15 17:29:54 +0000 UTC 2020-10-15 17:29:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wp6q.163e3aa45f4c088e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wp6q.163e3aa45f4c088e 096499cf-70a2-4380-b8a1-fda64e494c7d 13218 0 2020-10-15 17:29:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:29:55 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-wp6q bootstrap-e2e-minion-group-wp6q   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-wp6q status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-wp6q} 2020-10-15 17:29:55 +0000 UTC 2020-10-15 17:29:55 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wp6q.163e3aa45f4c4314  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wp6q.163e3aa45f4c4314 2fc06cca-26c8-4c63-89ff-56c5adc3ea38 13219 0 2020-10-15 17:29:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:29:55 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-wp6q bootstrap-e2e-minion-group-wp6q   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-wp6q status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-wp6q} 2020-10-15 17:29:55 +0000 UTC 2020-10-15 17:29:55 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wp6q.163e3aa45f4c8f25  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wp6q.163e3aa45f4c8f25 65b3f51d-78ef-446f-af58-1f0b78c1abff 13220 0 2020-10-15 17:29:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:29:55 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-wp6q bootstrap-e2e-minion-group-wp6q   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-wp6q status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-wp6q} 2020-10-15 17:29:55 +0000 UTC 2020-10-15 17:29:55 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wp6q.163e3aa465df946c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wp6q.163e3aa465df946c de6a7fc2-b9c7-47e9-93a0-0b65e7730cca 13221 0 2020-10-15 17:29:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:29:55 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-wp6q bootstrap-e2e-minion-group-wp6q   } NodeNotReady Node bootstrap-e2e-minion-group-wp6q status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-wp6q} 2020-10-15 17:29:55 +0000 UTC 2020-10-15 17:29:55 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wp6q.163e3aa48634e551  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wp6q.163e3aa48634e551 34dd36ad-bacf-4374-b7d2-9c5e67383714 13222 0 2020-10-15 17:29:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:29:55 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-wp6q bootstrap-e2e-minion-group-wp6q   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-wp6q} 2020-10-15 17:29:55 +0000 UTC 2020-10-15 17:29:55 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wp6q.163e3aa490203f8a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wp6q.163e3aa490203f8a af59be41-9ec5-4578-a0b2-fca16174d8ed 13223 0 2020-10-15 17:29:55 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:29:55 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-wp6q bootstrap-e2e-minion-group-wp6q   } NodeReady Node bootstrap-e2e-minion-group-wp6q status is now: NodeReady {kubelet bootstrap-e2e-minion-group-wp6q} 2020-10-15 17:29:55 +0000 UTC 2020-10-15 17:29:55 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wp6q.163e3b9ab06ca565  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wp6q.163e3b9ab06ca565 34c0c292-8a5e-497d-bf2a-4e27a26122e5 13831 0 2020-10-15 17:47:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-15 17:47:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-wp6q bootstrap-e2e-minion-group-wp6q   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-wp6q} 2020-10-15 17:47:32 +0000 UTC 2020-10-15 17:47:32 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wp6q.163e3b9ab06cc7ba  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wp6q.163e3b9ab06cc7ba 801753d9-51de-46a6-a69f-4f498d418385 13830 0 2020-10-15 17:47:32 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-15 17:47:32 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-wp6q bootstrap-e2e-minion-group-wp6q   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-wp6q} 2020-10-15 17:47:32 +0000 UTC 2020-10-15 17:47:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]",
    }
    Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-nrn1.163e3b998b505649  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-nrn1.163e3b998b505649 80049882-8597-4485-9790-9e63c52566be 13827 0 2020-10-15 17:47:28 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-15 17:47:28 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-nrn1 bootstrap-e2e-minion-group-nrn1   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-nrn1} 2020-10-15 17:47:28 +0000 UTC 2020-10-15 17:47:28 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-nrn1.163e3b998b507a3f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-nrn1.163e3b998b507a3f a6671ca0-964a-4523-a402-d5fb2a476510 13826 0 2020-10-15 17:47:28 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-15 17:47:28 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-nrn1 bootstrap-e2e-minion-group-nrn1   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-nrn1} 2020-10-15 17:47:28 +0000 UTC 2020-10-15 17:47:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e34ca81cd2ca9  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e34ca81cd2ca9 55abad7d-b6a5-4ac5-8b2f-a4f7de85e0bd 12333 0 2020-10-15 17:02:11 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-15 17:12:28 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-r7pv} 2020-10-15 15:42:41 +0000 UTC 2020-10-15 17:12:28 +0000 UTC 4 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e3923b22a298c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e3923b22a298c 0d1acec9-bc39-4bc9-a1f6-f00f47c2fcd2 11964 0 2020-10-15 17:02:22 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:02:22 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:02:22 +0000 UTC 2020-10-15 17:02:22 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e3923bf000692  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e3923bf000692 49fde7cd-c746-4d6a-a097-3e512a077215 11965 0 2020-10-15 17:02:23 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:02:23 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-r7pv status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:02:23 +0000 UTC 2020-10-15 17:02:23 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e3923bf1146c1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e3923bf1146c1 6490a32b-65b8-4a1f-aad5-5d0946d8f5a9 11966 0 2020-10-15 17:02:23 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:02:23 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-r7pv status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:02:23 +0000 UTC 2020-10-15 17:02:23 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e3923bf1aaaef  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e3923bf1aaaef d43cebcd-714d-41e2-877c-bf8f4c2e5f7f 11967 0 2020-10-15 17:02:23 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:02:23 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-r7pv status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:02:23 +0000 UTC 2020-10-15 17:02:23 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e3923c5f82a3d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e3923c5f82a3d bdf25db2-eca3-4dfc-9030-6df2507dc988 11968 0 2020-10-15 17:02:23 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:02:23 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeNotReady Node bootstrap-e2e-minion-group-r7pv status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:02:23 +0000 UTC 2020-10-15 17:02:23 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e3923cffb10bf  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e3923cffb10bf 97872534-e2de-4eb0-9488-c9c53d3a0def 11969 0 2020-10-15 17:02:23 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:02:23 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:02:23 +0000 UTC 2020-10-15 17:02:23 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e3923d50d480b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e3923d50d480b d2fd3ad7-5dd4-4fda-8399-9e2cf3ae0055 11970 0 2020-10-15 17:02:23 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:02:23 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeReady Node bootstrap-e2e-minion-group-r7pv status is now: NodeReady {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:02:23 +0000 UTC 2020-10-15 17:02:23 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e39b017a6c3b4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e39b017a6c3b4 e9fb685a-5abc-4eae-8b22-07d8a62c0ccd 12332 0 2020-10-15 17:12:25 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-15 17:12:25 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv f4129af9-1a11-4a96-930f-dfdb179ff5ea v1  } NodeNotReady Node bootstrap-e2e-minion-group-r7pv status is now: NodeNotReady {node-controller } 2020-10-15 17:12:25 +0000 UTC 2020-10-15 17:12:25 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e39b0b387ffa8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e39b0b387ffa8 7a5f2e77-6efd-4f11-ac4b-103eba15c411 12334 0 2020-10-15 17:12:28 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:12:28 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:12:28 +0000 UTC 2020-10-15 17:12:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e39b0c1011d52  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e39b0c1011d52 5dcc9e99-b793-4c39-ba44-9f408ecda0f2 12338 0 2020-10-15 17:12:28 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:12:28 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-r7pv status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:12:28 +0000 UTC 2020-10-15 17:12:28 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e39b0c102a4ee  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e39b0c102a4ee 4ff83cdb-a9dc-4011-a871-f547ceb17398 12339 0 2020-10-15 17:12:28 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:12:28 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-r7pv status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:12:28 +0000 UTC 2020-10-15 17:12:28 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e39b0c103e28f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e39b0c103e28f 9765fa6e-8562-411b-af8b-487f40e6be24 12340 0 2020-10-15 17:12:28 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:12:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-r7pv status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:12:28 +0000 UTC 2020-10-15 17:12:28 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e39b0cfae8896  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e39b0cfae8896 19844bf8-9985-451a-ae07-65073106d569 12341 0 2020-10-15 17:12:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:12:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeNotReady Node bootstrap-e2e-minion-group-r7pv status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:12:28 +0000 UTC 2020-10-15 17:12:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e39b0dcc2491e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e39b0dcc2491e 5faf7179-aae8-403b-b45b-bd2dd56b82db 12342 0 2020-10-15 17:12:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:12:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:12:29 +0000 UTC 2020-10-15 17:12:29 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e39b0e2e60001  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e39b0e2e60001 66e9a8ea-a882-47dd-8383-8c3918afa095 12343 0 2020-10-15 17:12:29 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:12:29 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } NodeReady Node bootstrap-e2e-minion-group-r7pv status is now: NodeReady {kubelet bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:12:29 +0000 UTC 2020-10-15 17:12:29 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e3b9a1c0bc7e7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e3b9a1c0bc7e7 37f8c298-ae8e-4403-8ebb-71ccfab26070 13829 0 2020-10-15 17:47:30 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-15 17:47:30 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:47:30 +0000 UTC 2020-10-15 17:47:30 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r7pv.163e3b9a1c0c0428  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r7pv.163e3b9a1c0c0428 49f47761-fa32-4263-ac89-e8cd6dd6aa01 13828 0 2020-10-15 17:47:30 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-15 17:47:30 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-r7pv bootstrap-e2e-minion-group-r7pv   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-r7pv} 2020-10-15 17:47:30 +0000 UTC 2020-10-15 17:47:30 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wp6q.163e31040b1aace0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wp6q.163e31040b1aace0 5db1cbcc-a6a5-4462-8cf1-58f29b4cbc65 13213 0 2020-10-15 17:29:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{node-problem-detector Update v1 2020-10-15 17:29:54 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 44 34 102 58 104 111 115 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-wp6q bootstrap-e2e-minion-group-wp6q   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-wp6q} 2020-10-15 14:33:30 +0000 UTC 2020-10-15 17:29:54 +0000 UTC 4 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wp6q.163e3aa375e5536a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wp6q.163e3aa375e5536a ea74a5ba-4f93-47f4-a047-ebf77616c539 13212 0 2020-10-15 17:29:51 +0000 UTC <nil> <nil> map[] map[] [] []  [{kube-controller-manager Update v1 2020-10-15 17:29:51 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 97 112 105 86 101 114 115 105 111 110 34 58 123 125 44 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 58 99 111 109 112 111 110 101 110 116 34 58 123 125 125 44 34 102 58 116 121 112 101 34 58 123 125 125],}}]} {Node  bootstrap-e2e-minion-group-wp6q 6d01ac6e-348f-4367-ba4c-904e4e085c74 v1  } NodeNotReady Node bootstrap-e2e-minion-group-wp6q status is now: NodeNotReady {node-controller } 2020-10-15 17:29:51 +0000 UTC 2020-10-15 17:29:51 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wp6q.163e3aa4490dfbac  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wp6q.163e3aa4490dfbac 13e2313e-da8f-4cdd-8083-76c985f9e4b3 13214 0 2020-10-15 17:29:54 +0000 UTC <nil> <nil> map[] map[] [] []  [{kubelet Update v1 2020-10-15 17:29:54 +0000 UTC FieldsV1 &FieldsV1{Raw:*[123 34 102 58 99 111 117 110 116 34 58 123 125 44 34 102 58 102 105 114 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 105 110 118 111 108 118 101 100 79 98 106 101 99 116 34 58 123 34 102 58 107 105 110 100 34 58 123 125 44 34 102 58 110 97 109 101 34 58 123 125 44 34 102 58 117 105 100 34 58 123 125 125 44 34 102 58 108 97 115 116 84 105 109 101 115 116 97 109 112 34 58 123 125 44 34 102 58 109 101 115 115 97 103 101 34 58 123 125 44 34 102 58 114 101 97 115 111 110 34 58 123 125 44 34 102 58 115 111 117 114 99 101 34 58 123 34 102 5