This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 6 failed / 953 succeeded
Started2020-04-02 04:23
Elapsed15h10m
Revision
Builder983d224d-7499-11ea-9640-beab5e722989
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/5ad56a49-94ac-44f2-a356-5c2ed2a511e7/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/5ad56a49-94ac-44f2-a356-5c2ed2a511e7/targets/test
infra-commit32e3b5ce7
job-versionv1.16.9-beta.0.17+bb616cba1cc983
master_os_imagecos-77-12371-175-0
node_os_imagecos-73-11647-163-0
revisionv1.16.9-beta.0.17+bb616cba1cc983

Test Failures


Kubernetes e2e suite [k8s.io] [sig-cloud-provider-gcp] Upgrade [Feature:Upgrade] master upgrade should maintain a functioning cluster [Feature:MasterUpgrade] 17m44s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-cloud\-provider\-gcp\]\sUpgrade\s\[Feature\:Upgrade\]\smaster\supgrade\sshould\smaintain\sa\sfunctioning\scluster\s\[Feature\:MasterUpgrade\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:91
Apr  2 04:38:36.565: Unexpected error:
    <*errors.errorString | 0xc000705b70>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.22+ea3eeb494a528e]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-2qtd\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-r971\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-s4nz\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.22+ea3eeb494a528e/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n.......................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Upgrading the CoreDNS ConfigMap ==\\nconfigmap/coredns configured\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE     VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m55s   v1.17.5-beta.0.22+ea3eeb494a528e\\nbootstrap-e2e-minion-group-2qtd   Ready                      <none>   8m58s   v1.16.9-beta.0.17+bb616cba1cc983\\nbootstrap-e2e-minion-group-r971   Ready                      <none>   8m48s   v1.16.9-beta.0.17+bb616cba1cc983\\nbootstrap-e2e-minion-group-s4nz   Ready                      <none>   8m58s   v1.16.9-beta.0.17+bb616cba1cc983\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\ncontroller-manager   Healthy   ok                  \\nscheduler            Healthy   ok                  \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.5-beta.0.22+ea3eeb494a528e\\\"\\nname: \\\"bootstrap-e2e-minion-group-2qtd\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-r971\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-s4nz\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\n\", stderr \"Project: k8s-jkns-gce-1-4\\nNetwork Project: k8s-jkns-gce-1-4\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-r971 bootstrap-e2e-minion-group-s4nz\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 34.82.59.49; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-4/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-4/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP  STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   34.82.59.49  RUNNING\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: k8s-jkns-gce-1-4\\nNetwork Project: k8s-jkns-gce-1-4\\nZone: us-west1-b\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.22+ea3eeb494a528e]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-2qtd\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-r971\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-s4nz\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.22+ea3eeb494a528e/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n.......................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Upgrading the CoreDNS ConfigMap ==\nconfigmap/coredns configured\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE     VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m55s   v1.17.5-beta.0.22+ea3eeb494a528e\nbootstrap-e2e-minion-group-2qtd   Ready                      <none>   8m58s   v1.16.9-beta.0.17+bb616cba1cc983\nbootstrap-e2e-minion-group-r971   Ready                      <none>   8m48s   v1.16.9-beta.0.17+bb616cba1cc983\nbootstrap-e2e-minion-group-s4nz   Ready                      <none>   8m58s   v1.16.9-beta.0.17+bb616cba1cc983\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\netcd-0               Healthy   {\"health\":\"true\"}   \netcd-1               Healthy   {\"health\":\"true\"}   \ncontroller-manager   Healthy   ok                  \nscheduler            Healthy   ok                  \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.5-beta.0.22+ea3eeb494a528e\"\nname: \"bootstrap-e2e-minion-group-2qtd\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-r971\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-s4nz\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\n", stderr "Project: k8s-jkns-gce-1-4\nNetwork Project: k8s-jkns-gce-1-4\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-r971 bootstrap-e2e-minion-group-s4nz\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 34.82.59.49; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-4/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-4/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP  STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   34.82.59.49  RUNNING\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: k8s-jkns-gce-1-4\nNetwork Project: k8s-jkns-gce-1-4\nZone: us-west1-b\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:106
				
				Click to see stdout/stderrfrom junit_upgrade01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] [sig-node] NodeProblemDetector [DisabledForLargeClusters] should run without error 2m16s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sNodeProblemDetector\s\[DisabledForLargeClusters\]\sshould\srun\swithout\serror$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:58
Apr  2 07:39:17.091: Timed out after 60.001s.
Expected success, but got an error:
    <*errors.errorString | 0xc003f72f80>: {
        s: "Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-2qtd.1601e650cadd9441  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601e650cadd9441 81a87889-9821-432e-a380-27f402ec0f8e 8526 0 2020-04-02 04:29:38 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-2qtd} 2020-04-02 04:29:38 +0000 UTC 2020-04-02 07:04:04 +0000 UTC 10 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eb0aca86e816  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eb0aca86e816 93d12e91-3fe0-4af1-bad8-0115c0a8347c 8605 0 2020-04-02 05:56:15 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bc5de441-6029-44d4-8c3f-4ca1869a4d08   } NodeNotReady Node bootstrap-e2e-minion-group-2qtd status is now: NodeNotReady {node-controller } 2020-04-02 05:56:15 +0000 UTC 2020-04-02 07:07:46 +0000 UTC 5 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601ed861dac95ed  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601ed861dac95ed fca5be17-11c8-4916-b43f-ffa8e75ae4a6 5513 0 2020-04-02 06:41:44 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:41:44 +0000 UTC 2020-04-02 06:41:44 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601ed862aa31dee  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601ed862aa31dee 62ac84d4-74fb-47cf-ba2b-43882b158d40 5517 0 2020-04-02 06:41:44 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:41:44 +0000 UTC 2020-04-02 06:41:44 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601ed862aa35ddd  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601ed862aa35ddd 13b35461-5fd9-4cdc-860e-751eac69ff10 5519 0 2020-04-02 06:41:44 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:41:44 +0000 UTC 2020-04-02 06:41:44 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601ed862aa3bfd8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601ed862aa3bfd8 cc3c6865-5dd9-431b-81ae-b2cf66f83069 5520 0 2020-04-02 06:41:44 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:41:44 +0000 UTC 2020-04-02 06:41:44 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601ed8630f0b429  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601ed8630f0b429 c85f3873-d3b1-463a-853d-a20ec886ac19 5518 0 2020-04-02 06:41:44 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeNotReady Node bootstrap-e2e-minion-group-2qtd status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:41:44 +0000 UTC 2020-04-02 06:41:44 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601ed8646ebcfe2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601ed8646ebcfe2 ff23abc2-5e13-46df-b20e-67eaef04d6a7 5521 0 2020-04-02 06:41:44 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:41:44 +0000 UTC 2020-04-02 06:41:44 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601ed864b5285a6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601ed864b5285a6 4dc71194-fdc2-4cf6-875f-d88958325c68 5522 0 2020-04-02 06:41:44 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeReady Node bootstrap-e2e-minion-group-2qtd status is now: NodeReady {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:41:44 +0000 UTC 2020-04-02 06:41:44 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edac4897f618  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edac4897f618 d5a853d1-4e5a-4873-87fb-82c76314861f 5681 0 2020-04-02 06:44:28 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:44:28 +0000 UTC 2020-04-02 06:44:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edac53ee4251  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edac53ee4251 8a56f7f2-f17f-4107-a0a2-65bad94beb4e 5682 0 2020-04-02 06:44:28 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:44:28 +0000 UTC 2020-04-02 06:44:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edac54d85bbd  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edac54d85bbd 25a0011a-cae9-4891-bf9d-b83c6003584a 5683 0 2020-04-02 06:44:28 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:44:28 +0000 UTC 2020-04-02 06:44:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edac54df8aac  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edac54df8aac 6ad31f37-2bbf-4d40-b51e-b93603edf766 5684 0 2020-04-02 06:44:28 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:44:28 +0000 UTC 2020-04-02 06:44:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edac588bf143  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edac588bf143 1f14c983-50d0-4ff8-a6f6-f6091afc2c87 5685 0 2020-04-02 06:44:28 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeNotReady Node bootstrap-e2e-minion-group-2qtd status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:44:28 +0000 UTC 2020-04-02 06:44:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edac7c241a8a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edac7c241a8a 5e72726b-1565-4447-9426-136344711950 5686 0 2020-04-02 06:44:28 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:44:28 +0000 UTC 2020-04-02 06:44:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edac7fd5864a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edac7fd5864a 535f7810-a935-4563-be44-f83f6bcdc73f 5687 0 2020-04-02 06:44:28 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeReady Node bootstrap-e2e-minion-group-2qtd status is now: NodeReady {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:44:28 +0000 UTC 2020-04-02 06:44:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edd0aeb42f6f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edd0aeb42f6f a118dacd-fad8-48f8-b255-595558ac05f9 5753 0 2020-04-02 06:47:04 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:47:04 +0000 UTC 2020-04-02 06:47:04 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edd0b9544c1d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edd0b9544c1d eb530168-1127-49e3-a167-6cfe527c287a 5757 0 2020-04-02 06:47:04 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:47:04 +0000 UTC 2020-04-02 06:47:04 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edd0b9548a7f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edd0b9548a7f 8846b7da-3588-4e66-b72a-b96307c67b1b 5758 0 2020-04-02 06:47:04 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:47:04 +0000 UTC 2020-04-02 06:47:04 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edd0b954bcfa  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edd0b954bcfa 280d5ac1-c0ab-4d00-8039-67499881d95c 5759 0 2020-04-02 06:47:04 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:47:04 +0000 UTC 2020-04-02 06:47:04 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edd0bc85d168  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edd0bc85d168 f4a20b46-db80-47db-99b5-8e761a4128b6 5760 0 2020-04-02 06:47:04 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeNotReady Node bootstrap-e2e-minion-group-2qtd status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:47:04 +0000 UTC 2020-04-02 06:47:04 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edd0dd2e18f0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edd0dd2e18f0 d1df2cde-bda8-46be-8adb-fc53bea491ae 5761 0 2020-04-02 06:47:05 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:47:05 +0000 UTC 2020-04-02 06:47:05 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edd0e2ab0cf4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edd0e2ab0cf4 34209374-8f6b-4e45-b251-8793e89b1340 5762 0 2020-04-02 06:47:05 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeReady Node bootstrap-e2e-minion-group-2qtd status is now: NodeReady {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:47:05 +0000 UTC 2020-04-02 06:47:05 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eebe51d3ebed  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eebe51d3ebed 9ff56e35-f501-4de8-9f4b-91b9ec456b34 8527 0 2020-04-02 07:04:05 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 07:04:04 +0000 UTC 2020-04-02 07:04:04 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eebe5e17688b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eebe5e17688b 773a4ad9-f792-44af-84e0-d13497e8fcf1 8532 0 2020-04-02 07:04:05 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 07:04:05 +0000 UTC 2020-04-02 07:04:05 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eebe5e17e7d4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eebe5e17e7d4 64fc0961-a549-4079-b135-2d7dd3598290 8533 0 2020-04-02 07:04:05 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 07:04:05 +0000 UTC 2020-04-02 07:04:05 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eebe5e181d01  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eebe5e181d01 1af69f30-4c8c-4496-b16d-136b47f158cf 8534 0 2020-04-02 07:04:05 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 07:04:05 +0000 UTC 2020-04-02 07:04:05 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eebe6101fc37  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eebe6101fc37 b8649cb4-9e41-4000-95a5-7331c7a20391 8531 0 2020-04-02 07:04:05 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeNotReady Node bootstrap-e2e-minion-group-2qtd status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 07:04:05 +0000 UTC 2020-04-02 07:04:05 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eebe87c77c64  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eebe87c77c64 4e8ba355-2c7c-4adc-b10d-ca1c0bb3fe06 8535 0 2020-04-02 07:04:05 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 07:04:05 +0000 UTC 2020-04-02 07:04:05 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eebe8b65b8dc  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eebe8b65b8dc 27545779-b99a-4578-8457-7c0c67fc02c7 8536 0 2020-04-02 07:04:05 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeReady Node bootstrap-e2e-minion-group-2qtd status is now: NodeReady {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 07:04:05 +0000 UTC 2020-04-02 07:04:05 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eef252890a8c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eef252890a8c b86ff641-9b34-4176-ac3a-e8aebc1ceca8 8606 0 2020-04-02 07:07:48 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bc5de441-6029-44d4-8c3f-4ca1869a4d08   } Deleting node bootstrap-e2e-minion-group-2qtd because it does not exist in the cloud provider Node bootstrap-e2e-minion-group-2qtd event: DeletingNode {cloud-node-lifecycle-controller } 2020-04-02 07:07:48 +0000 UTC 2020-04-02 07:07:48 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eef309996ae4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eef309996ae4 8845996f-43c8-45db-9009-a06e43a50731 8607 0 2020-04-02 07:07:51 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bc5de441-6029-44d4-8c3f-4ca1869a4d08   } RemovingNode Node bootstrap-e2e-minion-group-2qtd event: Removing Node bootstrap-e2e-minion-group-2qtd from Controller {node-controller } 2020-04-02 07:07:51 +0000 UTC 2020-04-02 07:07:51 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eedf17c72d4a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eedf17c72d4a 6172a594-3720-4235-9b81-0a1013777f20 8561 0 2020-04-02 07:06:25 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:25 +0000 UTC 2020-04-02 07:06:25 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eedf1ff5b578  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eedf1ff5b578 59106f84-b361-478b-b70f-2f7b312b2335 8562 0 2020-04-02 07:06:25 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-4tbc status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:25 +0000 UTC 2020-04-02 07:06:25 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eedf1ffa961b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eedf1ffa961b 9e2c64fd-e10b-4191-9665-c4809ce892a7 8563 0 2020-04-02 07:06:25 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-4tbc status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:25 +0000 UTC 2020-04-02 07:06:25 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eedf1ffeac17  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eedf1ffeac17 36f1fbb9-a05b-45c0-8f14-d015dc0af8cc 8564 0 2020-04-02 07:06:25 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-4tbc status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:25 +0000 UTC 2020-04-02 07:06:25 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eedf2404ac35  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eedf2404ac35 8a22d0e2-3587-4f69-b56a-66721b6be374 8567 0 2020-04-02 07:06:26 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:25 +0000 UTC 2020-04-02 07:06:25 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eedf26cb204a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eedf26cb204a 24da51d5-966f-4c0c-b710-2b3aa3480a66 8569 0 2020-04-02 07:06:26 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeReady Node bootstrap-e2e-minion-group-4tbc status is now: NodeReady {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:26 +0000 UTC 2020-04-02 07:06:26 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eedf395eaf8c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eedf395eaf8c 7b17df70-fdd3-4b1e-8656-e9ea42608fca 8571 0 2020-04-02 07:06:26 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc ad451165-54b7-4150-8e37-bae59ec7deca   } RegisteredNode Node bootstrap-e2e-minion-group-4tbc event: Registered Node bootstrap-e2e-minion-group-4tbc in Controller {node-controller } 2020-04-02 07:06:26 +0000 UTC 2020-04-02 07:06:26 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eedf9c7a34e2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eedf9c7a34e2 0c389fa9-8104-444a-8038-595e84259d73 8576 0 2020-04-02 07:06:27 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } Starting Starting kube-proxy. {kube-proxy bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:27 +0000 UTC 2020-04-02 07:06:27 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eee001e58443  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eee001e58443 46638cf4-d7a7-46f2-bff3-c6060a6b1fac 8578 0 2020-04-02 07:06:29 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } ContainerdStart Starting containerd container runtime... {systemd-monitor bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:29 +0000 UTC 2020-04-02 07:06:29 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eee002e8975c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eee002e8975c a9ac92a8-7723-4141-8710-0820758e9942 8580 0 2020-04-02 07:06:29 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } DockerStart Starting Docker Application Container Engine... {systemd-monitor bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:29 +0000 UTC 2020-04-02 07:06:29 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eee0053649fa  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eee0053649fa a95fba1a-c06c-40c5-b0c4-727fcd7c15d4 9164 0 2020-04-02 07:06:29 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:29 +0000 UTC 2020-04-02 07:22:41 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601efc24313b771  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601efc24313b771 a2fcbc1b-3ed2-4e62-b316-7f104c4383d3 9165 0 2020-04-02 07:22:41 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:22:41 +0000 UTC 2020-04-02 07:22:41 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601efc24d62167a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601efc24d62167a dcaf227c-4cf0-4527-ad18-1cc1afaf5734 9166 0 2020-04-02 07:22:41 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-4tbc status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:22:41 +0000 UTC 2020-04-02 07:22:41 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601efc24d6254be  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601efc24d6254be 05744666-c8cd-4198-a439-eee4eb85d454 9167 0 2020-04-02 07:22:41 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-4tbc status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:22:41 +0000 UTC 2020-04-02 07:22:41 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601efc24d628db8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601efc24d628db8 7b759aa0-eddf-4f0c-a655-a8f016d4cc28 9168 0 2020-04-02 07:22:41 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-4tbc status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:22:41 +0000 UTC 2020-04-02 07:22:41 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601efc25145926c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601efc25145926c 39e4e58c-5550-4774-9d52-582df2118c7f 9169 0 2020-04-02 07:22:41 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeNotReady Node bootstrap-e2e-minion-group-4tbc status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:22:41 +0000 UTC 2020-04-02 07:22:41 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601efc27284da22  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601efc27284da22 bf7a30c2-c216-4b93-acfe-5b81736fd6d2 9170 0 2020-04-02 07:22:42 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:22:42 +0000 UTC 2020-04-02 07:22:42 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601efc2749d3ea2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601efc2749d3ea2 0b1364a6-9db3-498e-bea6-b0012f4e11d7 9171 0 2020-04-02 07:22:42 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeReady Node bootstrap-e2e-minion-group-4tbc status is now: NodeReady {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:22:42 +0000 UTC 2020-04-02 07:22:42 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601f09ae9cbc4c0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601f09ae9cbc4c0 c8cd2ff3-467d-4fb9-8e75-438d7c5fad29 9460 0 2020-04-02 07:38:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:38:11 +0000 UTC 2020-04-02 07:38:11 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601f09ae9cbe439  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601f09ae9cbe439 00a417d8-af9e-46d8-99f8-3153e9599d43 9459 0 2020-04-02 07:38:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:38:11 +0000 UTC 2020-04-02 07:38:11 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r971.1601f09b7b823931  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r971.1601f09b7b823931 1c145bc9-c276-42dc-9de1-5ecd17a4244a 9462 0 2020-04-02 07:38:14 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-r971 bootstrap-e2e-minion-group-r971   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-r971} 2020-04-02 07:38:14 +0000 UTC 2020-04-02 07:38:14 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r971.1601f09b7b825efd  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r971.1601f09b7b825efd fb5c0c74-775c-4cc0-8f1a-15e2d448ae92 9461 0 2020-04-02 07:38:14 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-r971 bootstrap-e2e-minion-group-r971   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-r971} 2020-04-02 07:38:14 +0000 UTC 2020-04-02 07:38:14 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-s4nz.1601f09c0e80be3d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-s4nz.1601f09c0e80be3d 81421964-ef55-4755-9c3e-b2942aa70924 9464 0 2020-04-02 07:38:16 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-s4nz bootstrap-e2e-minion-group-s4nz   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-s4nz} 2020-04-02 07:38:16 +0000 UTC 2020-04-02 07:38:16 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-s4nz.1601f09c0e80dec8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-s4nz.1601f09c0e80dec8 5123c398-25bb-4734-8b97-f73d2f3ae99f 9463 0 2020-04-02 07:38:16 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-s4nz bootstrap-e2e-minion-group-s4nz   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-s4nz} 2020-04-02 07:38:16 +0000 UTC 2020-04-02 07:38:16 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]",
    }
    Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-2qtd.1601e650cadd9441  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601e650cadd9441 81a87889-9821-432e-a380-27f402ec0f8e 8526 0 2020-04-02 04:29:38 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-2qtd} 2020-04-02 04:29:38 +0000 UTC 2020-04-02 07:04:04 +0000 UTC 10 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eb0aca86e816  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eb0aca86e816 93d12e91-3fe0-4af1-bad8-0115c0a8347c 8605 0 2020-04-02 05:56:15 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bc5de441-6029-44d4-8c3f-4ca1869a4d08   } NodeNotReady Node bootstrap-e2e-minion-group-2qtd status is now: NodeNotReady {node-controller } 2020-04-02 05:56:15 +0000 UTC 2020-04-02 07:07:46 +0000 UTC 5 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601ed861dac95ed  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601ed861dac95ed fca5be17-11c8-4916-b43f-ffa8e75ae4a6 5513 0 2020-04-02 06:41:44 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:41:44 +0000 UTC 2020-04-02 06:41:44 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601ed862aa31dee  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601ed862aa31dee 62ac84d4-74fb-47cf-ba2b-43882b158d40 5517 0 2020-04-02 06:41:44 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:41:44 +0000 UTC 2020-04-02 06:41:44 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601ed862aa35ddd  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601ed862aa35ddd 13b35461-5fd9-4cdc-860e-751eac69ff10 5519 0 2020-04-02 06:41:44 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:41:44 +0000 UTC 2020-04-02 06:41:44 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601ed862aa3bfd8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601ed862aa3bfd8 cc3c6865-5dd9-431b-81ae-b2cf66f83069 5520 0 2020-04-02 06:41:44 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:41:44 +0000 UTC 2020-04-02 06:41:44 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601ed8630f0b429  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601ed8630f0b429 c85f3873-d3b1-463a-853d-a20ec886ac19 5518 0 2020-04-02 06:41:44 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeNotReady Node bootstrap-e2e-minion-group-2qtd status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:41:44 +0000 UTC 2020-04-02 06:41:44 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601ed8646ebcfe2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601ed8646ebcfe2 ff23abc2-5e13-46df-b20e-67eaef04d6a7 5521 0 2020-04-02 06:41:44 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:41:44 +0000 UTC 2020-04-02 06:41:44 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601ed864b5285a6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601ed864b5285a6 4dc71194-fdc2-4cf6-875f-d88958325c68 5522 0 2020-04-02 06:41:44 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeReady Node bootstrap-e2e-minion-group-2qtd status is now: NodeReady {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:41:44 +0000 UTC 2020-04-02 06:41:44 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edac4897f618  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edac4897f618 d5a853d1-4e5a-4873-87fb-82c76314861f 5681 0 2020-04-02 06:44:28 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:44:28 +0000 UTC 2020-04-02 06:44:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edac53ee4251  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edac53ee4251 8a56f7f2-f17f-4107-a0a2-65bad94beb4e 5682 0 2020-04-02 06:44:28 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:44:28 +0000 UTC 2020-04-02 06:44:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edac54d85bbd  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edac54d85bbd 25a0011a-cae9-4891-bf9d-b83c6003584a 5683 0 2020-04-02 06:44:28 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:44:28 +0000 UTC 2020-04-02 06:44:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edac54df8aac  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edac54df8aac 6ad31f37-2bbf-4d40-b51e-b93603edf766 5684 0 2020-04-02 06:44:28 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:44:28 +0000 UTC 2020-04-02 06:44:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edac588bf143  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edac588bf143 1f14c983-50d0-4ff8-a6f6-f6091afc2c87 5685 0 2020-04-02 06:44:28 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeNotReady Node bootstrap-e2e-minion-group-2qtd status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:44:28 +0000 UTC 2020-04-02 06:44:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edac7c241a8a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edac7c241a8a 5e72726b-1565-4447-9426-136344711950 5686 0 2020-04-02 06:44:28 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:44:28 +0000 UTC 2020-04-02 06:44:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edac7fd5864a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edac7fd5864a 535f7810-a935-4563-be44-f83f6bcdc73f 5687 0 2020-04-02 06:44:28 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeReady Node bootstrap-e2e-minion-group-2qtd status is now: NodeReady {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:44:28 +0000 UTC 2020-04-02 06:44:28 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edd0aeb42f6f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edd0aeb42f6f a118dacd-fad8-48f8-b255-595558ac05f9 5753 0 2020-04-02 06:47:04 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:47:04 +0000 UTC 2020-04-02 06:47:04 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edd0b9544c1d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edd0b9544c1d eb530168-1127-49e3-a167-6cfe527c287a 5757 0 2020-04-02 06:47:04 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:47:04 +0000 UTC 2020-04-02 06:47:04 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edd0b9548a7f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edd0b9548a7f 8846b7da-3588-4e66-b72a-b96307c67b1b 5758 0 2020-04-02 06:47:04 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:47:04 +0000 UTC 2020-04-02 06:47:04 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edd0b954bcfa  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edd0b954bcfa 280d5ac1-c0ab-4d00-8039-67499881d95c 5759 0 2020-04-02 06:47:04 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:47:04 +0000 UTC 2020-04-02 06:47:04 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edd0bc85d168  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edd0bc85d168 f4a20b46-db80-47db-99b5-8e761a4128b6 5760 0 2020-04-02 06:47:04 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeNotReady Node bootstrap-e2e-minion-group-2qtd status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:47:04 +0000 UTC 2020-04-02 06:47:04 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edd0dd2e18f0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edd0dd2e18f0 d1df2cde-bda8-46be-8adb-fc53bea491ae 5761 0 2020-04-02 06:47:05 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:47:05 +0000 UTC 2020-04-02 06:47:05 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601edd0e2ab0cf4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601edd0e2ab0cf4 34209374-8f6b-4e45-b251-8793e89b1340 5762 0 2020-04-02 06:47:05 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeReady Node bootstrap-e2e-minion-group-2qtd status is now: NodeReady {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 06:47:05 +0000 UTC 2020-04-02 06:47:05 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eebe51d3ebed  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eebe51d3ebed 9ff56e35-f501-4de8-9f4b-91b9ec456b34 8527 0 2020-04-02 07:04:05 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 07:04:04 +0000 UTC 2020-04-02 07:04:04 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eebe5e17688b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eebe5e17688b 773a4ad9-f792-44af-84e0-d13497e8fcf1 8532 0 2020-04-02 07:04:05 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 07:04:05 +0000 UTC 2020-04-02 07:04:05 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eebe5e17e7d4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eebe5e17e7d4 64fc0961-a549-4079-b135-2d7dd3598290 8533 0 2020-04-02 07:04:05 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 07:04:05 +0000 UTC 2020-04-02 07:04:05 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eebe5e181d01  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eebe5e181d01 1af69f30-4c8c-4496-b16d-136b47f158cf 8534 0 2020-04-02 07:04:05 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-2qtd status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 07:04:05 +0000 UTC 2020-04-02 07:04:05 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eebe6101fc37  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eebe6101fc37 b8649cb4-9e41-4000-95a5-7331c7a20391 8531 0 2020-04-02 07:04:05 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeNotReady Node bootstrap-e2e-minion-group-2qtd status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 07:04:05 +0000 UTC 2020-04-02 07:04:05 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eebe87c77c64  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eebe87c77c64 4e8ba355-2c7c-4adc-b10d-ca1c0bb3fe06 8535 0 2020-04-02 07:04:05 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 07:04:05 +0000 UTC 2020-04-02 07:04:05 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eebe8b65b8dc  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eebe8b65b8dc 27545779-b99a-4578-8457-7c0c67fc02c7 8536 0 2020-04-02 07:04:05 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-2qtd   } NodeReady Node bootstrap-e2e-minion-group-2qtd status is now: NodeReady {kubelet bootstrap-e2e-minion-group-2qtd} 2020-04-02 07:04:05 +0000 UTC 2020-04-02 07:04:05 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eef252890a8c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eef252890a8c b86ff641-9b34-4176-ac3a-e8aebc1ceca8 8606 0 2020-04-02 07:07:48 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bc5de441-6029-44d4-8c3f-4ca1869a4d08   } Deleting node bootstrap-e2e-minion-group-2qtd because it does not exist in the cloud provider Node bootstrap-e2e-minion-group-2qtd event: DeletingNode {cloud-node-lifecycle-controller } 2020-04-02 07:07:48 +0000 UTC 2020-04-02 07:07:48 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-2qtd.1601eef309996ae4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-2qtd.1601eef309996ae4 8845996f-43c8-45db-9009-a06e43a50731 8607 0 2020-04-02 07:07:51 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-2qtd bc5de441-6029-44d4-8c3f-4ca1869a4d08   } RemovingNode Node bootstrap-e2e-minion-group-2qtd event: Removing Node bootstrap-e2e-minion-group-2qtd from Controller {node-controller } 2020-04-02 07:07:51 +0000 UTC 2020-04-02 07:07:51 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eedf17c72d4a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eedf17c72d4a 6172a594-3720-4235-9b81-0a1013777f20 8561 0 2020-04-02 07:06:25 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:25 +0000 UTC 2020-04-02 07:06:25 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eedf1ff5b578  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eedf1ff5b578 59106f84-b361-478b-b70f-2f7b312b2335 8562 0 2020-04-02 07:06:25 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-4tbc status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:25 +0000 UTC 2020-04-02 07:06:25 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eedf1ffa961b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eedf1ffa961b 9e2c64fd-e10b-4191-9665-c4809ce892a7 8563 0 2020-04-02 07:06:25 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-4tbc status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:25 +0000 UTC 2020-04-02 07:06:25 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eedf1ffeac17  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eedf1ffeac17 36f1fbb9-a05b-45c0-8f14-d015dc0af8cc 8564 0 2020-04-02 07:06:25 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-4tbc status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:25 +0000 UTC 2020-04-02 07:06:25 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eedf2404ac35  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eedf2404ac35 8a22d0e2-3587-4f69-b56a-66721b6be374 8567 0 2020-04-02 07:06:26 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:25 +0000 UTC 2020-04-02 07:06:25 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eedf26cb204a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eedf26cb204a 24da51d5-966f-4c0c-b710-2b3aa3480a66 8569 0 2020-04-02 07:06:26 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeReady Node bootstrap-e2e-minion-group-4tbc status is now: NodeReady {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:26 +0000 UTC 2020-04-02 07:06:26 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eedf395eaf8c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eedf395eaf8c 7b17df70-fdd3-4b1e-8656-e9ea42608fca 8571 0 2020-04-02 07:06:26 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc ad451165-54b7-4150-8e37-bae59ec7deca   } RegisteredNode Node bootstrap-e2e-minion-group-4tbc event: Registered Node bootstrap-e2e-minion-group-4tbc in Controller {node-controller } 2020-04-02 07:06:26 +0000 UTC 2020-04-02 07:06:26 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eedf9c7a34e2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eedf9c7a34e2 0c389fa9-8104-444a-8038-595e84259d73 8576 0 2020-04-02 07:06:27 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } Starting Starting kube-proxy. {kube-proxy bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:27 +0000 UTC 2020-04-02 07:06:27 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eee001e58443  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eee001e58443 46638cf4-d7a7-46f2-bff3-c6060a6b1fac 8578 0 2020-04-02 07:06:29 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } ContainerdStart Starting containerd container runtime... {systemd-monitor bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:29 +0000 UTC 2020-04-02 07:06:29 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eee002e8975c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eee002e8975c a9ac92a8-7723-4141-8710-0820758e9942 8580 0 2020-04-02 07:06:29 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } DockerStart Starting Docker Application Container Engine... {systemd-monitor bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:29 +0000 UTC 2020-04-02 07:06:29 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601eee0053649fa  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601eee0053649fa a95fba1a-c06c-40c5-b0c4-727fcd7c15d4 9164 0 2020-04-02 07:06:29 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:06:29 +0000 UTC 2020-04-02 07:22:41 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601efc24313b771  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601efc24313b771 a2fcbc1b-3ed2-4e62-b316-7f104c4383d3 9165 0 2020-04-02 07:22:41 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:22:41 +0000 UTC 2020-04-02 07:22:41 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601efc24d62167a  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601efc24d62167a dcaf227c-4cf0-4527-ad18-1cc1afaf5734 9166 0 2020-04-02 07:22:41 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-4tbc status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:22:41 +0000 UTC 2020-04-02 07:22:41 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601efc24d6254be  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601efc24d6254be 05744666-c8cd-4198-a439-eee4eb85d454 9167 0 2020-04-02 07:22:41 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-4tbc status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:22:41 +0000 UTC 2020-04-02 07:22:41 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601efc24d628db8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601efc24d628db8 7b759aa0-eddf-4f0c-a655-a8f016d4cc28 9168 0 2020-04-02 07:22:41 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-4tbc status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:22:41 +0000 UTC 2020-04-02 07:22:41 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601efc25145926c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601efc25145926c 39e4e58c-5550-4774-9d52-582df2118c7f 9169 0 2020-04-02 07:22:41 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeNotReady Node bootstrap-e2e-minion-group-4tbc status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:22:41 +0000 UTC 2020-04-02 07:22:41 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601efc27284da22  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601efc27284da22 bf7a30c2-c216-4b93-acfe-5b81736fd6d2 9170 0 2020-04-02 07:22:42 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:22:42 +0000 UTC 2020-04-02 07:22:42 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601efc2749d3ea2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601efc2749d3ea2 0b1364a6-9db3-498e-bea6-b0012f4e11d7 9171 0 2020-04-02 07:22:42 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } NodeReady Node bootstrap-e2e-minion-group-4tbc status is now: NodeReady {kubelet bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:22:42 +0000 UTC 2020-04-02 07:22:42 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601f09ae9cbc4c0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601f09ae9cbc4c0 c8cd2ff3-467d-4fb9-8e75-438d7c5fad29 9460 0 2020-04-02 07:38:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:38:11 +0000 UTC 2020-04-02 07:38:11 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-4tbc.1601f09ae9cbe439  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-4tbc.1601f09ae9cbe439 00a417d8-af9e-46d8-99f8-3153e9599d43 9459 0 2020-04-02 07:38:11 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-4tbc bootstrap-e2e-minion-group-4tbc   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-4tbc} 2020-04-02 07:38:11 +0000 UTC 2020-04-02 07:38:11 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r971.1601f09b7b823931  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r971.1601f09b7b823931 1c145bc9-c276-42dc-9de1-5ecd17a4244a 9462 0 2020-04-02 07:38:14 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-r971 bootstrap-e2e-minion-group-r971   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-r971} 2020-04-02 07:38:14 +0000 UTC 2020-04-02 07:38:14 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-r971.1601f09b7b825efd  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-r971.1601f09b7b825efd fb5c0c74-775c-4cc0-8f1a-15e2d448ae92 9461 0 2020-04-02 07:38:14 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-r971 bootstrap-e2e-minion-group-r971   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-r971} 2020-04-02 07:38:14 +0000 UTC 2020-04-02 07:38:14 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-s4nz.1601f09c0e80be3d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-s4nz.1601f09c0e80be3d 81421964-ef55-4755-9c3e-b2942aa70924 9464 0 2020-04-02 07:38:16 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-s4nz bootstrap-e2e-minion-group-s4nz   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-s4nz} 2020-04-02 07:38:16 +0000 UTC 2020-04-02 07:38:16 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-s4nz.1601f09c0e80dec8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-s4nz.1601f09c0e80dec8 5123c398-25bb-4734-8b97-f73d2f3ae99f 9463 0 2020-04-02 07:38:16 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-s4nz bootstrap-e2e-minion-group-s4nz   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-s4nz} 2020-04-02 07:38:16 +0000 UTC 2020-04-02 07:38:16 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:141
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-cloud-provider-gcp] master-upgrade 4m34s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-cloud\-provider\-gcp\]\smaster\-upgrade$'
Apr  2 04:38:36.565: Unexpected error:
    <*errors.errorString | 0xc000705b70>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.22+ea3eeb494a528e]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-2qtd\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-r971\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-s4nz\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.22+ea3eeb494a528e/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n.......................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Upgrading the CoreDNS ConfigMap ==\\nconfigmap/coredns configured\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE     VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m55s   v1.17.5-beta.0.22+ea3eeb494a528e\\nbootstrap-e2e-minion-group-2qtd   Ready                      <none>   8m58s   v1.16.9-beta.0.17+bb616cba1cc983\\nbootstrap-e2e-minion-group-r971   Ready                      <none>   8m48s   v1.16.9-beta.0.17+bb616cba1cc983\\nbootstrap-e2e-minion-group-s4nz   Ready                      <none>   8m58s   v1.16.9-beta.0.17+bb616cba1cc983\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\ncontroller-manager   Healthy   ok                  \\nscheduler            Healthy   ok                  \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.5-beta.0.22+ea3eeb494a528e\\\"\\nname: \\\"bootstrap-e2e-minion-group-2qtd\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-r971\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-s4nz\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\n\", stderr \"Project: k8s-jkns-gce-1-4\\nNetwork Project: k8s-jkns-gce-1-4\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-r971 bootstrap-e2e-minion-group-s4nz\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 34.82.59.49; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-4/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-4/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP  STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   34.82.59.49  RUNNING\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: k8s-jkns-gce-1-4\\nNetwork Project: k8s-jkns-gce-1-4\\nZone: us-west1-b\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.22+ea3eeb494a528e]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-2qtd\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-r971\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-s4nz\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.22+ea3eeb494a528e/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n.......................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Upgrading the CoreDNS ConfigMap ==\nconfigmap/coredns configured\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE     VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m55s   v1.17.5-beta.0.22+ea3eeb494a528e\nbootstrap-e2e-minion-group-2qtd   Ready                      <none>   8m58s   v1.16.9-beta.0.17+bb616cba1cc983\nbootstrap-e2e-minion-group-r971   Ready                      <none>   8m48s   v1.16.9-beta.0.17+bb616cba1cc983\nbootstrap-e2e-minion-group-s4nz   Ready                      <none>   8m58s   v1.16.9-beta.0.17+bb616cba1cc983\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\netcd-0               Healthy   {\"health\":\"true\"}   \netcd-1               Healthy   {\"health\":\"true\"}   \ncontroller-manager   Healthy   ok                  \nscheduler            Healthy   ok                  \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.5-beta.0.22+ea3eeb494a528e\"\nname: \"bootstrap-e2e-minion-group-2qtd\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-r971\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-s4nz\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\n", stderr "Project: k8s-jkns-gce-1-4\nNetwork Project: k8s-jkns-gce-1-4\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-2qtd bootstrap-e2e-minion-group-r971 bootstrap-e2e-minion-group-s4nz\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 34.82.59.49; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-4/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gce-1-4/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP  STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   34.82.59.49  RUNNING\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: k8s-jkns-gce-1-4\nNetwork Project: k8s-jkns-gce-1-4\nZone: us-west1-b\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred

k8s.io/kubernetes/test/e2e/cloud/gcp.glob..func2.1.1.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:106 +0x12c
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do(0xc0028c1200)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:111 +0x38a
k8s.io/kubernetes/test/e2e/cloud/gcp.runUpgradeSuite(0xc000c5e140, 0x7757ca0, 0xc, 0xc, 0xc0006c3f20, 0xc000e26000, 0x0, 0xc00139e020)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:479 +0x47a
k8s.io/kubernetes/test/e2e/cloud/gcp.glob..func2.1.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:109 +0x222
k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0002f6400)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:110 +0x30a
k8s.io/kubernetes/test/e2e.TestE2E(0xc0002f6400)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:112 +0x2b
testing.tRunner(0xc0002f6400, 0x49f96a0)
	/usr/local/go/src/testing/testing.go:909 +0xc9
created by testing.(*T).Run
	/usr/local/go/src/testing/testing.go:960 +0x350
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Test 14h35m

error during ./hack/ginkgo-e2e.sh --kubectl-path=../../../../kubernetes_skew/cluster/kubectl.sh --minStartupPods=8 --report-dir=/workspace/_artifacts --disable-log-dump=true (interrupted): exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Timeout 15h0m

kubetest --timeout triggered
				from junit_runner.xml

Filter through log files | View test history on testgrid


UpgradeTest 18m3s

error during kubetest --test --test_args=--ginkgo.focus=\[Feature:MasterUpgrade\] --upgrade-target=ci/k8s-stable1 --report-dir=/workspace/_artifacts --disable-log-dump=true --report-prefix=upgrade --check-version-skew=false: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 953 Passed Tests