This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 6 failed / 939 succeeded
Started2020-03-25 16:52
Elapsed15h13m
Revision
Buildere7a8b635-6eb8-11ea-80f4-d2b8db82001b
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/d3dd5bb0-e3a8-4d0f-8d5b-220c1302259a/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/d3dd5bb0-e3a8-4d0f-8d5b-220c1302259a/targets/test
infra-commitf22b8e515
job-versionv1.16.9-beta.0.11+1e06e869a4a653
master_os_imagecos-77-12371-175-0
node_os_imagecos-73-11647-163-0
revisionv1.16.9-beta.0.11+1e06e869a4a653

Test Failures


Kubernetes e2e suite [k8s.io] [sig-cloud-provider-gcp] Upgrade [Feature:Upgrade] master upgrade should maintain a functioning cluster [Feature:MasterUpgrade] 18m5s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-cloud\-provider\-gcp\]\sUpgrade\s\[Feature\:Upgrade\]\smaster\supgrade\sshould\smaintain\sa\sfunctioning\scluster\s\[Feature\:MasterUpgrade\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:91
Mar 25 17:07:48.401: Unexpected error:
    <*errors.errorString | 0xc001dea950>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.13+222605b0aa03bc]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.11+1e06e869a4a653\\\"\\nname: \\\"bootstrap-e2e-minion-group-7615\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.11+1e06e869a4a653\\\"\\nname: \\\"bootstrap-e2e-minion-group-mhfl\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.11+1e06e869a4a653\\\"\\nname: \\\"bootstrap-e2e-minion-group-w2fl\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.11+1e06e869a4a653\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.13+222605b0aa03bc/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n..........................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Upgrading the CoreDNS ConfigMap ==\\nconfigmap/coredns configured\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE   VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   10m   v1.17.5-beta.0.13+222605b0aa03bc\\nbootstrap-e2e-minion-group-7615   Ready                      <none>   10m   v1.16.9-beta.0.11+1e06e869a4a653\\nbootstrap-e2e-minion-group-mhfl   Ready                      <none>   10m   v1.16.9-beta.0.11+1e06e869a4a653\\nbootstrap-e2e-minion-group-w2fl   Ready                      <none>   10m   v1.16.9-beta.0.11+1e06e869a4a653\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\ncontroller-manager   Healthy   ok                  \\nscheduler            Healthy   ok                  \\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.5-beta.0.13+222605b0aa03bc\\\"\\nname: \\\"bootstrap-e2e-minion-group-7615\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.11+1e06e869a4a653\\\"\\nname: \\\"bootstrap-e2e-minion-group-mhfl\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.11+1e06e869a4a653\\\"\\nname: \\\"bootstrap-e2e-minion-group-w2fl\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.11+1e06e869a4a653\\\"\\n\", stderr \"Project: k8s-jkns-e2e-gce-flaky\\nNetwork Project: k8s-jkns-e2e-gce-flaky\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-7615 bootstrap-e2e-minion-group-mhfl bootstrap-e2e-minion-group-w2fl\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 35.203.133.89; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-flaky/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-flaky/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP    STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.203.133.89  RUNNING\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: k8s-jkns-e2e-gce-flaky\\nNetwork Project: k8s-jkns-e2e-gce-flaky\\nZone: us-west1-b\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.13+222605b0aa03bc]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.11+1e06e869a4a653\"\nname: \"bootstrap-e2e-minion-group-7615\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.11+1e06e869a4a653\"\nname: \"bootstrap-e2e-minion-group-mhfl\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.11+1e06e869a4a653\"\nname: \"bootstrap-e2e-minion-group-w2fl\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.11+1e06e869a4a653\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.13+222605b0aa03bc/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n..........................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Upgrading the CoreDNS ConfigMap ==\nconfigmap/coredns configured\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE   VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   10m   v1.17.5-beta.0.13+222605b0aa03bc\nbootstrap-e2e-minion-group-7615   Ready                      <none>   10m   v1.16.9-beta.0.11+1e06e869a4a653\nbootstrap-e2e-minion-group-mhfl   Ready                      <none>   10m   v1.16.9-beta.0.11+1e06e869a4a653\nbootstrap-e2e-minion-group-w2fl   Ready                      <none>   10m   v1.16.9-beta.0.11+1e06e869a4a653\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\ncontroller-manager   Healthy   ok                  \nscheduler            Healthy   ok                  \netcd-1               Healthy   {\"health\":\"true\"}   \netcd-0               Healthy   {\"health\":\"true\"}   \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.5-beta.0.13+222605b0aa03bc\"\nname: \"bootstrap-e2e-minion-group-7615\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.11+1e06e869a4a653\"\nname: \"bootstrap-e2e-minion-group-mhfl\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.11+1e06e869a4a653\"\nname: \"bootstrap-e2e-minion-group-w2fl\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.11+1e06e869a4a653\"\n", stderr "Project: k8s-jkns-e2e-gce-flaky\nNetwork Project: k8s-jkns-e2e-gce-flaky\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-7615 bootstrap-e2e-minion-group-mhfl bootstrap-e2e-minion-group-w2fl\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 35.203.133.89; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-flaky/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-flaky/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP    STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.203.133.89  RUNNING\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: k8s-jkns-e2e-gce-flaky\nNetwork Project: k8s-jkns-e2e-gce-flaky\nZone: us-west1-b\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:106
				
				Click to see stdout/stderrfrom junit_upgrade01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] [sig-node] NodeProblemDetector [DisabledForLargeClusters] should run without error 2m17s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sNodeProblemDetector\s\[DisabledForLargeClusters\]\sshould\srun\swithout\serror$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:58
Mar 26 06:01:30.178: Timed out after 60.001s.
Expected success, but got an error:
    <*errors.errorString | 0xc003a6e400>: {
        s: "Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-8kqz.15ffb86b7fb62b45  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffb86b7fb62b45 45f65be0-64f3-4d4c-8c46-7b2172dbf85c 26613 0 2020-03-26 05:06:53 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz f4da16c2-9a5e-4a99-83f3-66f8fdbc9d61   } NodeNotReady Node bootstrap-e2e-minion-group-8kqz status is now: NodeNotReady {node-controller } 2020-03-26 02:06:05 +0000 UTC 2020-03-26 05:06:53 +0000 UTC 4 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26ee93c23c8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26ee93c23c8 ff498f24-bd1a-4940-8350-d33bc0c09728 26616 0 2020-03-26 05:09:35 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } ContainerdStart Starting containerd container runtime... {systemd-monitor bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:35 +0000 UTC 2020-03-26 05:09:35 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26ee93c59db  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26ee93c59db e0fbe795-a51a-4951-908f-29270e8fbd43 26618 0 2020-03-26 05:09:35 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } DockerStart Starting Docker Application Container Engine... {systemd-monitor bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:35 +0000 UTC 2020-03-26 05:09:35 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26eeb1ca692  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26eeb1ca692 45c97600-0782-4ac2-8dff-c60fd169f3b6 27373 0 2020-03-26 05:09:35 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:35 +0000 UTC 2020-03-26 05:39:53 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26f28891add  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26f28891add 1027d7c0-26bb-4158-8329-36eee671f9d0 26619 0 2020-03-26 05:09:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:36 +0000 UTC 2020-03-26 05:09:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26f30556246  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26f30556246 5c9b7102-af8d-4e24-9df8-848556d1cae0 26624 0 2020-03-26 05:09:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-8kqz status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:36 +0000 UTC 2020-03-26 05:09:36 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26f3055a926  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26f3055a926 be9516a5-ae58-4565-aa24-160077c0c722 26625 0 2020-03-26 05:09:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-8kqz status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:36 +0000 UTC 2020-03-26 05:09:36 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26f3055d8a4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26f3055d8a4 2dac2fba-c9a4-4855-b0e1-cd94be0c98bc 26626 0 2020-03-26 05:09:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-8kqz status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:36 +0000 UTC 2020-03-26 05:09:36 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26f3182f628  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26f3182f628 40d617c3-048a-4a1f-a30d-2ac198234b80 26623 0 2020-03-26 05:09:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } Rebooted Node bootstrap-e2e-minion-group-8kqz has been rebooted, boot id: 637023e1-7caa-49ee-85aa-b2412ef227b2 {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:36 +0000 UTC 2020-03-26 05:09:36 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26f32cda82c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26f32cda82c f24684a6-d16e-40bf-88e6-cb96d7c16150 26627 0 2020-03-26 05:09:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeNotReady Node bootstrap-e2e-minion-group-8kqz status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:36 +0000 UTC 2020-03-26 05:09:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26f384142c6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26f384142c6 46c226b0-8b18-4acb-8d85-9610de7b48d3 26628 0 2020-03-26 05:09:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:36 +0000 UTC 2020-03-26 05:09:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26f398a4b26  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26f398a4b26 e92b3171-3f13-454f-ac0a-1cc516089818 26629 0 2020-03-26 05:09:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeReady Node bootstrap-e2e-minion-group-8kqz status is now: NodeReady {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:36 +0000 UTC 2020-03-26 05:09:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26fb351ab7c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26fb351ab7c cc1144a8-f50f-4f09-bc6a-e3e91278bc0b 26636 0 2020-03-26 05:09:38 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } Starting Starting kube-proxy. {kube-proxy bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:38 +0000 UTC 2020-03-26 05:09:38 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc41662e215da  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc41662e215da 64dbd0a2-435c-405e-b4e9-03a081ffca10 27374 0 2020-03-26 05:39:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:39:54 +0000 UTC 2020-03-26 05:39:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc4166bab6a86  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc4166bab6a86 9e8bd496-2c96-4956-aa76-4029a869cacb 27375 0 2020-03-26 05:39:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-8kqz status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:39:54 +0000 UTC 2020-03-26 05:39:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc4166babb696  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc4166babb696 023c2d09-3d00-42cf-a657-bbe88b431b87 27376 0 2020-03-26 05:39:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-8kqz status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:39:54 +0000 UTC 2020-03-26 05:39:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc4166babff43  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc4166babff43 564060b6-f807-4089-8ff4-ac8037b23b67 27377 0 2020-03-26 05:39:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-8kqz status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:39:54 +0000 UTC 2020-03-26 05:39:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc4166e0f1c23  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc4166e0f1c23 deec4d4d-97a2-4625-8ce7-0c96abfc8060 27378 0 2020-03-26 05:39:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeNotReady Node bootstrap-e2e-minion-group-8kqz status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:39:54 +0000 UTC 2020-03-26 05:39:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc41678e3ebd6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc41678e3ebd6 b945599a-5052-4da6-aa25-2b2125cf4263 27379 0 2020-03-26 05:39:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:39:54 +0000 UTC 2020-03-26 05:39:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc4167a99746c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc4167a99746c ffbdf4ee-58c2-45d6-8b95-bcb18655641c 27380 0 2020-03-26 05:39:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeReady Node bootstrap-e2e-minion-group-8kqz status is now: NodeReady {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:39:54 +0000 UTC 2020-03-26 05:39:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc534d3b6cdd8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc534d3b6cdd8 266dbcb5-3a3b-4097-8df8-0e55f7fc820e 28200 0 2020-03-26 06:00:24 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-8kqz} 2020-03-26 06:00:24 +0000 UTC 2020-03-26 06:00:24 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc534d3b6f3c2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc534d3b6f3c2 dc68ae92-1566-4c2d-81df-7a2913796a97 28199 0 2020-03-26 06:00:24 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-8kqz} 2020-03-26 06:00:24 +0000 UTC 2020-03-26 06:00:24 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mhfl.15ffc5357620022b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mhfl.15ffc5357620022b d24d29b8-aa6f-442e-9eeb-b9506c4fb259 28202 0 2020-03-26 06:00:27 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mhfl bootstrap-e2e-minion-group-mhfl   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-mhfl} 2020-03-26 06:00:27 +0000 UTC 2020-03-26 06:00:27 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mhfl.15ffc53576203378  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mhfl.15ffc53576203378 508f9f4c-1987-4ed6-8b5d-ce2224215c32 28201 0 2020-03-26 06:00:27 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mhfl bootstrap-e2e-minion-group-mhfl   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-mhfl} 2020-03-26 06:00:27 +0000 UTC 2020-03-26 06:00:27 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-w2fl.15ffc53615b8811d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-w2fl.15ffc53615b8811d d28a99f8-907d-45b4-ae76-8e737f892113 28204 0 2020-03-26 06:00:29 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-w2fl bootstrap-e2e-minion-group-w2fl   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-w2fl} 2020-03-26 06:00:29 +0000 UTC 2020-03-26 06:00:29 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-w2fl.15ffc53615b92a85  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-w2fl.15ffc53615b92a85 a8aaaf17-8612-45fe-a114-dcacf0033b88 28203 0 2020-03-26 06:00:29 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-w2fl bootstrap-e2e-minion-group-w2fl   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-w2fl} 2020-03-26 06:00:29 +0000 UTC 2020-03-26 06:00:29 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]",
    }
    Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-8kqz.15ffb86b7fb62b45  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffb86b7fb62b45 45f65be0-64f3-4d4c-8c46-7b2172dbf85c 26613 0 2020-03-26 05:06:53 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz f4da16c2-9a5e-4a99-83f3-66f8fdbc9d61   } NodeNotReady Node bootstrap-e2e-minion-group-8kqz status is now: NodeNotReady {node-controller } 2020-03-26 02:06:05 +0000 UTC 2020-03-26 05:06:53 +0000 UTC 4 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26ee93c23c8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26ee93c23c8 ff498f24-bd1a-4940-8350-d33bc0c09728 26616 0 2020-03-26 05:09:35 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } ContainerdStart Starting containerd container runtime... {systemd-monitor bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:35 +0000 UTC 2020-03-26 05:09:35 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26ee93c59db  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26ee93c59db e0fbe795-a51a-4951-908f-29270e8fbd43 26618 0 2020-03-26 05:09:35 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } DockerStart Starting Docker Application Container Engine... {systemd-monitor bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:35 +0000 UTC 2020-03-26 05:09:35 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26eeb1ca692  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26eeb1ca692 45c97600-0782-4ac2-8dff-c60fd169f3b6 27373 0 2020-03-26 05:09:35 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:35 +0000 UTC 2020-03-26 05:39:53 +0000 UTC 2 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26f28891add  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26f28891add 1027d7c0-26bb-4158-8329-36eee671f9d0 26619 0 2020-03-26 05:09:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:36 +0000 UTC 2020-03-26 05:09:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26f30556246  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26f30556246 5c9b7102-af8d-4e24-9df8-848556d1cae0 26624 0 2020-03-26 05:09:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-8kqz status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:36 +0000 UTC 2020-03-26 05:09:36 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26f3055a926  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26f3055a926 be9516a5-ae58-4565-aa24-160077c0c722 26625 0 2020-03-26 05:09:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-8kqz status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:36 +0000 UTC 2020-03-26 05:09:36 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26f3055d8a4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26f3055d8a4 2dac2fba-c9a4-4855-b0e1-cd94be0c98bc 26626 0 2020-03-26 05:09:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-8kqz status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:36 +0000 UTC 2020-03-26 05:09:36 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26f3182f628  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26f3182f628 40d617c3-048a-4a1f-a30d-2ac198234b80 26623 0 2020-03-26 05:09:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } Rebooted Node bootstrap-e2e-minion-group-8kqz has been rebooted, boot id: 637023e1-7caa-49ee-85aa-b2412ef227b2 {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:36 +0000 UTC 2020-03-26 05:09:36 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26f32cda82c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26f32cda82c f24684a6-d16e-40bf-88e6-cb96d7c16150 26627 0 2020-03-26 05:09:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeNotReady Node bootstrap-e2e-minion-group-8kqz status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:36 +0000 UTC 2020-03-26 05:09:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26f384142c6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26f384142c6 46c226b0-8b18-4acb-8d85-9610de7b48d3 26628 0 2020-03-26 05:09:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:36 +0000 UTC 2020-03-26 05:09:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26f398a4b26  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26f398a4b26 e92b3171-3f13-454f-ac0a-1cc516089818 26629 0 2020-03-26 05:09:36 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeReady Node bootstrap-e2e-minion-group-8kqz status is now: NodeReady {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:36 +0000 UTC 2020-03-26 05:09:36 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc26fb351ab7c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc26fb351ab7c cc1144a8-f50f-4f09-bc6a-e3e91278bc0b 26636 0 2020-03-26 05:09:38 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } Starting Starting kube-proxy. {kube-proxy bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:09:38 +0000 UTC 2020-03-26 05:09:38 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc41662e215da  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc41662e215da 64dbd0a2-435c-405e-b4e9-03a081ffca10 27374 0 2020-03-26 05:39:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:39:54 +0000 UTC 2020-03-26 05:39:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc4166bab6a86  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc4166bab6a86 9e8bd496-2c96-4956-aa76-4029a869cacb 27375 0 2020-03-26 05:39:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-8kqz status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:39:54 +0000 UTC 2020-03-26 05:39:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc4166babb696  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc4166babb696 023c2d09-3d00-42cf-a657-bbe88b431b87 27376 0 2020-03-26 05:39:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-8kqz status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:39:54 +0000 UTC 2020-03-26 05:39:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc4166babff43  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc4166babff43 564060b6-f807-4089-8ff4-ac8037b23b67 27377 0 2020-03-26 05:39:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-8kqz status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:39:54 +0000 UTC 2020-03-26 05:39:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc4166e0f1c23  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc4166e0f1c23 deec4d4d-97a2-4625-8ce7-0c96abfc8060 27378 0 2020-03-26 05:39:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeNotReady Node bootstrap-e2e-minion-group-8kqz status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:39:54 +0000 UTC 2020-03-26 05:39:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc41678e3ebd6  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc41678e3ebd6 b945599a-5052-4da6-aa25-2b2125cf4263 27379 0 2020-03-26 05:39:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:39:54 +0000 UTC 2020-03-26 05:39:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc4167a99746c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc4167a99746c ffbdf4ee-58c2-45d6-8b95-bcb18655641c 27380 0 2020-03-26 05:39:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } NodeReady Node bootstrap-e2e-minion-group-8kqz status is now: NodeReady {kubelet bootstrap-e2e-minion-group-8kqz} 2020-03-26 05:39:54 +0000 UTC 2020-03-26 05:39:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc534d3b6cdd8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc534d3b6cdd8 266dbcb5-3a3b-4097-8df8-0e55f7fc820e 28200 0 2020-03-26 06:00:24 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-8kqz} 2020-03-26 06:00:24 +0000 UTC 2020-03-26 06:00:24 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8kqz.15ffc534d3b6f3c2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8kqz.15ffc534d3b6f3c2 dc68ae92-1566-4c2d-81df-7a2913796a97 28199 0 2020-03-26 06:00:24 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8kqz bootstrap-e2e-minion-group-8kqz   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-8kqz} 2020-03-26 06:00:24 +0000 UTC 2020-03-26 06:00:24 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mhfl.15ffc5357620022b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mhfl.15ffc5357620022b d24d29b8-aa6f-442e-9eeb-b9506c4fb259 28202 0 2020-03-26 06:00:27 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mhfl bootstrap-e2e-minion-group-mhfl   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-mhfl} 2020-03-26 06:00:27 +0000 UTC 2020-03-26 06:00:27 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mhfl.15ffc53576203378  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mhfl.15ffc53576203378 508f9f4c-1987-4ed6-8b5d-ce2224215c32 28201 0 2020-03-26 06:00:27 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mhfl bootstrap-e2e-minion-group-mhfl   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-mhfl} 2020-03-26 06:00:27 +0000 UTC 2020-03-26 06:00:27 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-w2fl.15ffc53615b8811d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-w2fl.15ffc53615b8811d d28a99f8-907d-45b4-ae76-8e737f892113 28204 0 2020-03-26 06:00:29 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-w2fl bootstrap-e2e-minion-group-w2fl   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-w2fl} 2020-03-26 06:00:29 +0000 UTC 2020-03-26 06:00:29 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-w2fl.15ffc53615b92a85  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-w2fl.15ffc53615b92a85 a8aaaf17-8612-45fe-a114-dcacf0033b88 28203 0 2020-03-26 06:00:29 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-w2fl bootstrap-e2e-minion-group-w2fl   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-w2fl} 2020-03-26 06:00:29 +0000 UTC 2020-03-26 06:00:29 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:141
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-cloud-provider-gcp] master-upgrade 6m15s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-cloud\-provider\-gcp\]\smaster\-upgrade$'
Mar 25 17:07:48.401: Unexpected error:
    <*errors.errorString | 0xc001dea950>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.13+222605b0aa03bc]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.11+1e06e869a4a653\\\"\\nname: \\\"bootstrap-e2e-minion-group-7615\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.11+1e06e869a4a653\\\"\\nname: \\\"bootstrap-e2e-minion-group-mhfl\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.11+1e06e869a4a653\\\"\\nname: \\\"bootstrap-e2e-minion-group-w2fl\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.11+1e06e869a4a653\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.13+222605b0aa03bc/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n..........................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Upgrading the CoreDNS ConfigMap ==\\nconfigmap/coredns configured\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE   VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   10m   v1.17.5-beta.0.13+222605b0aa03bc\\nbootstrap-e2e-minion-group-7615   Ready                      <none>   10m   v1.16.9-beta.0.11+1e06e869a4a653\\nbootstrap-e2e-minion-group-mhfl   Ready                      <none>   10m   v1.16.9-beta.0.11+1e06e869a4a653\\nbootstrap-e2e-minion-group-w2fl   Ready                      <none>   10m   v1.16.9-beta.0.11+1e06e869a4a653\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\ncontroller-manager   Healthy   ok                  \\nscheduler            Healthy   ok                  \\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.5-beta.0.13+222605b0aa03bc\\\"\\nname: \\\"bootstrap-e2e-minion-group-7615\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.11+1e06e869a4a653\\\"\\nname: \\\"bootstrap-e2e-minion-group-mhfl\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.11+1e06e869a4a653\\\"\\nname: \\\"bootstrap-e2e-minion-group-w2fl\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.11+1e06e869a4a653\\\"\\n\", stderr \"Project: k8s-jkns-e2e-gce-flaky\\nNetwork Project: k8s-jkns-e2e-gce-flaky\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-7615 bootstrap-e2e-minion-group-mhfl bootstrap-e2e-minion-group-w2fl\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 35.203.133.89; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-flaky/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-flaky/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP    STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.203.133.89  RUNNING\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: k8s-jkns-e2e-gce-flaky\\nNetwork Project: k8s-jkns-e2e-gce-flaky\\nZone: us-west1-b\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.13+222605b0aa03bc]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.11+1e06e869a4a653\"\nname: \"bootstrap-e2e-minion-group-7615\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.11+1e06e869a4a653\"\nname: \"bootstrap-e2e-minion-group-mhfl\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.11+1e06e869a4a653\"\nname: \"bootstrap-e2e-minion-group-w2fl\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.11+1e06e869a4a653\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.13+222605b0aa03bc/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n..........................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Upgrading the CoreDNS ConfigMap ==\nconfigmap/coredns configured\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE   VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   10m   v1.17.5-beta.0.13+222605b0aa03bc\nbootstrap-e2e-minion-group-7615   Ready                      <none>   10m   v1.16.9-beta.0.11+1e06e869a4a653\nbootstrap-e2e-minion-group-mhfl   Ready                      <none>   10m   v1.16.9-beta.0.11+1e06e869a4a653\nbootstrap-e2e-minion-group-w2fl   Ready                      <none>   10m   v1.16.9-beta.0.11+1e06e869a4a653\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\ncontroller-manager   Healthy   ok                  \nscheduler            Healthy   ok                  \netcd-1               Healthy   {\"health\":\"true\"}   \netcd-0               Healthy   {\"health\":\"true\"}   \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.5-beta.0.13+222605b0aa03bc\"\nname: \"bootstrap-e2e-minion-group-7615\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.11+1e06e869a4a653\"\nname: \"bootstrap-e2e-minion-group-mhfl\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.11+1e06e869a4a653\"\nname: \"bootstrap-e2e-minion-group-w2fl\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.11+1e06e869a4a653\"\n", stderr "Project: k8s-jkns-e2e-gce-flaky\nNetwork Project: k8s-jkns-e2e-gce-flaky\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-7615 bootstrap-e2e-minion-group-mhfl bootstrap-e2e-minion-group-w2fl\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 35.203.133.89; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-flaky/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-flaky/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP    STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.203.133.89  RUNNING\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: k8s-jkns-e2e-gce-flaky\nNetwork Project: k8s-jkns-e2e-gce-flaky\nZone: us-west1-b\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred

k8s.io/kubernetes/test/e2e/cloud/gcp.glob..func2.1.1.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:106 +0x12c
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do(0xc0024b7200)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:111 +0x38a
k8s.io/kubernetes/test/e2e/cloud/gcp.runUpgradeSuite(0xc00078e3c0, 0x7757ca0, 0xc, 0xc, 0xc0005d0d80, 0xc002b650e0, 0x0, 0xc00314e540)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:479 +0x47a
k8s.io/kubernetes/test/e2e/cloud/gcp.glob..func2.1.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:109 +0x222
k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002964100)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:110 +0x30a
k8s.io/kubernetes/test/e2e.TestE2E(0xc002964100)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:112 +0x2b
testing.tRunner(0xc002964100, 0x49f9638)
	/usr/local/go/src/testing/testing.go:909 +0xc9
created by testing.(*T).Run
	/usr/local/go/src/testing/testing.go:960 +0x350
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Test 14h35m

error during ./hack/ginkgo-e2e.sh --kubectl-path=../../../../kubernetes_skew/cluster/kubectl.sh --minStartupPods=8 --report-dir=/workspace/_artifacts --disable-log-dump=true (interrupted): exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Timeout 15h0m

kubetest --timeout triggered
				from junit_runner.xml

Filter through log files | View test history on testgrid


UpgradeTest 18m20s

error during kubetest --test --test_args=--ginkgo.focus=\[Feature:MasterUpgrade\] --upgrade-target=ci/k8s-stable1 --report-dir=/workspace/_artifacts --disable-log-dump=true --report-prefix=upgrade --check-version-skew=false: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 939 Passed Tests