This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 7 failed / 881 succeeded
Started2020-03-26 08:06
Elapsed15h11m
Revision
Buildera53e7b19-6f38-11ea-9710-126912a3969e
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/e630fb0e-1457-4a1e-9003-9db80c1f14c6/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/e630fb0e-1457-4a1e-9003-9db80c1f14c6/targets/test
infra-commit21b8ad1b0
job-versionv1.16.9-beta.0.17+bb616cba1cc983
master_os_imagecos-77-12371-175-0
node_os_imagecos-73-11647-163-0
revisionv1.16.9-beta.0.17+bb616cba1cc983

Test Failures


Kubernetes e2e suite [k8s.io] [sig-cloud-provider-gcp] Upgrade [Feature:Upgrade] master upgrade should maintain a functioning cluster [Feature:MasterUpgrade] 23m21s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-cloud\-provider\-gcp\]\sUpgrade\s\[Feature\:Upgrade\]\smaster\supgrade\sshould\smaintain\sa\sfunctioning\scluster\s\[Feature\:MasterUpgrade\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:91
Mar 26 08:22:05.491: Unexpected error:
    <*errors.errorString | 0xc0006ab0f0>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.17+77813728f727fb]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-34b7\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-b9zw\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-fkdk\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.17+77813728f727fb/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n.......................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Upgrading the CoreDNS ConfigMap ==\\nconfigmap/coredns configured\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE     VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   9m31s   v1.17.5-beta.0.17+77813728f727fb\\nbootstrap-e2e-minion-group-34b7   Ready                      <none>   9m35s   v1.16.9-beta.0.17+bb616cba1cc983\\nbootstrap-e2e-minion-group-b9zw   Ready                      <none>   9m34s   v1.16.9-beta.0.17+bb616cba1cc983\\nbootstrap-e2e-minion-group-fkdk   Ready                      <none>   9m35s   v1.16.9-beta.0.17+bb616cba1cc983\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\nscheduler            Healthy   ok                  \\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\ncontroller-manager   Healthy   ok                  \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.5-beta.0.17+77813728f727fb\\\"\\nname: \\\"bootstrap-e2e-minion-group-34b7\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-b9zw\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-fkdk\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\n\", stderr \"Project: k8s-jkns-e2e-gce-gci\\nNetwork Project: k8s-jkns-e2e-gce-gci\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-34b7 bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-fkdk\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 35.230.112.166; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP     STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.230.112.166  RUNNING\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: k8s-jkns-e2e-gce-gci\\nNetwork Project: k8s-jkns-e2e-gce-gci\\nZone: us-west1-b\\nWARNING: Some requests did not succeed.\\n - Invalid value for field 'zone': 'us-west4-a'. Unknown zone.\\n - Invalid value for field 'zone': 'us-west4-b'. Unknown zone.\\n - Invalid value for field 'zone': 'us-west4-c'. Unknown zone.\\n\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.17+77813728f727fb]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-34b7\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-b9zw\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-fkdk\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.17+77813728f727fb/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n.......................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Upgrading the CoreDNS ConfigMap ==\nconfigmap/coredns configured\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE     VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   9m31s   v1.17.5-beta.0.17+77813728f727fb\nbootstrap-e2e-minion-group-34b7   Ready                      <none>   9m35s   v1.16.9-beta.0.17+bb616cba1cc983\nbootstrap-e2e-minion-group-b9zw   Ready                      <none>   9m34s   v1.16.9-beta.0.17+bb616cba1cc983\nbootstrap-e2e-minion-group-fkdk   Ready                      <none>   9m35s   v1.16.9-beta.0.17+bb616cba1cc983\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\netcd-0               Healthy   {\"health\":\"true\"}   \nscheduler            Healthy   ok                  \netcd-1               Healthy   {\"health\":\"true\"}   \ncontroller-manager   Healthy   ok                  \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.5-beta.0.17+77813728f727fb\"\nname: \"bootstrap-e2e-minion-group-34b7\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-b9zw\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-fkdk\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\n", stderr "Project: k8s-jkns-e2e-gce-gci\nNetwork Project: k8s-jkns-e2e-gce-gci\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-34b7 bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-fkdk\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 35.230.112.166; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP     STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.230.112.166  RUNNING\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: k8s-jkns-e2e-gce-gci\nNetwork Project: k8s-jkns-e2e-gce-gci\nZone: us-west1-b\nWARNING: Some requests did not succeed.\n - Invalid value for field 'zone': 'us-west4-a'. Unknown zone.\n - Invalid value for field 'zone': 'us-west4-b'. Unknown zone.\n - Invalid value for field 'zone': 'us-west4-c'. Unknown zone.\n\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:106
				
				Click to see stdout/stderrfrom junit_upgrade01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] [sig-node] NodeProblemDetector [DisabledForLargeClusters] should run without error 2m16s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sNodeProblemDetector\s\[DisabledForLargeClusters\]\sshould\srun\swithout\serror$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:58
Mar 26 20:23:46.905: Timed out after 60.000s.
Expected success, but got an error:
    <*errors.errorString | 0xc006403d40>: {
        s: "Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-b9zw.15ffce0082397421  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15ffce0082397421 5e1d61df-84bc-478d-8c8e-89da0d8d51fa 24984 0 2020-03-26 19:47:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-b9zw} 2020-03-26 08:41:35 +0000 UTC 2020-03-26 19:47:12 +0000 UTC 6 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-b9zw.15fff25322272a85  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15fff25322272a85 10cc1b43-0acc-4608-a322-cb7b87b0d849 24985 0 2020-03-26 19:47:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-b9zw} 2020-03-26 19:47:12 +0000 UTC 2020-03-26 19:47:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-b9zw.15fff2532b1754db  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15fff2532b1754db 6be9e14e-f6d3-4699-944c-da782174a76e 24986 0 2020-03-26 19:47:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-b9zw status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-b9zw} 2020-03-26 19:47:12 +0000 UTC 2020-03-26 19:47:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-b9zw.15fff2532b17af8b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15fff2532b17af8b 70cb226b-2cb5-4d8e-ae5b-d13fd4232c34 24987 0 2020-03-26 19:47:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-b9zw status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-b9zw} 2020-03-26 19:47:12 +0000 UTC 2020-03-26 19:47:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-b9zw.15fff2532b17d915  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15fff2532b17d915 ba771d48-f769-4aba-961b-9c1a70c80046 24988 0 2020-03-26 19:47:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-b9zw status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-b9zw} 2020-03-26 19:47:12 +0000 UTC 2020-03-26 19:47:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-b9zw.15fff2532dd87d79  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15fff2532dd87d79 8b3efa3d-6dd0-4bb6-a18a-d30c10187eb6 24989 0 2020-03-26 19:47:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } NodeNotReady Node bootstrap-e2e-minion-group-b9zw status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-b9zw} 2020-03-26 19:47:12 +0000 UTC 2020-03-26 19:47:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-b9zw.15fff253570e0032  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15fff253570e0032 58ca9686-9da6-4492-851a-d78dd527ce62 24990 0 2020-03-26 19:47:13 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-b9zw} 2020-03-26 19:47:13 +0000 UTC 2020-03-26 19:47:13 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-b9zw.15fff2535df8b796  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15fff2535df8b796 a8f3fb3d-e964-4e88-b517-11cbd7a16b70 24991 0 2020-03-26 19:47:13 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } NodeReady Node bootstrap-e2e-minion-group-b9zw status is now: NodeReady {kubelet bootstrap-e2e-minion-group-b9zw} 2020-03-26 19:47:13 +0000 UTC 2020-03-26 19:47:13 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-b9zw.15fff442d47174b7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15fff442d47174b7 c25d9d60-a830-4ff0-bd43-c163fe349554 26377 0 2020-03-26 20:22:41 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-b9zw} 2020-03-26 20:22:41 +0000 UTC 2020-03-26 20:22:41 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-b9zw.15fff442d4718ed2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15fff442d4718ed2 ce177b0e-5338-4f2d-9a67-9b72cd732859 26376 0 2020-03-26 20:22:41 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-b9zw} 2020-03-26 20:22:41 +0000 UTC 2020-03-26 20:22:41 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-fkdk.15fff44368a777f8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-fkdk.15fff44368a777f8 f5774289-76b1-4883-8a18-8063bd8d7c6e 26379 0 2020-03-26 20:22:44 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-fkdk bootstrap-e2e-minion-group-fkdk   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-fkdk} 2020-03-26 20:22:44 +0000 UTC 2020-03-26 20:22:44 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-fkdk.15fff44368a79d36  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-fkdk.15fff44368a79d36 53756cc0-e23b-4e44-8cd3-f0c155d7d310 26378 0 2020-03-26 20:22:44 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-fkdk bootstrap-e2e-minion-group-fkdk   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-fkdk} 2020-03-26 20:22:44 +0000 UTC 2020-03-26 20:22:44 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wv8s.15fff443fcdbfe3e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wv8s.15fff443fcdbfe3e 89317d85-ca08-4072-a5ff-a2f2f6c9ae7e 26381 0 2020-03-26 20:22:46 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-wv8s bootstrap-e2e-minion-group-wv8s   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-wv8s} 2020-03-26 20:22:46 +0000 UTC 2020-03-26 20:22:46 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wv8s.15fff443fcdc24dd  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wv8s.15fff443fcdc24dd 71aae38d-6451-45f4-a112-fab7a1a2ee91 26380 0 2020-03-26 20:22:46 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-wv8s bootstrap-e2e-minion-group-wv8s   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-wv8s} 2020-03-26 20:22:46 +0000 UTC 2020-03-26 20:22:46 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]",
    }
    Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-b9zw.15ffce0082397421  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15ffce0082397421 5e1d61df-84bc-478d-8c8e-89da0d8d51fa 24984 0 2020-03-26 19:47:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-b9zw} 2020-03-26 08:41:35 +0000 UTC 2020-03-26 19:47:12 +0000 UTC 6 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-b9zw.15fff25322272a85  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15fff25322272a85 10cc1b43-0acc-4608-a322-cb7b87b0d849 24985 0 2020-03-26 19:47:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-b9zw} 2020-03-26 19:47:12 +0000 UTC 2020-03-26 19:47:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-b9zw.15fff2532b1754db  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15fff2532b1754db 6be9e14e-f6d3-4699-944c-da782174a76e 24986 0 2020-03-26 19:47:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-b9zw status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-b9zw} 2020-03-26 19:47:12 +0000 UTC 2020-03-26 19:47:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-b9zw.15fff2532b17af8b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15fff2532b17af8b 70cb226b-2cb5-4d8e-ae5b-d13fd4232c34 24987 0 2020-03-26 19:47:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-b9zw status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-b9zw} 2020-03-26 19:47:12 +0000 UTC 2020-03-26 19:47:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-b9zw.15fff2532b17d915  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15fff2532b17d915 ba771d48-f769-4aba-961b-9c1a70c80046 24988 0 2020-03-26 19:47:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-b9zw status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-b9zw} 2020-03-26 19:47:12 +0000 UTC 2020-03-26 19:47:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-b9zw.15fff2532dd87d79  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15fff2532dd87d79 8b3efa3d-6dd0-4bb6-a18a-d30c10187eb6 24989 0 2020-03-26 19:47:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } NodeNotReady Node bootstrap-e2e-minion-group-b9zw status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-b9zw} 2020-03-26 19:47:12 +0000 UTC 2020-03-26 19:47:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-b9zw.15fff253570e0032  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15fff253570e0032 58ca9686-9da6-4492-851a-d78dd527ce62 24990 0 2020-03-26 19:47:13 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-b9zw} 2020-03-26 19:47:13 +0000 UTC 2020-03-26 19:47:13 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-b9zw.15fff2535df8b796  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15fff2535df8b796 a8f3fb3d-e964-4e88-b517-11cbd7a16b70 24991 0 2020-03-26 19:47:13 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } NodeReady Node bootstrap-e2e-minion-group-b9zw status is now: NodeReady {kubelet bootstrap-e2e-minion-group-b9zw} 2020-03-26 19:47:13 +0000 UTC 2020-03-26 19:47:13 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-b9zw.15fff442d47174b7  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15fff442d47174b7 c25d9d60-a830-4ff0-bd43-c163fe349554 26377 0 2020-03-26 20:22:41 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-b9zw} 2020-03-26 20:22:41 +0000 UTC 2020-03-26 20:22:41 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-b9zw.15fff442d4718ed2  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-b9zw.15fff442d4718ed2 ce177b0e-5338-4f2d-9a67-9b72cd732859 26376 0 2020-03-26 20:22:41 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-b9zw   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-b9zw} 2020-03-26 20:22:41 +0000 UTC 2020-03-26 20:22:41 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-fkdk.15fff44368a777f8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-fkdk.15fff44368a777f8 f5774289-76b1-4883-8a18-8063bd8d7c6e 26379 0 2020-03-26 20:22:44 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-fkdk bootstrap-e2e-minion-group-fkdk   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-fkdk} 2020-03-26 20:22:44 +0000 UTC 2020-03-26 20:22:44 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-fkdk.15fff44368a79d36  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-fkdk.15fff44368a79d36 53756cc0-e23b-4e44-8cd3-f0c155d7d310 26378 0 2020-03-26 20:22:44 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-fkdk bootstrap-e2e-minion-group-fkdk   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-fkdk} 2020-03-26 20:22:44 +0000 UTC 2020-03-26 20:22:44 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wv8s.15fff443fcdbfe3e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wv8s.15fff443fcdbfe3e 89317d85-ca08-4072-a5ff-a2f2f6c9ae7e 26381 0 2020-03-26 20:22:46 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-wv8s bootstrap-e2e-minion-group-wv8s   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-wv8s} 2020-03-26 20:22:46 +0000 UTC 2020-03-26 20:22:46 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-wv8s.15fff443fcdc24dd  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-wv8s.15fff443fcdc24dd 71aae38d-6451-45f4-a112-fab7a1a2ee91 26380 0 2020-03-26 20:22:46 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-wv8s bootstrap-e2e-minion-group-wv8s   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-wv8s} 2020-03-26 20:22:46 +0000 UTC 2020-03-26 20:22:46 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:141
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [sig-scheduling] PreemptionExecutionPath runs ReplicaSets to verify preemption running path 36s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-scheduling\]\sPreemptionExecutionPath\sruns\sReplicaSets\sto\sverify\spreemption\srunning\spath$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/scheduling/preemption.go:345
Mar 26 23:06:40.807: Unexpected error:
    <*errors.StatusError | 0xc001ea92c0>: {
        ErrStatus: {
            TypeMeta: {Kind: "", APIVersion: ""},
            ListMeta: {
                SelfLink: "",
                ResourceVersion: "",
                Continue: "",
                RemainingItemCount: nil,
            },
            Status: "Failure",
            Message: "replicasets.apps \"rs-pod4\" not found",
            Reason: "NotFound",
            Details: {Name: "rs-pod4", Group: "apps", Kind: "replicasets", UID: "", Causes: nil, RetryAfterSeconds: 0},
            Code: 404,
        },
    }
    replicasets.apps "rs-pod4" not found
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/scheduling/preemption.go:510
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-cloud-provider-gcp] master-upgrade 4m57s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-cloud\-provider\-gcp\]\smaster\-upgrade$'
Mar 26 08:22:05.491: Unexpected error:
    <*errors.errorString | 0xc0006ab0f0>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.17+77813728f727fb]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-34b7\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-b9zw\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-fkdk\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.17+77813728f727fb/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n.......................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Upgrading the CoreDNS ConfigMap ==\\nconfigmap/coredns configured\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE     VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   9m31s   v1.17.5-beta.0.17+77813728f727fb\\nbootstrap-e2e-minion-group-34b7   Ready                      <none>   9m35s   v1.16.9-beta.0.17+bb616cba1cc983\\nbootstrap-e2e-minion-group-b9zw   Ready                      <none>   9m34s   v1.16.9-beta.0.17+bb616cba1cc983\\nbootstrap-e2e-minion-group-fkdk   Ready                      <none>   9m35s   v1.16.9-beta.0.17+bb616cba1cc983\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\nscheduler            Healthy   ok                  \\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\ncontroller-manager   Healthy   ok                  \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.5-beta.0.17+77813728f727fb\\\"\\nname: \\\"bootstrap-e2e-minion-group-34b7\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-b9zw\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-fkdk\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\n\", stderr \"Project: k8s-jkns-e2e-gce-gci\\nNetwork Project: k8s-jkns-e2e-gce-gci\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-34b7 bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-fkdk\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 35.230.112.166; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP     STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.230.112.166  RUNNING\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: k8s-jkns-e2e-gce-gci\\nNetwork Project: k8s-jkns-e2e-gce-gci\\nZone: us-west1-b\\nWARNING: Some requests did not succeed.\\n - Invalid value for field 'zone': 'us-west4-a'. Unknown zone.\\n - Invalid value for field 'zone': 'us-west4-b'. Unknown zone.\\n - Invalid value for field 'zone': 'us-west4-c'. Unknown zone.\\n\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.17+77813728f727fb]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-34b7\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-b9zw\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-fkdk\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.17+77813728f727fb/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n.......................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Upgrading the CoreDNS ConfigMap ==\nconfigmap/coredns configured\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE     VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   9m31s   v1.17.5-beta.0.17+77813728f727fb\nbootstrap-e2e-minion-group-34b7   Ready                      <none>   9m35s   v1.16.9-beta.0.17+bb616cba1cc983\nbootstrap-e2e-minion-group-b9zw   Ready                      <none>   9m34s   v1.16.9-beta.0.17+bb616cba1cc983\nbootstrap-e2e-minion-group-fkdk   Ready                      <none>   9m35s   v1.16.9-beta.0.17+bb616cba1cc983\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\netcd-0               Healthy   {\"health\":\"true\"}   \nscheduler            Healthy   ok                  \netcd-1               Healthy   {\"health\":\"true\"}   \ncontroller-manager   Healthy   ok                  \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.5-beta.0.17+77813728f727fb\"\nname: \"bootstrap-e2e-minion-group-34b7\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-b9zw\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-fkdk\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\n", stderr "Project: k8s-jkns-e2e-gce-gci\nNetwork Project: k8s-jkns-e2e-gce-gci\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-34b7 bootstrap-e2e-minion-group-b9zw bootstrap-e2e-minion-group-fkdk\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 35.230.112.166; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-gci/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP     STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.230.112.166  RUNNING\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: k8s-jkns-e2e-gce-gci\nNetwork Project: k8s-jkns-e2e-gce-gci\nZone: us-west1-b\nWARNING: Some requests did not succeed.\n - Invalid value for field 'zone': 'us-west4-a'. Unknown zone.\n - Invalid value for field 'zone': 'us-west4-b'. Unknown zone.\n - Invalid value for field 'zone': 'us-west4-c'. Unknown zone.\n\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred

k8s.io/kubernetes/test/e2e/cloud/gcp.glob..func2.1.1.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:106 +0x12c
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do(0xc002c37200)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:111 +0x38a
k8s.io/kubernetes/test/e2e/cloud/gcp.runUpgradeSuite(0xc000bfab40, 0x7757ca0, 0xc, 0xc, 0xc00056b650, 0xc00345c000, 0x0, 0xc00343c020)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:479 +0x47a
k8s.io/kubernetes/test/e2e/cloud/gcp.glob..func2.1.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:109 +0x222
k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002a2c900)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:110 +0x30a
k8s.io/kubernetes/test/e2e.TestE2E(0xc002a2c900)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:112 +0x2b
testing.tRunner(0xc002a2c900, 0x49f96a0)
	/usr/local/go/src/testing/testing.go:909 +0xc9
created by testing.(*T).Run
	/usr/local/go/src/testing/testing.go:960 +0x350
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Test 14h29m

error during ./hack/ginkgo-e2e.sh --kubectl-path=../../../../kubernetes_skew/cluster/kubectl.sh --minStartupPods=8 --report-dir=/workspace/_artifacts --disable-log-dump=true (interrupted): exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Timeout 15h0m

kubetest --timeout triggered
				from junit_runner.xml

Filter through log files | View test history on testgrid


UpgradeTest 23m34s

error during kubetest --test --test_args=--ginkgo.focus=\[Feature:MasterUpgrade\] --upgrade-target=ci/k8s-stable1 --report-dir=/workspace/_artifacts --disable-log-dump=true --report-prefix=upgrade --check-version-skew=false: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 881 Passed Tests