This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 5 failed / 186 succeeded
Started2020-01-17 13:27
Elapsed5h4m
Revision
Buildergke-prow-default-pool-cf4891d4-mb35
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/509bce22-8be1-4723-8933-e032e9ca77a8/targets/test'}}
pod03b7704b-392d-11ea-8780-468616f72408
resultstorehttps://source.cloud.google.com/results/invocations/509bce22-8be1-4723-8933-e032e9ca77a8/targets/test
infra-commitf3c464c7f
job-versionv1.16.6-beta.0.1+94a082657c9310
master_os_imagecos-77-12371-89-0
node_os_imagecos-73-11647-163-0
pod03b7704b-392d-11ea-8780-468616f72408
revisionv1.16.6-beta.0.1+94a082657c9310

Test Failures


Kubernetes e2e suite [k8s.io] [sig-cloud-provider-gcp] Upgrade [Feature:Upgrade] master upgrade should maintain a functioning cluster [Feature:MasterUpgrade] 16m54s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-cloud\-provider\-gcp\]\sUpgrade\s\[Feature\:Upgrade\]\smaster\supgrade\sshould\smaintain\sa\sfunctioning\scluster\s\[Feature\:MasterUpgrade\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:91
Jan 17 13:43:50.015: Unexpected error:
    <*errors.errorString | 0xc002e78060>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.2-beta.0]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.6-beta.0.1+94a082657c9310\\\"\\nname: \\\"bootstrap-e2e-minion-group-07kr\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.6-beta.0.1+94a082657c9310\\\"\\nname: \\\"bootstrap-e2e-minion-group-pbpc\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.6-beta.0.1+94a082657c9310\\\"\\nname: \\\"bootstrap-e2e-minion-group-wp5w\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.6-beta.0.1+94a082657c9310\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release/release/v1.17.2-beta.0/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n........................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Upgrading the CoreDNS ConfigMap ==\\nconfigmap/coredns configured\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE     VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m56s   v1.17.1\\nbootstrap-e2e-minion-group-07kr   Ready                      <none>   8m59s   v1.16.6-beta.0.1+94a082657c9310\\nbootstrap-e2e-minion-group-pbpc   Ready                      <none>   8m59s   v1.16.6-beta.0.1+94a082657c9310\\nbootstrap-e2e-minion-group-wp5w   Ready                      <none>   9m      v1.16.6-beta.0.1+94a082657c9310\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\nscheduler            Healthy   ok                  \\ncontroller-manager   Healthy   ok                  \\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.1\\\"\\nname: \\\"bootstrap-e2e-minion-group-07kr\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.6-beta.0.1+94a082657c9310\\\"\\nname: \\\"bootstrap-e2e-minion-group-pbpc\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.6-beta.0.1+94a082657c9310\\\"\\nname: \\\"bootstrap-e2e-minion-group-wp5w\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.6-beta.0.1+94a082657c9310\\\"\\n\", stderr \"Project: k8s-gce-cvm-1-6-1-5-ctl-skew\\nNetwork Project: k8s-gce-cvm-1-6-1-5-ctl-skew\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-07kr bootstrap-e2e-minion-group-pbpc bootstrap-e2e-minion-group-wp5w\\nWARNING: Some requests did not succeed.\\n - Invalid value for field 'zone': 'asia-northeast3-a'. Unknown zone.\\n - Invalid value for field 'zone': 'asia-northeast3-b'. Unknown zone.\\n - Invalid value for field 'zone': 'asia-northeast3-c'. Unknown zone.\\n\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 35.230.5.76; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-1-5-ctl-skew/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-1-5-ctl-skew/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-89-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-114-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP  STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.230.5.76  RUNNING\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: k8s-gce-cvm-1-6-1-5-ctl-skew\\nNetwork Project: k8s-gce-cvm-1-6-1-5-ctl-skew\\nZone: us-west1-b\\nWARNING: Some requests did not succeed.\\n - Invalid value for field 'zone': 'asia-northeast3-a'. Unknown zone.\\n - Invalid value for field 'zone': 'asia-northeast3-b'. Unknown zone.\\n - Invalid value for field 'zone': 'asia-northeast3-c'. Unknown zone.\\n\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.2-beta.0]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.6-beta.0.1+94a082657c9310\"\nname: \"bootstrap-e2e-minion-group-07kr\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.6-beta.0.1+94a082657c9310\"\nname: \"bootstrap-e2e-minion-group-pbpc\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.6-beta.0.1+94a082657c9310\"\nname: \"bootstrap-e2e-minion-group-wp5w\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.6-beta.0.1+94a082657c9310\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release/release/v1.17.2-beta.0/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n........................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Upgrading the CoreDNS ConfigMap ==\nconfigmap/coredns configured\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE     VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m56s   v1.17.1\nbootstrap-e2e-minion-group-07kr   Ready                      <none>   8m59s   v1.16.6-beta.0.1+94a082657c9310\nbootstrap-e2e-minion-group-pbpc   Ready                      <none>   8m59s   v1.16.6-beta.0.1+94a082657c9310\nbootstrap-e2e-minion-group-wp5w   Ready                      <none>   9m      v1.16.6-beta.0.1+94a082657c9310\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\netcd-0               Healthy   {\"health\":\"true\"}   \nscheduler            Healthy   ok                  \ncontroller-manager   Healthy   ok                  \netcd-1               Healthy   {\"health\":\"true\"}   \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.1\"\nname: \"bootstrap-e2e-minion-group-07kr\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.6-beta.0.1+94a082657c9310\"\nname: \"bootstrap-e2e-minion-group-pbpc\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.6-beta.0.1+94a082657c9310\"\nname: \"bootstrap-e2e-minion-group-wp5w\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.6-beta.0.1+94a082657c9310\"\n", stderr "Project: k8s-gce-cvm-1-6-1-5-ctl-skew\nNetwork Project: k8s-gce-cvm-1-6-1-5-ctl-skew\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-07kr bootstrap-e2e-minion-group-pbpc bootstrap-e2e-minion-group-wp5w\nWARNING: Some requests did not succeed.\n - Invalid value for field 'zone': 'asia-northeast3-a'. Unknown zone.\n - Invalid value for field 'zone': 'asia-northeast3-b'. Unknown zone.\n - Invalid value for field 'zone': 'asia-northeast3-c'. Unknown zone.\n\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 35.230.5.76; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-1-5-ctl-skew/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-1-5-ctl-skew/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-89-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-114-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP  STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.230.5.76  RUNNING\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: k8s-gce-cvm-1-6-1-5-ctl-skew\nNetwork Project: k8s-gce-cvm-1-6-1-5-ctl-skew\nZone: us-west1-b\nWARNING: Some requests did not succeed.\n - Invalid value for field 'zone': 'asia-northeast3-a'. Unknown zone.\n - Invalid value for field 'zone': 'asia-northeast3-b'. Unknown zone.\n - Invalid value for field 'zone': 'asia-northeast3-c'. Unknown zone.\n\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:106
				
				Click to see stdout/stderrfrom junit_upgrade01.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-cloud-provider-gcp] master-upgrade 5m12s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-cloud\-provider\-gcp\]\smaster\-upgrade$'
Jan 17 13:43:50.015: Unexpected error:
    <*errors.errorString | 0xc002e78060>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.2-beta.0]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.6-beta.0.1+94a082657c9310\\\"\\nname: \\\"bootstrap-e2e-minion-group-07kr\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.6-beta.0.1+94a082657c9310\\\"\\nname: \\\"bootstrap-e2e-minion-group-pbpc\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.6-beta.0.1+94a082657c9310\\\"\\nname: \\\"bootstrap-e2e-minion-group-wp5w\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.6-beta.0.1+94a082657c9310\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release/release/v1.17.2-beta.0/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n........................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Upgrading the CoreDNS ConfigMap ==\\nconfigmap/coredns configured\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE     VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m56s   v1.17.1\\nbootstrap-e2e-minion-group-07kr   Ready                      <none>   8m59s   v1.16.6-beta.0.1+94a082657c9310\\nbootstrap-e2e-minion-group-pbpc   Ready                      <none>   8m59s   v1.16.6-beta.0.1+94a082657c9310\\nbootstrap-e2e-minion-group-wp5w   Ready                      <none>   9m      v1.16.6-beta.0.1+94a082657c9310\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\nscheduler            Healthy   ok                  \\ncontroller-manager   Healthy   ok                  \\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.1\\\"\\nname: \\\"bootstrap-e2e-minion-group-07kr\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.6-beta.0.1+94a082657c9310\\\"\\nname: \\\"bootstrap-e2e-minion-group-pbpc\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.6-beta.0.1+94a082657c9310\\\"\\nname: \\\"bootstrap-e2e-minion-group-wp5w\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.6-beta.0.1+94a082657c9310\\\"\\n\", stderr \"Project: k8s-gce-cvm-1-6-1-5-ctl-skew\\nNetwork Project: k8s-gce-cvm-1-6-1-5-ctl-skew\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-07kr bootstrap-e2e-minion-group-pbpc bootstrap-e2e-minion-group-wp5w\\nWARNING: Some requests did not succeed.\\n - Invalid value for field 'zone': 'asia-northeast3-a'. Unknown zone.\\n - Invalid value for field 'zone': 'asia-northeast3-b'. Unknown zone.\\n - Invalid value for field 'zone': 'asia-northeast3-c'. Unknown zone.\\n\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 35.230.5.76; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-1-5-ctl-skew/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-1-5-ctl-skew/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-89-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-114-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP  STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.230.5.76  RUNNING\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: k8s-gce-cvm-1-6-1-5-ctl-skew\\nNetwork Project: k8s-gce-cvm-1-6-1-5-ctl-skew\\nZone: us-west1-b\\nWARNING: Some requests did not succeed.\\n - Invalid value for field 'zone': 'asia-northeast3-a'. Unknown zone.\\n - Invalid value for field 'zone': 'asia-northeast3-b'. Unknown zone.\\n - Invalid value for field 'zone': 'asia-northeast3-c'. Unknown zone.\\n\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.2-beta.0]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.6-beta.0.1+94a082657c9310\"\nname: \"bootstrap-e2e-minion-group-07kr\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.6-beta.0.1+94a082657c9310\"\nname: \"bootstrap-e2e-minion-group-pbpc\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.6-beta.0.1+94a082657c9310\"\nname: \"bootstrap-e2e-minion-group-wp5w\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.6-beta.0.1+94a082657c9310\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release/release/v1.17.2-beta.0/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n........................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Upgrading the CoreDNS ConfigMap ==\nconfigmap/coredns configured\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE     VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   8m56s   v1.17.1\nbootstrap-e2e-minion-group-07kr   Ready                      <none>   8m59s   v1.16.6-beta.0.1+94a082657c9310\nbootstrap-e2e-minion-group-pbpc   Ready                      <none>   8m59s   v1.16.6-beta.0.1+94a082657c9310\nbootstrap-e2e-minion-group-wp5w   Ready                      <none>   9m      v1.16.6-beta.0.1+94a082657c9310\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\netcd-0               Healthy   {\"health\":\"true\"}   \nscheduler            Healthy   ok                  \ncontroller-manager   Healthy   ok                  \netcd-1               Healthy   {\"health\":\"true\"}   \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.1\"\nname: \"bootstrap-e2e-minion-group-07kr\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.6-beta.0.1+94a082657c9310\"\nname: \"bootstrap-e2e-minion-group-pbpc\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.6-beta.0.1+94a082657c9310\"\nname: \"bootstrap-e2e-minion-group-wp5w\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.6-beta.0.1+94a082657c9310\"\n", stderr "Project: k8s-gce-cvm-1-6-1-5-ctl-skew\nNetwork Project: k8s-gce-cvm-1-6-1-5-ctl-skew\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-07kr bootstrap-e2e-minion-group-pbpc bootstrap-e2e-minion-group-wp5w\nWARNING: Some requests did not succeed.\n - Invalid value for field 'zone': 'asia-northeast3-a'. Unknown zone.\n - Invalid value for field 'zone': 'asia-northeast3-b'. Unknown zone.\n - Invalid value for field 'zone': 'asia-northeast3-c'. Unknown zone.\n\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 35.230.5.76; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-1-5-ctl-skew/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-gce-cvm-1-6-1-5-ctl-skew/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-89-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-114-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP  STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.230.5.76  RUNNING\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: k8s-gce-cvm-1-6-1-5-ctl-skew\nNetwork Project: k8s-gce-cvm-1-6-1-5-ctl-skew\nZone: us-west1-b\nWARNING: Some requests did not succeed.\n - Invalid value for field 'zone': 'asia-northeast3-a'. Unknown zone.\n - Invalid value for field 'zone': 'asia-northeast3-b'. Unknown zone.\n - Invalid value for field 'zone': 'asia-northeast3-c'. Unknown zone.\n\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred

k8s.io/kubernetes/test/e2e/cloud/gcp.glob..func2.1.1.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:106 +0x12c
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do(0xc002f29200)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:111 +0x38a
k8s.io/kubernetes/test/e2e/cloud/gcp.runUpgradeSuite(0xc000986c80, 0x7bdf120, 0xc, 0xc, 0xc000676e40, 0xc001682a50, 0x0, 0xc00257ff20)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:479 +0x47a
k8s.io/kubernetes/test/e2e/cloud/gcp.glob..func2.1.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:109 +0x222
k8s.io/kubernetes/test/e2e.RunE2ETests(0xc000b02100)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:110 +0x30a
k8s.io/kubernetes/test/e2e.TestE2E(0xc000b02100)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:112 +0x2b
testing.tRunner(0xc000b02100, 0x4c764b0)
	/usr/local/go/src/testing/testing.go:909 +0xc9
created by testing.(*T).Run
	/usr/local/go/src/testing/testing.go:960 +0x350
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


UpgradeTest 17m6s

error during kubetest --test --test_args=--ginkgo.focus=\[Feature:MasterUpgrade\] --upgrade-target=ci/k8s-beta --report-dir=/workspace/_artifacts --disable-log-dump=true --report-prefix=upgrade --check-version-skew=false: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


diffResources 0.00s

Error: 36 leaked resources
+[ compute disks ]
+[ compute addresses ]
+[ compute routes ]
+NAME                            NETWORK  DEST_RANGE     NEXT_HOP                  PRIORITY
+default-route-007f13106e71ab5a  default  10.140.0.0/20  default                   1000
+default-route-07846bd924a1924e  default  10.174.0.0/20  default                   1000
+default-route-09ab27b1086da248  default  10.158.0.0/20  default                   1000
+default-route-0d30f113f86f5a4a  default  10.146.0.0/20  default                   1000
+default-route-0dc08ead18ff31a4  default  10.178.0.0/20  default                   1000
+default-route-2ea974013922040e  default  10.156.0.0/20  default                   1000
+default-route-3028fd243472ebec  default  10.132.0.0/20  default                   1000
+default-route-3311db308c7a6a54  default  10.168.0.0/20  default                   1000
+default-route-4acf76e7bd266ea1  default  10.142.0.0/20  default                   1000
+default-route-53cc9a5eaf00d437  default  10.150.0.0/20  default                   1000
+default-route-54af26cfd15de655  default  10.128.0.0/20  default                   1000
+default-route-72d243f14fcf7e88  default  0.0.0.0/0      default-internet-gateway  1000
+default-route-966f8234c1519dbb  default  10.172.0.0/20  default                   1000
+default-route-a1b0a209b0387c3f  default  10.152.0.0/20  default                   1000
+default-route-af0e3ce0cc18a58e  default  10.164.0.0/20  default                   1000
+default-route-bed94b042e6dc946  default  10.154.0.0/20  default                   1000
+default-route-ca815106d966f120  default  10.148.0.0/20  default                   1000
+default-route-d1210da7eddf566d  default  10.160.0.0/20  default                   1000
+default-route-e3d194804f54456d  default  10.130.0.0/20  default                   1000
+default-route-eff1d5b6013a87a2  default  10.166.0.0/20  default                   1000
+default-route-f6216ab2a093c98c  default  10.162.0.0/20  default                   1000
+default-route-f865b0f713b7b816  default  10.170.0.0/20  default                   1000
+default-route-fe599e07fd451d94  default  10.138.0.0/20  default                   1000
+[ compute firewall-rules ]
+NAME                    NETWORK  DIRECTION  PRIORITY  ALLOW                         DENY  DISABLED
+default-allow-icmp      default  INGRESS    65534     icmp                                False
+default-allow-internal  default  INGRESS    65534     tcp:0-65535,udp:0-65535,icmp        False
+default-allow-rdp       default  INGRESS    65534     tcp:3389                            False
+default-allow-ssh       default  INGRESS    65534     tcp:22                              False
+[ compute forwarding-rules ]
+[ compute target-pools ]
+[ logging sinks ]
				from junit_runner.xml

Filter through log files | View test history on testgrid


listResources Before 1m20s

Failed to list resources (error during ./cluster/gce/list-resources.sh: exit status 2):
Project: k8s-gce-cvm-1-6-1-5-ctl-skew
Region: 
Zone: 
Instance prefix: bootstrap-e2e
Network: bootstrap-e2e
Provider: gce


[ compute instance-templates ]



[ compute instance-groups ]



[ compute instances ]

				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 186 Passed Tests

Show 9416 Skipped Tests