This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 7 failed / 946 succeeded
Started2020-03-22 12:43
Elapsed15h12m
Revision
Buildera53aa62b-6c3a-11ea-85de-3e9df61a68c7
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/fade4d92-b9bc-4ce7-a65a-36f3338cff55/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/fade4d92-b9bc-4ce7-a65a-36f3338cff55/targets/test
infra-commit3d5100e9f
job-versionv1.16.9-beta.0.7+5116ee4b159565
master_os_imagecos-77-12371-175-0
node_os_imagecos-73-11647-163-0
revisionv1.16.9-beta.0.7+5116ee4b159565

Test Failures


Kubernetes e2e suite [k8s.io] [sig-cloud-provider-gcp] Upgrade [Feature:Upgrade] master upgrade should maintain a functioning cluster [Feature:MasterUpgrade] 17m47s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-cloud\-provider\-gcp\]\sUpgrade\s\[Feature\:Upgrade\]\smaster\supgrade\sshould\smaintain\sa\sfunctioning\scluster\s\[Feature\:MasterUpgrade\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:91
Mar 22 12:58:24.008: Unexpected error:
    <*errors.errorString | 0xc003236880>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.11+4dfcd1cc87879f]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.7+5116ee4b159565\\\"\\nname: \\\"bootstrap-e2e-minion-group-8hfk\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.7+5116ee4b159565\\\"\\nname: \\\"bootstrap-e2e-minion-group-mcqk\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.7+5116ee4b159565\\\"\\nname: \\\"bootstrap-e2e-minion-group-qk3x\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.7+5116ee4b159565\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.11+4dfcd1cc87879f/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n......................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Upgrading the CoreDNS ConfigMap ==\\nconfigmap/coredns configured\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE     VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   9m47s   v1.17.5-beta.0.11+4dfcd1cc87879f\\nbootstrap-e2e-minion-group-8hfk   Ready                      <none>   9m49s   v1.16.9-beta.0.7+5116ee4b159565\\nbootstrap-e2e-minion-group-mcqk   Ready                      <none>   9m51s   v1.16.9-beta.0.7+5116ee4b159565\\nbootstrap-e2e-minion-group-qk3x   Ready                      <none>   9m51s   v1.16.9-beta.0.7+5116ee4b159565\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\nscheduler            Healthy   ok                  \\ncontroller-manager   Healthy   ok                  \\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.5-beta.0.11+4dfcd1cc87879f\\\"\\nname: \\\"bootstrap-e2e-minion-group-8hfk\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.7+5116ee4b159565\\\"\\nname: \\\"bootstrap-e2e-minion-group-mcqk\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.7+5116ee4b159565\\\"\\nname: \\\"bootstrap-e2e-minion-group-qk3x\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.7+5116ee4b159565\\\"\\n\", stderr \"Project: k8s-jkns-gci-gce-serial-1-6\\nNetwork Project: k8s-jkns-gci-gce-serial-1-6\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-8hfk bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-qk3x\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 35.227.183.16; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-6/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-6/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP    STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.227.183.16  RUNNING\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: k8s-jkns-gci-gce-serial-1-6\\nNetwork Project: k8s-jkns-gci-gce-serial-1-6\\nZone: us-west1-b\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.11+4dfcd1cc87879f]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.7+5116ee4b159565\"\nname: \"bootstrap-e2e-minion-group-8hfk\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.7+5116ee4b159565\"\nname: \"bootstrap-e2e-minion-group-mcqk\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.7+5116ee4b159565\"\nname: \"bootstrap-e2e-minion-group-qk3x\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.7+5116ee4b159565\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.11+4dfcd1cc87879f/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n......................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Upgrading the CoreDNS ConfigMap ==\nconfigmap/coredns configured\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE     VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   9m47s   v1.17.5-beta.0.11+4dfcd1cc87879f\nbootstrap-e2e-minion-group-8hfk   Ready                      <none>   9m49s   v1.16.9-beta.0.7+5116ee4b159565\nbootstrap-e2e-minion-group-mcqk   Ready                      <none>   9m51s   v1.16.9-beta.0.7+5116ee4b159565\nbootstrap-e2e-minion-group-qk3x   Ready                      <none>   9m51s   v1.16.9-beta.0.7+5116ee4b159565\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\netcd-1               Healthy   {\"health\":\"true\"}   \nscheduler            Healthy   ok                  \ncontroller-manager   Healthy   ok                  \netcd-0               Healthy   {\"health\":\"true\"}   \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.5-beta.0.11+4dfcd1cc87879f\"\nname: \"bootstrap-e2e-minion-group-8hfk\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.7+5116ee4b159565\"\nname: \"bootstrap-e2e-minion-group-mcqk\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.7+5116ee4b159565\"\nname: \"bootstrap-e2e-minion-group-qk3x\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.7+5116ee4b159565\"\n", stderr "Project: k8s-jkns-gci-gce-serial-1-6\nNetwork Project: k8s-jkns-gci-gce-serial-1-6\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-8hfk bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-qk3x\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 35.227.183.16; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-6/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-6/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP    STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.227.183.16  RUNNING\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: k8s-jkns-gci-gce-serial-1-6\nNetwork Project: k8s-jkns-gci-gce-serial-1-6\nZone: us-west1-b\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:106
				
				Click to see stdout/stderrfrom junit_upgrade01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] [sig-node] NodeProblemDetector [DisabledForLargeClusters] should run without error 2m16s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sNodeProblemDetector\s\[DisabledForLargeClusters\]\sshould\srun\swithout\serror$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:58
Mar 22 15:39:18.672: Timed out after 60.001s.
Expected success, but got an error:
    <*errors.errorString | 0xc0037ded60>: {
        s: "Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-8hfk.15feaa6a9e304de8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8hfk.15feaa6a9e304de8 ca146340-e662-41f5-b1da-d10ddff102b4 6347 0 2020-03-22 15:38:13 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8hfk bootstrap-e2e-minion-group-8hfk   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-8hfk} 2020-03-22 15:38:13 +0000 UTC 2020-03-22 15:38:13 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8hfk.15feaa6a9e306e1b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8hfk.15feaa6a9e306e1b 47501855-7e09-4ab6-9a5f-f133584a1bd6 6346 0 2020-03-22 15:38:13 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8hfk bootstrap-e2e-minion-group-8hfk   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-8hfk} 2020-03-22 15:38:13 +0000 UTC 2020-03-22 15:38:13 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15fea128b9cb45cf  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15fea128b9cb45cf 3dcc83e1-d6d2-4c8c-9ace-927bd544b416 5336 0 2020-03-22 14:07:20 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-mcqk} 2020-03-22 12:48:35 +0000 UTC 2020-03-22 15:10:12 +0000 UTC 6 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15fea6b7071aab14  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15fea6b7071aab14 e3b48688-7ca1-4ef5-9e5c-a14de6b9b315 5335 0 2020-03-22 14:30:23 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk 1dcecd58-ad8c-459f-be42-d671a0816fe6   } NodeNotReady Node bootstrap-e2e-minion-group-mcqk status is now: NodeNotReady {node-controller } 2020-03-22 14:30:23 +0000 UTC 2020-03-22 15:10:09 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15fea8e32f3404b4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15fea8e32f3404b4 cee9d2ff-efc8-49ec-a477-71531785e948 5337 0 2020-03-22 15:10:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-mcqk} 2020-03-22 15:10:12 +0000 UTC 2020-03-22 15:10:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15fea8e33b436f40  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15fea8e33b436f40 466efbef-419b-494a-8a74-2d97d4ab09f5 5341 0 2020-03-22 15:10:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-mcqk status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-mcqk} 2020-03-22 15:10:12 +0000 UTC 2020-03-22 15:10:12 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15fea8e33b43a85e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15fea8e33b43a85e d7b9f64c-f6d0-4de0-8c7c-f0115a0e6116 5342 0 2020-03-22 15:10:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-mcqk status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-mcqk} 2020-03-22 15:10:12 +0000 UTC 2020-03-22 15:10:12 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15fea8e33b43db92  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15fea8e33b43db92 6222f057-b34c-4108-a14a-f0741ed8812d 5343 0 2020-03-22 15:10:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-mcqk status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-mcqk} 2020-03-22 15:10:12 +0000 UTC 2020-03-22 15:10:12 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15fea8e33dbc7a81  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15fea8e33dbc7a81 c6b48fd6-08bc-466a-900d-2752e8c4f87f 5344 0 2020-03-22 15:10:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } NodeNotReady Node bootstrap-e2e-minion-group-mcqk status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-mcqk} 2020-03-22 15:10:12 +0000 UTC 2020-03-22 15:10:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15fea8e34d6ce249  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15fea8e34d6ce249 8886574f-1c9b-445b-a038-29d5aa4c5c2c 5345 0 2020-03-22 15:10:13 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-mcqk} 2020-03-22 15:10:13 +0000 UTC 2020-03-22 15:10:13 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15fea8e34fe5ac1b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15fea8e34fe5ac1b 83c49fdf-20e7-4f05-b01d-510df4eaca28 5346 0 2020-03-22 15:10:13 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } NodeReady Node bootstrap-e2e-minion-group-mcqk status is now: NodeReady {kubelet bootstrap-e2e-minion-group-mcqk} 2020-03-22 15:10:13 +0000 UTC 2020-03-22 15:10:13 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15feaa6b29852017  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15feaa6b29852017 742e716f-24bb-4ba6-8446-0f38761727a4 6349 0 2020-03-22 15:38:16 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-mcqk} 2020-03-22 15:38:16 +0000 UTC 2020-03-22 15:38:16 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15feaa6b29854168  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15feaa6b29854168 e1e9146d-703e-4791-aceb-68bb4a03bf67 6348 0 2020-03-22 15:38:16 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-mcqk} 2020-03-22 15:38:16 +0000 UTC 2020-03-22 15:38:16 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qk3x.15feaa6bbad8dd26  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qk3x.15feaa6bbad8dd26 31982b46-a96d-406c-bda7-a1503979af43 6351 0 2020-03-22 15:38:18 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-qk3x bootstrap-e2e-minion-group-qk3x   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-qk3x} 2020-03-22 15:38:18 +0000 UTC 2020-03-22 15:38:18 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qk3x.15feaa6bbad929ba  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qk3x.15feaa6bbad929ba fea7a079-ac2e-42b1-b39d-fd4f1f9bb312 6350 0 2020-03-22 15:38:18 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-qk3x bootstrap-e2e-minion-group-qk3x   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-qk3x} 2020-03-22 15:38:18 +0000 UTC 2020-03-22 15:38:18 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]",
    }
    Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-8hfk.15feaa6a9e304de8  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8hfk.15feaa6a9e304de8 ca146340-e662-41f5-b1da-d10ddff102b4 6347 0 2020-03-22 15:38:13 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8hfk bootstrap-e2e-minion-group-8hfk   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-8hfk} 2020-03-22 15:38:13 +0000 UTC 2020-03-22 15:38:13 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-8hfk.15feaa6a9e306e1b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-8hfk.15feaa6a9e306e1b 47501855-7e09-4ab6-9a5f-f133584a1bd6 6346 0 2020-03-22 15:38:13 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-8hfk bootstrap-e2e-minion-group-8hfk   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-8hfk} 2020-03-22 15:38:13 +0000 UTC 2020-03-22 15:38:13 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15fea128b9cb45cf  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15fea128b9cb45cf 3dcc83e1-d6d2-4c8c-9ace-927bd544b416 5336 0 2020-03-22 14:07:20 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-mcqk} 2020-03-22 12:48:35 +0000 UTC 2020-03-22 15:10:12 +0000 UTC 6 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15fea6b7071aab14  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15fea6b7071aab14 e3b48688-7ca1-4ef5-9e5c-a14de6b9b315 5335 0 2020-03-22 14:30:23 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk 1dcecd58-ad8c-459f-be42-d671a0816fe6   } NodeNotReady Node bootstrap-e2e-minion-group-mcqk status is now: NodeNotReady {node-controller } 2020-03-22 14:30:23 +0000 UTC 2020-03-22 15:10:09 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15fea8e32f3404b4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15fea8e32f3404b4 cee9d2ff-efc8-49ec-a477-71531785e948 5337 0 2020-03-22 15:10:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-mcqk} 2020-03-22 15:10:12 +0000 UTC 2020-03-22 15:10:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15fea8e33b436f40  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15fea8e33b436f40 466efbef-419b-494a-8a74-2d97d4ab09f5 5341 0 2020-03-22 15:10:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-mcqk status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-mcqk} 2020-03-22 15:10:12 +0000 UTC 2020-03-22 15:10:12 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15fea8e33b43a85e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15fea8e33b43a85e d7b9f64c-f6d0-4de0-8c7c-f0115a0e6116 5342 0 2020-03-22 15:10:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-mcqk status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-mcqk} 2020-03-22 15:10:12 +0000 UTC 2020-03-22 15:10:12 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15fea8e33b43db92  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15fea8e33b43db92 6222f057-b34c-4108-a14a-f0741ed8812d 5343 0 2020-03-22 15:10:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-mcqk status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-mcqk} 2020-03-22 15:10:12 +0000 UTC 2020-03-22 15:10:12 +0000 UTC 2 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15fea8e33dbc7a81  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15fea8e33dbc7a81 c6b48fd6-08bc-466a-900d-2752e8c4f87f 5344 0 2020-03-22 15:10:12 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } NodeNotReady Node bootstrap-e2e-minion-group-mcqk status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-mcqk} 2020-03-22 15:10:12 +0000 UTC 2020-03-22 15:10:12 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15fea8e34d6ce249  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15fea8e34d6ce249 8886574f-1c9b-445b-a038-29d5aa4c5c2c 5345 0 2020-03-22 15:10:13 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-mcqk} 2020-03-22 15:10:13 +0000 UTC 2020-03-22 15:10:13 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15fea8e34fe5ac1b  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15fea8e34fe5ac1b 83c49fdf-20e7-4f05-b01d-510df4eaca28 5346 0 2020-03-22 15:10:13 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } NodeReady Node bootstrap-e2e-minion-group-mcqk status is now: NodeReady {kubelet bootstrap-e2e-minion-group-mcqk} 2020-03-22 15:10:13 +0000 UTC 2020-03-22 15:10:13 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15feaa6b29852017  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15feaa6b29852017 742e716f-24bb-4ba6-8446-0f38761727a4 6349 0 2020-03-22 15:38:16 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-mcqk} 2020-03-22 15:38:16 +0000 UTC 2020-03-22 15:38:16 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mcqk.15feaa6b29854168  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mcqk.15feaa6b29854168 e1e9146d-703e-4791-aceb-68bb4a03bf67 6348 0 2020-03-22 15:38:16 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-mcqk   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-mcqk} 2020-03-22 15:38:16 +0000 UTC 2020-03-22 15:38:16 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qk3x.15feaa6bbad8dd26  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qk3x.15feaa6bbad8dd26 31982b46-a96d-406c-bda7-a1503979af43 6351 0 2020-03-22 15:38:18 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-qk3x bootstrap-e2e-minion-group-qk3x   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-qk3x} 2020-03-22 15:38:18 +0000 UTC 2020-03-22 15:38:18 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-qk3x.15feaa6bbad929ba  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-qk3x.15feaa6bbad929ba fea7a079-ac2e-42b1-b39d-fd4f1f9bb312 6350 0 2020-03-22 15:38:18 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-qk3x bootstrap-e2e-minion-group-qk3x   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-qk3x} 2020-03-22 15:38:18 +0000 UTC 2020-03-22 15:38:18 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:141
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [sig-apps] StatefulSet [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] should not deadlock when a pod's predecessor fails 1m32s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sStatefulSet\s\[k8s\.io\]\sBasic\sStatefulSet\sfunctionality\s\[StatefulSetBasic\]\sshould\snot\sdeadlock\swhen\sa\spod\'s\spredecessor\sfails$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:88
Mar 23 03:43:30.858: Failed waiting for stateful set status.replicas updated to 0: statefulsets.apps "ss" not found
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset/wait.go:272
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-cloud-provider-gcp] master-upgrade 5m23s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-cloud\-provider\-gcp\]\smaster\-upgrade$'
Mar 22 12:58:24.008: Unexpected error:
    <*errors.errorString | 0xc003236880>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.11+4dfcd1cc87879f]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.7+5116ee4b159565\\\"\\nname: \\\"bootstrap-e2e-minion-group-8hfk\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.7+5116ee4b159565\\\"\\nname: \\\"bootstrap-e2e-minion-group-mcqk\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.7+5116ee4b159565\\\"\\nname: \\\"bootstrap-e2e-minion-group-qk3x\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.7+5116ee4b159565\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.11+4dfcd1cc87879f/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n......................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Upgrading the CoreDNS ConfigMap ==\\nconfigmap/coredns configured\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE     VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   9m47s   v1.17.5-beta.0.11+4dfcd1cc87879f\\nbootstrap-e2e-minion-group-8hfk   Ready                      <none>   9m49s   v1.16.9-beta.0.7+5116ee4b159565\\nbootstrap-e2e-minion-group-mcqk   Ready                      <none>   9m51s   v1.16.9-beta.0.7+5116ee4b159565\\nbootstrap-e2e-minion-group-qk3x   Ready                      <none>   9m51s   v1.16.9-beta.0.7+5116ee4b159565\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\nscheduler            Healthy   ok                  \\ncontroller-manager   Healthy   ok                  \\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.5-beta.0.11+4dfcd1cc87879f\\\"\\nname: \\\"bootstrap-e2e-minion-group-8hfk\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.7+5116ee4b159565\\\"\\nname: \\\"bootstrap-e2e-minion-group-mcqk\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.7+5116ee4b159565\\\"\\nname: \\\"bootstrap-e2e-minion-group-qk3x\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.7+5116ee4b159565\\\"\\n\", stderr \"Project: k8s-jkns-gci-gce-serial-1-6\\nNetwork Project: k8s-jkns-gci-gce-serial-1-6\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-8hfk bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-qk3x\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 35.227.183.16; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-6/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-6/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP    STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.227.183.16  RUNNING\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: k8s-jkns-gci-gce-serial-1-6\\nNetwork Project: k8s-jkns-gci-gce-serial-1-6\\nZone: us-west1-b\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.11+4dfcd1cc87879f]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.7+5116ee4b159565\"\nname: \"bootstrap-e2e-minion-group-8hfk\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.7+5116ee4b159565\"\nname: \"bootstrap-e2e-minion-group-mcqk\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.7+5116ee4b159565\"\nname: \"bootstrap-e2e-minion-group-qk3x\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.7+5116ee4b159565\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.11+4dfcd1cc87879f/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n......................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Upgrading the CoreDNS ConfigMap ==\nconfigmap/coredns configured\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE     VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   9m47s   v1.17.5-beta.0.11+4dfcd1cc87879f\nbootstrap-e2e-minion-group-8hfk   Ready                      <none>   9m49s   v1.16.9-beta.0.7+5116ee4b159565\nbootstrap-e2e-minion-group-mcqk   Ready                      <none>   9m51s   v1.16.9-beta.0.7+5116ee4b159565\nbootstrap-e2e-minion-group-qk3x   Ready                      <none>   9m51s   v1.16.9-beta.0.7+5116ee4b159565\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\netcd-1               Healthy   {\"health\":\"true\"}   \nscheduler            Healthy   ok                  \ncontroller-manager   Healthy   ok                  \netcd-0               Healthy   {\"health\":\"true\"}   \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.5-beta.0.11+4dfcd1cc87879f\"\nname: \"bootstrap-e2e-minion-group-8hfk\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.7+5116ee4b159565\"\nname: \"bootstrap-e2e-minion-group-mcqk\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.7+5116ee4b159565\"\nname: \"bootstrap-e2e-minion-group-qk3x\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.7+5116ee4b159565\"\n", stderr "Project: k8s-jkns-gci-gce-serial-1-6\nNetwork Project: k8s-jkns-gci-gce-serial-1-6\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-8hfk bootstrap-e2e-minion-group-mcqk bootstrap-e2e-minion-group-qk3x\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 35.227.183.16; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-6/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-gci-gce-serial-1-6/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP    STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   35.227.183.16  RUNNING\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: k8s-jkns-gci-gce-serial-1-6\nNetwork Project: k8s-jkns-gci-gce-serial-1-6\nZone: us-west1-b\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred

k8s.io/kubernetes/test/e2e/cloud/gcp.glob..func2.1.1.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:106 +0x12c
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do(0xc00367d200)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:111 +0x38a
k8s.io/kubernetes/test/e2e/cloud/gcp.runUpgradeSuite(0xc0008dde00, 0x7757ca0, 0xc, 0xc, 0xc000663560, 0xc00250c690, 0x0, 0xc00227a020)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:479 +0x47a
k8s.io/kubernetes/test/e2e/cloud/gcp.glob..func2.1.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:109 +0x222
k8s.io/kubernetes/test/e2e.RunE2ETests(0xc000316500)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:110 +0x30a
k8s.io/kubernetes/test/e2e.TestE2E(0xc000316500)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:112 +0x2b
testing.tRunner(0xc000316500, 0x49f9638)
	/usr/local/go/src/testing/testing.go:909 +0xc9
created by testing.(*T).Run
	/usr/local/go/src/testing/testing.go:960 +0x350
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Test 14h36m

error during ./hack/ginkgo-e2e.sh --kubectl-path=../../../../kubernetes_skew/cluster/kubectl.sh --minStartupPods=8 --report-dir=/workspace/_artifacts --disable-log-dump=true (interrupted): exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Timeout 15h0m

kubetest --timeout triggered
				from junit_runner.xml

Filter through log files | View test history on testgrid


UpgradeTest 18m4s

error during kubetest --test --test_args=--ginkgo.focus=\[Feature:MasterUpgrade\] --upgrade-target=ci/k8s-stable1 --report-dir=/workspace/_artifacts --disable-log-dump=true --report-prefix=upgrade --check-version-skew=false: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 946 Passed Tests