This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 10 failed / 884 succeeded
Started2020-03-31 06:40
Elapsed15h12m
Revision
Builder743981e7-731a-11ea-8574-7e2b78ec67cb
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/b204edc9-a7c9-4740-b2ce-54b759d1a627/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/b204edc9-a7c9-4740-b2ce-54b759d1a627/targets/test
infra-commitab008788a
job-versionv1.16.9-beta.0.17+bb616cba1cc983
master_os_imagecos-77-12371-175-0
node_os_imagecos-73-11647-163-0
revisionv1.16.9-beta.0.17+bb616cba1cc983

Test Failures


Kubernetes e2e suite [k8s.io] [sig-cloud-provider-gcp] Upgrade [Feature:Upgrade] master upgrade should maintain a functioning cluster [Feature:MasterUpgrade] 18m2s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-cloud\-provider\-gcp\]\sUpgrade\s\[Feature\:Upgrade\]\smaster\supgrade\sshould\smaintain\sa\sfunctioning\scluster\s\[Feature\:MasterUpgrade\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:91
Mar 31 06:56:11.579: Unexpected error:
    <*errors.errorString | 0xc0030ec5d0>: {
        s: "error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.22+ea3eeb494a528e]; got error exit status 1, stdout \"Fetching the previously installed CoreDNS version\\n\\n***WARNING***\\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\\nbefore running this script:\\n\\n# example: pin to etcd v3.0.17\\nexport ETCD_IMAGE=3.0.17\\nexport ETCD_VERSION=3.0.17\\n\\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\\n\\n== Pre-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-05lj\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-mhv9\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-nc9t\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.22+ea3eeb494a528e/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\\n== Upgrading master environment variables. ==\\n== Waiting for new master to respond to API requests ==\\n........................== Done ==\\nWaiting for CoreDNS to update\\nFetching the latest installed CoreDNS version\\n== Downloading the CoreDNS migration tool ==\\n== Upgrading the CoreDNS ConfigMap ==\\nconfigmap/coredns configured\\n== The CoreDNS Config has been updated ==\\n== Validating cluster post-upgrade ==\\nValidating gce cluster, MULTIZONE=\\nFound 4 node(s).\\nNAME                              STATUS                     ROLES    AGE     VERSION\\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   9m37s   v1.17.5-beta.0.22+ea3eeb494a528e\\nbootstrap-e2e-minion-group-05lj   Ready                      <none>   9m41s   v1.16.9-beta.0.17+bb616cba1cc983\\nbootstrap-e2e-minion-group-mhv9   Ready                      <none>   9m40s   v1.16.9-beta.0.17+bb616cba1cc983\\nbootstrap-e2e-minion-group-nc9t   Ready                      <none>   9m31s   v1.16.9-beta.0.17+bb616cba1cc983\\nValidate output:\\nNAME                 STATUS    MESSAGE             ERROR\\netcd-1               Healthy   {\\\"health\\\":\\\"true\\\"}   \\nscheduler            Healthy   ok                  \\ncontroller-manager   Healthy   ok                  \\netcd-0               Healthy   {\\\"health\\\":\\\"true\\\"}   \\n\\x1b[0;32mCluster validation succeeded\\x1b[0m\\n== Post-Upgrade Node OS and Kubelet Versions ==\\nname: \\\"bootstrap-e2e-master\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.17.5-beta.0.22+ea3eeb494a528e\\\"\\nname: \\\"bootstrap-e2e-minion-group-05lj\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-mhv9\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\nname: \\\"bootstrap-e2e-minion-group-nc9t\\\", osImage: \\\"Container-Optimized OS from Google\\\", kubeletVersion: \\\"v1.16.9-beta.0.17+bb616cba1cc983\\\"\\n\", stderr \"Project: ci-k8s-e2e-gci-tip-gce\\nNetwork Project: ci-k8s-e2e-gci-tip-gce\\nZone: us-west1-b\\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\\nNODE_NAMES=bootstrap-e2e-minion-group-05lj bootstrap-e2e-minion-group-mhv9 bootstrap-e2e-minion-group-nc9t\\nTrying to find master named 'bootstrap-e2e-master'\\nLooking for address 'bootstrap-e2e-master-ip'\\nUsing master: bootstrap-e2e-master (external IP: 34.82.223.167; internal IP: (not set))\\nDeleted [https://www.googleapis.com/compute/v1/projects/ci-k8s-e2e-gci-tip-gce/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\\nCreated [https://www.googleapis.com/compute/v1/projects/ci-k8s-e2e-gci-tip-gce/zones/us-west1-b/instances/bootstrap-e2e-master].\\nWARNING: Some requests generated warnings:\\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\\n\\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP    STATUS\\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   34.82.223.167  RUNNING\\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\\nProject: ci-k8s-e2e-gci-tip-gce\\nNetwork Project: ci-k8s-e2e-gci-tip-gce\\nZone: us-west1-b\\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\\n\"",
    }
    error running /workspace/kubernetes_skew/cluster/gce/upgrade.sh [-M v1.17.5-beta.0.22+ea3eeb494a528e]; got error exit status 1, stdout "Fetching the previously installed CoreDNS version\n\n***WARNING***\nUpgrading Kubernetes with this script might result in an upgrade to a new etcd version.\nSome etcd version upgrades, such as 3.0.x to 3.1.x, DO NOT offer a downgrade path.\nTo pin the etcd version to your current one (e.g. v3.0.17), set the following variables\nbefore running this script:\n\n# example: pin to etcd v3.0.17\nexport ETCD_IMAGE=3.0.17\nexport ETCD_VERSION=3.0.17\n\nAlternatively, if you choose to allow an etcd upgrade that doesn't support downgrade,\nyou might still be able to downgrade Kubernetes by pinning to the newer etcd version.\nIn all cases, it is strongly recommended to have an etcd backup before upgrading.\n\n== Pre-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-05lj\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-mhv9\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-nc9t\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nFound subnet for region us-west1 in network bootstrap-e2e: bootstrap-e2e\n== Upgrading master to 'https://storage.googleapis.com/kubernetes-release-dev/ci/v1.17.5-beta.0.22+ea3eeb494a528e/kubernetes-server-linux-amd64.tar.gz'. Do not interrupt, deleting master instance. ==\n== Upgrading master environment variables. ==\n== Waiting for new master to respond to API requests ==\n........................== Done ==\nWaiting for CoreDNS to update\nFetching the latest installed CoreDNS version\n== Downloading the CoreDNS migration tool ==\n== Upgrading the CoreDNS ConfigMap ==\nconfigmap/coredns configured\n== The CoreDNS Config has been updated ==\n== Validating cluster post-upgrade ==\nValidating gce cluster, MULTIZONE=\nFound 4 node(s).\nNAME                              STATUS                     ROLES    AGE     VERSION\nbootstrap-e2e-master              Ready,SchedulingDisabled   <none>   9m37s   v1.17.5-beta.0.22+ea3eeb494a528e\nbootstrap-e2e-minion-group-05lj   Ready                      <none>   9m41s   v1.16.9-beta.0.17+bb616cba1cc983\nbootstrap-e2e-minion-group-mhv9   Ready                      <none>   9m40s   v1.16.9-beta.0.17+bb616cba1cc983\nbootstrap-e2e-minion-group-nc9t   Ready                      <none>   9m31s   v1.16.9-beta.0.17+bb616cba1cc983\nValidate output:\nNAME                 STATUS    MESSAGE             ERROR\netcd-1               Healthy   {\"health\":\"true\"}   \nscheduler            Healthy   ok                  \ncontroller-manager   Healthy   ok                  \netcd-0               Healthy   {\"health\":\"true\"}   \n\x1b[0;32mCluster validation succeeded\x1b[0m\n== Post-Upgrade Node OS and Kubelet Versions ==\nname: \"bootstrap-e2e-master\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.17.5-beta.0.22+ea3eeb494a528e\"\nname: \"bootstrap-e2e-minion-group-05lj\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-mhv9\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\nname: \"bootstrap-e2e-minion-group-nc9t\", osImage: \"Container-Optimized OS from Google\", kubeletVersion: \"v1.16.9-beta.0.17+bb616cba1cc983\"\n", stderr "Project: ci-k8s-e2e-gci-tip-gce\nNetwork Project: ci-k8s-e2e-gci-tip-gce\nZone: us-west1-b\nINSTANCE_GROUPS=bootstrap-e2e-minion-group\nNODE_NAMES=bootstrap-e2e-minion-group-05lj bootstrap-e2e-minion-group-mhv9 bootstrap-e2e-minion-group-nc9t\nTrying to find master named 'bootstrap-e2e-master'\nLooking for address 'bootstrap-e2e-master-ip'\nUsing master: bootstrap-e2e-master (external IP: 34.82.223.167; internal IP: (not set))\nDeleted [https://www.googleapis.com/compute/v1/projects/ci-k8s-e2e-gci-tip-gce/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.\nCreated [https://www.googleapis.com/compute/v1/projects/ci-k8s-e2e-gci-tip-gce/zones/us-west1-b/instances/bootstrap-e2e-master].\nWARNING: Some requests generated warnings:\n - Disk size: '20 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.\n - The resource 'projects/cos-cloud/global/images/cos-77-12371-175-0' is deprecated. A suggested replacement is 'projects/cos-cloud/global/images/cos-77-12371-183-0'.\n\nNAME                  ZONE        MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP    STATUS\nbootstrap-e2e-master  us-west1-b  n1-standard-1               10.138.0.6   34.82.223.167  RUNNING\nWarning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply\nProject: ci-k8s-e2e-gci-tip-gce\nNetwork Project: ci-k8s-e2e-gci-tip-gce\nZone: us-west1-b\n/workspace/kubernetes_skew/cluster/gce/upgrade.sh: line 452: download_dir: unbound variable\n"
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/cloud/gcp/cluster_upgrade.go:106
				
				Click to see stdout/stderrfrom junit_upgrade01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [k8s.io] [sig-node] NodeProblemDetector [DisabledForLargeClusters] should run without error 2m18s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[k8s\.io\]\s\[sig\-node\]\sNodeProblemDetector\s\[DisabledForLargeClusters\]\sshould\srun\swithout\serror$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:58
Mar 31 12:54:54.777: Timed out after 60.001s.
Expected success, but got an error:
    <*errors.errorString | 0xc002fad4b0>: {
        s: "Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-mhv9.16016164fe4db9f9  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mhv9.16016164fe4db9f9 18746ce9-8a45-4f8f-a008-ecaa3818fbf5 13056 0 2020-03-31 11:53:50 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mhv9 bootstrap-e2e-minion-group-mhv9   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-mhv9 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-mhv9} 2020-03-31 11:53:50 +0000 UTC 2020-03-31 12:49:44 +0000 UTC 19 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mhv9.16016164fe53b821  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mhv9.16016164fe53b821 e5c5aa90-5c63-403b-a380-996b70e4b4ae 13020 0 2020-03-31 11:53:50 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mhv9 bootstrap-e2e-minion-group-mhv9   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-mhv9 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-mhv9} 2020-03-31 11:53:50 +0000 UTC 2020-03-31 12:46:52 +0000 UTC 10 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mhv9.16016164fe58e0d4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mhv9.16016164fe58e0d4 67be1415-3d9c-4531-97ea-f3a2e5792c2a 13021 0 2020-03-31 11:53:50 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mhv9 bootstrap-e2e-minion-group-mhv9   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-mhv9 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-mhv9} 2020-03-31 11:53:50 +0000 UTC 2020-03-31 12:46:52 +0000 UTC 10 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mhv9.1601643cc4adca95  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mhv9.1601643cc4adca95 a51c942f-0f2e-4d9f-b76f-e7788b4b693d 12991 0 2020-03-31 12:45:55 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mhv9 6fb75e8f-96af-430c-8804-7f957b6b080b   } RemovingNode Node bootstrap-e2e-minion-group-mhv9 event: Removing Node bootstrap-e2e-minion-group-mhv9 from Controller {node-controller } 2020-03-31 12:45:55 +0000 UTC 2020-03-31 12:45:55 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mhv9.16016492ecca1c3c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mhv9.16016492ecca1c3c fa0f524b-01a0-4967-b640-2024b5192a4f 13071 0 2020-03-31 12:52:06 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mhv9 c807e568-9e10-4bd2-97a4-8dbcf4af029b   } RegisteredNode Node bootstrap-e2e-minion-group-mhv9 event: Registered Node bootstrap-e2e-minion-group-mhv9 in Controller {node-controller } 2020-03-31 12:52:06 +0000 UTC 2020-03-31 12:52:06 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mhv9.160164ab0cb08f18  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mhv9.160164ab0cb08f18 4f878e6e-fb88-45ca-a5bb-4e97020a1ea4 13108 0 2020-03-31 12:53:49 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mhv9 bootstrap-e2e-minion-group-mhv9   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-mhv9} 2020-03-31 12:53:49 +0000 UTC 2020-03-31 12:53:49 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mhv9.160164ab0cb0e155  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mhv9.160164ab0cb0e155 875eb572-4da6-4589-9e52-c192babeacc5 13107 0 2020-03-31 12:53:49 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mhv9 bootstrap-e2e-minion-group-mhv9   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-mhv9} 2020-03-31 12:53:49 +0000 UTC 2020-03-31 12:53:49 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-nc9t.160164aba6197efb  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-nc9t.160164aba6197efb 0c101d54-d7fb-468a-8e06-a3021d6b4c09 13109 0 2020-03-31 12:53:52 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-nc9t bootstrap-e2e-minion-group-nc9t   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-nc9t} 2020-03-31 12:53:52 +0000 UTC 2020-03-31 12:53:52 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-nc9t.160164aba61eae8e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-nc9t.160164aba61eae8e d997f092-4a6a-4247-8c49-0185b00d3db6 13110 0 2020-03-31 12:53:52 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-nc9t bootstrap-e2e-minion-group-nc9t   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-nc9t} 2020-03-31 12:53:52 +0000 UTC 2020-03-31 12:53:52 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.16015c04a621e98c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.16015c04a621e98c 1ce935fa-0c29-4ec8-b845-b12edd583cf2 12557 0 2020-03-31 12:38:32 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-rz8p} 2020-03-31 10:15:18 +0000 UTC 2020-03-31 12:38:32 +0000 UTC 3 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.160163d5779f54ce  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.160163d5779f54ce aa7fdd5f-e3c9-49cb-ad35-2750781948ad 12558 0 2020-03-31 12:38:32 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-rz8p} 2020-03-31 12:38:32 +0000 UTC 2020-03-31 12:38:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.160163d5864b328d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.160163d5864b328d a690d926-90b4-48ba-8ef1-557838cc7cf8 12559 0 2020-03-31 12:38:32 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-rz8p status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-rz8p} 2020-03-31 12:38:32 +0000 UTC 2020-03-31 12:38:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.160163d5864b87e0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.160163d5864b87e0 5b109eb8-1fdc-4e71-9590-cafe98d75433 12560 0 2020-03-31 12:38:32 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-rz8p status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-rz8p} 2020-03-31 12:38:32 +0000 UTC 2020-03-31 12:38:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.160163d5864bc58f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.160163d5864bc58f bc49ee03-6890-4bac-9706-e84f4b4ffe2c 12561 0 2020-03-31 12:38:32 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-rz8p status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-rz8p} 2020-03-31 12:38:32 +0000 UTC 2020-03-31 12:38:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.160163d58a297f0e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.160163d58a297f0e 5bd8219c-944b-4ee7-848e-711219761c18 12562 0 2020-03-31 12:38:32 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } NodeNotReady Node bootstrap-e2e-minion-group-rz8p status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-rz8p} 2020-03-31 12:38:32 +0000 UTC 2020-03-31 12:38:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.160163d598c8aba1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.160163d598c8aba1 645300dc-5018-4e6f-834e-8d37f27f325b 12563 0 2020-03-31 12:38:32 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-rz8p} 2020-03-31 12:38:32 +0000 UTC 2020-03-31 12:38:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.160163d59a8ee325  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.160163d59a8ee325 cce7b833-a806-4cb1-9a98-8daa2154729a 12564 0 2020-03-31 12:38:32 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } NodeReady Node bootstrap-e2e-minion-group-rz8p status is now: NodeReady {kubelet bootstrap-e2e-minion-group-rz8p} 2020-03-31 12:38:32 +0000 UTC 2020-03-31 12:38:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.160164ac32efdd0d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.160164ac32efdd0d 0f57c78c-bbef-4bca-a75b-a3b6f44f9230 13112 0 2020-03-31 12:53:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-rz8p} 2020-03-31 12:53:54 +0000 UTC 2020-03-31 12:53:54 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.160164ac32f01a32  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.160164ac32f01a32 41f31189-54be-4759-949d-51dd4e79b4e2 13111 0 2020-03-31 12:53:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-rz8p} 2020-03-31 12:53:54 +0000 UTC 2020-03-31 12:53:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]",
    }
    Event KubeletStart does not exist: [{{ } {bootstrap-e2e-minion-group-mhv9.16016164fe4db9f9  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mhv9.16016164fe4db9f9 18746ce9-8a45-4f8f-a008-ecaa3818fbf5 13056 0 2020-03-31 11:53:50 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mhv9 bootstrap-e2e-minion-group-mhv9   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-mhv9 status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-mhv9} 2020-03-31 11:53:50 +0000 UTC 2020-03-31 12:49:44 +0000 UTC 19 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mhv9.16016164fe53b821  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mhv9.16016164fe53b821 e5c5aa90-5c63-403b-a380-996b70e4b4ae 13020 0 2020-03-31 11:53:50 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mhv9 bootstrap-e2e-minion-group-mhv9   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-mhv9 status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-mhv9} 2020-03-31 11:53:50 +0000 UTC 2020-03-31 12:46:52 +0000 UTC 10 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mhv9.16016164fe58e0d4  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mhv9.16016164fe58e0d4 67be1415-3d9c-4531-97ea-f3a2e5792c2a 13021 0 2020-03-31 11:53:50 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mhv9 bootstrap-e2e-minion-group-mhv9   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-mhv9 status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-mhv9} 2020-03-31 11:53:50 +0000 UTC 2020-03-31 12:46:52 +0000 UTC 10 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mhv9.1601643cc4adca95  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mhv9.1601643cc4adca95 a51c942f-0f2e-4d9f-b76f-e7788b4b693d 12991 0 2020-03-31 12:45:55 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mhv9 6fb75e8f-96af-430c-8804-7f957b6b080b   } RemovingNode Node bootstrap-e2e-minion-group-mhv9 event: Removing Node bootstrap-e2e-minion-group-mhv9 from Controller {node-controller } 2020-03-31 12:45:55 +0000 UTC 2020-03-31 12:45:55 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mhv9.16016492ecca1c3c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mhv9.16016492ecca1c3c fa0f524b-01a0-4967-b640-2024b5192a4f 13071 0 2020-03-31 12:52:06 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mhv9 c807e568-9e10-4bd2-97a4-8dbcf4af029b   } RegisteredNode Node bootstrap-e2e-minion-group-mhv9 event: Registered Node bootstrap-e2e-minion-group-mhv9 in Controller {node-controller } 2020-03-31 12:52:06 +0000 UTC 2020-03-31 12:52:06 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mhv9.160164ab0cb08f18  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mhv9.160164ab0cb08f18 4f878e6e-fb88-45ca-a5bb-4e97020a1ea4 13108 0 2020-03-31 12:53:49 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mhv9 bootstrap-e2e-minion-group-mhv9   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-mhv9} 2020-03-31 12:53:49 +0000 UTC 2020-03-31 12:53:49 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-mhv9.160164ab0cb0e155  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-mhv9.160164ab0cb0e155 875eb572-4da6-4589-9e52-c192babeacc5 13107 0 2020-03-31 12:53:49 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-mhv9 bootstrap-e2e-minion-group-mhv9   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-mhv9} 2020-03-31 12:53:49 +0000 UTC 2020-03-31 12:53:49 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-nc9t.160164aba6197efb  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-nc9t.160164aba6197efb 0c101d54-d7fb-468a-8e06-a3021d6b4c09 13109 0 2020-03-31 12:53:52 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-nc9t bootstrap-e2e-minion-group-nc9t   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-nc9t} 2020-03-31 12:53:52 +0000 UTC 2020-03-31 12:53:52 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-nc9t.160164aba61eae8e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-nc9t.160164aba61eae8e d997f092-4a6a-4247-8c49-0185b00d3db6 13110 0 2020-03-31 12:53:52 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-nc9t bootstrap-e2e-minion-group-nc9t   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-nc9t} 2020-03-31 12:53:52 +0000 UTC 2020-03-31 12:53:52 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.16015c04a621e98c  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.16015c04a621e98c 1ce935fa-0c29-4ec8-b845-b12edd583cf2 12557 0 2020-03-31 12:38:32 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } KubeletStart Started Kubernetes kubelet. {systemd-monitor bootstrap-e2e-minion-group-rz8p} 2020-03-31 10:15:18 +0000 UTC 2020-03-31 12:38:32 +0000 UTC 3 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.160163d5779f54ce  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.160163d5779f54ce aa7fdd5f-e3c9-49cb-ad35-2750781948ad 12558 0 2020-03-31 12:38:32 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } Starting Starting kubelet. {kubelet bootstrap-e2e-minion-group-rz8p} 2020-03-31 12:38:32 +0000 UTC 2020-03-31 12:38:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.160163d5864b328d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.160163d5864b328d a690d926-90b4-48ba-8ef1-557838cc7cf8 12559 0 2020-03-31 12:38:32 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } NodeHasSufficientMemory Node bootstrap-e2e-minion-group-rz8p status is now: NodeHasSufficientMemory {kubelet bootstrap-e2e-minion-group-rz8p} 2020-03-31 12:38:32 +0000 UTC 2020-03-31 12:38:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.160163d5864b87e0  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.160163d5864b87e0 5b109eb8-1fdc-4e71-9590-cafe98d75433 12560 0 2020-03-31 12:38:32 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } NodeHasNoDiskPressure Node bootstrap-e2e-minion-group-rz8p status is now: NodeHasNoDiskPressure {kubelet bootstrap-e2e-minion-group-rz8p} 2020-03-31 12:38:32 +0000 UTC 2020-03-31 12:38:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.160163d5864bc58f  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.160163d5864bc58f bc49ee03-6890-4bac-9706-e84f4b4ffe2c 12561 0 2020-03-31 12:38:32 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } NodeHasSufficientPID Node bootstrap-e2e-minion-group-rz8p status is now: NodeHasSufficientPID {kubelet bootstrap-e2e-minion-group-rz8p} 2020-03-31 12:38:32 +0000 UTC 2020-03-31 12:38:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.160163d58a297f0e  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.160163d58a297f0e 5bd8219c-944b-4ee7-848e-711219761c18 12562 0 2020-03-31 12:38:32 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } NodeNotReady Node bootstrap-e2e-minion-group-rz8p status is now: NodeNotReady {kubelet bootstrap-e2e-minion-group-rz8p} 2020-03-31 12:38:32 +0000 UTC 2020-03-31 12:38:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.160163d598c8aba1  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.160163d598c8aba1 645300dc-5018-4e6f-834e-8d37f27f325b 12563 0 2020-03-31 12:38:32 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } NodeAllocatableEnforced Updated Node Allocatable limit across pods {kubelet bootstrap-e2e-minion-group-rz8p} 2020-03-31 12:38:32 +0000 UTC 2020-03-31 12:38:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.160163d59a8ee325  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.160163d59a8ee325 cce7b833-a806-4cb1-9a98-8daa2154729a 12564 0 2020-03-31 12:38:32 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } NodeReady Node bootstrap-e2e-minion-group-rz8p status is now: NodeReady {kubelet bootstrap-e2e-minion-group-rz8p} 2020-03-31 12:38:32 +0000 UTC 2020-03-31 12:38:32 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.160164ac32efdd0d  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.160164ac32efdd0d 0f57c78c-bbef-4bca-a75b-a3b6f44f9230 13112 0 2020-03-31 12:53:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } TaskHung kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds. {kernel-monitor bootstrap-e2e-minion-group-rz8p} 2020-03-31 12:53:54 +0000 UTC 2020-03-31 12:53:54 +0000 UTC 1 Warning 0001-01-01 00:00:00 +0000 UTC nil  nil  } {{ } {bootstrap-e2e-minion-group-rz8p.160164ac32f01a32  default /api/v1/namespaces/default/events/bootstrap-e2e-minion-group-rz8p.160164ac32f01a32 41f31189-54be-4759-949d-51dd4e79b4e2 13111 0 2020-03-31 12:53:54 +0000 UTC <nil> <nil> map[] map[] [] []  []} {Node  bootstrap-e2e-minion-group-rz8p bootstrap-e2e-minion-group-rz8p   } AUFSUmountHung Node condition KernelDeadlock is now: True, reason: AUFSUmountHung {kernel-monitor bootstrap-e2e-minion-group-rz8p} 2020-03-31 12:53:54 +0000 UTC 2020-03-31 12:53:54 +0000 UTC 1 Normal 0001-01-01 00:00:00 +0000 UTC nil  nil  }]
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:141
				
				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: gcepd] [Testpattern: Dynamic PV (default fs)] subPath should unmount if pod is gracefully deleted while kubelet is down [Disruptive][Slow][LinuxOnly] 6m39s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sIn\-tree\sVolumes\s\[Driver\:\sgcepd\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\ssubPath\sshould\sunmount\sif\spod\sis\sgracefully\sdeleted\swhile\skubelet\sis\sdown\s\[Disruptive\]\[Slow\]\[LinuxOnly\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:328
Mar 31 16:40:23.537: Expected pod to be not found.
Unexpected error:
    <*errors.errorString | 0xc00009d010>: {
        s: "timed out waiting for the condition",
    }
    timed out waiting for the condition
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:278
				
				Click to see stdout/stderrfrom junit_01.xml

Find to mentions in log files | View test history on testgrid


Kubernetes e2e suite [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: block] [Testpattern: Pre-provisioned PV (block volmode)] disruptive[Disruptive] Should test that pv written before kubelet restart is readable after restart. 6m0s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-storage\]\sIn\-tree\sVolumes\s\[Driver\:\slocal\]\[LocalVolumeType\:\sblock\]\s\[Testpattern\:\sPre\-provisioned\sPV\s\(block\svolmode\)\]\sdisruptive\[Disruptive\]\sShould\stest\sthat\spv\swritten\sbefore\skubelet\srestart\sis\sreadable\safter\srestart\.$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/disruptive.go:144
Mar 31 14:26:23.565: while deleting pod
Unexpected error:
    <*errors.errorString | 0xc003fcb8d0>: {
        s: "pod \"security-context-cf319baa-6cbf-45fc-93a7-efe115f35df5\" was not deleted: timed out waiting for the condition",
    }
    pod "security-context-cf319baa-6cbf-45fc-93a7-efe115f35df5" was not deleted: timed out waiting for the condition
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/disruptive.go:102