This job view page is being replaced by Spyglass soon. Check out the new job view.
PRrifelpet: Upgrade EBS CSI Driver to v1.4.0
ResultFAILURE
Tests 0 failed / 0 succeeded
Started2021-10-13 16:38
Elapsed31m7s
Revision0b6c47d64719cf4e4cd2bd17a2e900f13eac807f
Refs 12529

No Test Failures!


Error lines from build-log.txt

... skipping 573 lines ...
I1013 16:43:27.664625   12444 app.go:90] ID for this run: "ef893bae-2c43-11ec-9713-fe12a23139be"
I1013 16:43:27.688198   12444 up.go:43] Cleaning up any leaked resources from previous cluster
I1013 16:43:27.688260   12444 dumplogs.go:40] /home/prow/go/src/k8s.io/kops/.bazelbuild/dist/linux/amd64/kops toolbox dump --name e2e-b6f7c24027-45100.test-cncf-aws.k8s.io --dir /logs/artifacts --private-key /etc/aws-ssh/aws-ssh-private --ssh-user ubuntu
I1013 16:43:27.704876   12455 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
I1013 16:43:27.705714   12455 featureflag.go:166] FeatureFlag "AlphaAllowGCE"=true
I1013 16:43:27.705722   12455 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
Error: Cluster.kops.k8s.io "e2e-b6f7c24027-45100.test-cncf-aws.k8s.io" not found
W1013 16:43:28.187801   12444 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1
I1013 16:43:28.187868   12444 down.go:48] /home/prow/go/src/k8s.io/kops/.bazelbuild/dist/linux/amd64/kops delete cluster --name e2e-b6f7c24027-45100.test-cncf-aws.k8s.io --yes
I1013 16:43:28.205012   12465 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
I1013 16:43:28.205107   12465 featureflag.go:166] FeatureFlag "AlphaAllowGCE"=true
I1013 16:43:28.205111   12465 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
Error: error reading cluster configuration: Cluster.kops.k8s.io "e2e-b6f7c24027-45100.test-cncf-aws.k8s.io" not found
I1013 16:43:28.717351   12444 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip
2021/10/13 16:43:28 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404
I1013 16:43:28.725452   12444 http.go:37] curl https://ip.jsb.workers.dev
I1013 16:43:28.837213   12444 up.go:144] /home/prow/go/src/k8s.io/kops/.bazelbuild/dist/linux/amd64/kops create cluster --name e2e-b6f7c24027-45100.test-cncf-aws.k8s.io --cloud aws --kubernetes-version 1.22.1 --ssh-public-key /etc/aws-ssh/aws-ssh-public --override cluster.spec.nodePortAccess=0.0.0.0/0 --yes --networking calico --override=cluster.spec.cloudConfig.awsEBSCSIDriver.enabled=true --override=cluster.spec.snapshotController.enabled=true --override=cluster.spec.certManager.enabled=true --admin-access 35.192.48.56/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones us-west-2a --master-size c5.large
I1013 16:43:28.854037   12475 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
I1013 16:43:28.854126   12475 featureflag.go:166] FeatureFlag "AlphaAllowGCE"=true
I1013 16:43:28.854131   12475 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
I1013 16:43:28.876547   12475 create_cluster.go:838] Using SSH public key: /etc/aws-ssh/aws-ssh-public
... skipping 33 lines ...
I1013 16:43:54.689390   12444 up.go:181] /home/prow/go/src/k8s.io/kops/.bazelbuild/dist/linux/amd64/kops validate cluster --name e2e-b6f7c24027-45100.test-cncf-aws.k8s.io --count 10 --wait 15m0s
I1013 16:43:54.707788   12495 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
I1013 16:43:54.707878   12495 featureflag.go:166] FeatureFlag "AlphaAllowGCE"=true
I1013 16:43:54.707883   12495 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
Validating cluster e2e-b6f7c24027-45100.test-cncf-aws.k8s.io

W1013 16:43:55.837078   12495 validate_cluster.go:184] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-b6f7c24027-45100.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W1013 16:44:05.882142   12495 validate_cluster.go:184] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-b6f7c24027-45100.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 16:44:15.928484   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 16:44:25.977405   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 16:44:36.021881   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 16:44:46.052081   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 16:44:56.088593   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 16:45:06.119445   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 16:45:16.156824   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 16:45:26.203710   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 16:45:36.234167   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 16:45:46.269611   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 16:45:56.318637   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 16:46:06.355965   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 16:46:16.386621   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 16:46:26.459001   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 16:46:36.505788   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 16:46:46.540044   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 16:46:56.569250   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 16:47:06.606026   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
W1013 16:47:46.645402   12495 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-b6f7c24027-45100.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp 203.0.113.123:443: i/o timeout
W1013 16:47:56.702616   12495 validate_cluster.go:184] (will retry): unexpected error during validation: error listing nodes: Get "https://api.e2e-b6f7c24027-45100.test-cncf-aws.k8s.io/api/v1/nodes": dial tcp: lookup api.e2e-b6f7c24027-45100.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

NODE STATUS
... skipping 10 lines ...
Pod	kube-system/calico-node-lwhj5	system-node-critical pod "calico-node-lwhj5" is not ready (calico-node)
Pod	kube-system/calico-node-m2xf6	system-node-critical pod "calico-node-m2xf6" is not ready (calico-node)
Pod	kube-system/calico-node-zz4xf	system-node-critical pod "calico-node-zz4xf" is not ready (calico-node)
Pod	kube-system/ebs-csi-node-jl8ll	system-node-critical pod "ebs-csi-node-jl8ll" is pending
Pod	kube-system/ebs-csi-node-xcg9g	system-node-critical pod "ebs-csi-node-xcg9g" is pending

Validation Failed
W1013 16:48:08.812944   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

... skipping 6 lines ...
ip-172-20-62-52.us-west-2.compute.internal	master	True

VALIDATION ERRORS
KIND	NAME				MESSAGE
Pod	kube-system/ebs-csi-node-jl8ll	system-node-critical pod "ebs-csi-node-jl8ll" is pending

Validation Failed
W1013 16:48:20.338103   12495 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-us-west-2a	Master	c5.large	1	1	us-west-2a
nodes-us-west-2a	Node	t3.medium	4	4	us-west-2a

... skipping 354 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath file is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256

      Driver supports dynamic provisioning, skipping PreprovisionedPV pattern

      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:233
------------------------------
... skipping 107 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.002 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Pre-provisioned PV (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath directory is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240

    Driver "ebs.csi.aws.com" does not support volume type "PreprovisionedPV" - skipping

    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 346 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Pre-provisioned PV (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if non-existent subpath is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267

    Driver "ebs.csi.aws.com" does not support volume type "PreprovisionedPV" - skipping

    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 96 lines ...
[BeforeEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:51:28.482: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename topology
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to schedule a pod which has topologies that conflict with AllowedTopologies
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192
Oct 13 16:51:30.712: INFO: found topology map[topology.ebs.csi.aws.com/zone:us-west-2a]
Oct 13 16:51:30.712: INFO: Not enough topologies in cluster -- skipping
STEP: Deleting pvc
STEP: Deleting sc
[AfterEach] [Testpattern: Dynamic PV (immediate binding)] topology
... skipping 4 lines ...

S [SKIPPING] [2.421 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (immediate binding)] topology
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to schedule a pod which has topologies that conflict with AllowedTopologies [It]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

    Not enough topologies in cluster -- skipping

    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:199
------------------------------
... skipping 59 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.000 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath file is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256

    Driver ebs.csi.aws.com doesn't support ntfs -- skipping

    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:121
------------------------------
... skipping 15 lines ...
Oct 13 16:51:31.446: INFO: AfterEach: Cleaning up test resources


S [SKIPPING] in Spec Setup (BeforeEach) [2.631 seconds]
[sig-storage] PersistentVolumes:vsphere [Feature:vsphere]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  should test that deleting the PV before the pod does not cause pod deletion to fail on vsphere volume detach [BeforeEach]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/vsphere/persistent_volumes-vsphere.go:164

  Only supported for providers [vsphere] (not aws)

  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/vsphere/persistent_volumes-vsphere.go:64
------------------------------
... skipping 169 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Pre-provisioned PV (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278

    Driver "ebs.csi.aws.com" does not support volume type "PreprovisionedPV" - skipping

    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 60 lines ...
STEP: Creating a kubernetes client
Oct 13 16:51:28.181: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename volumemode
W1013 16:51:30.201161   25110 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
Oct 13 16:51:30.201: INFO: No PodSecurityPolicies found; assuming PodSecurityPolicy is disabled.
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to use a volume in a pod with mismatched mode [Slow]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
Oct 13 16:51:30.330: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
Oct 13 16:51:30.330: INFO: Creating resource for dynamic PV
Oct 13 16:51:30.330: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass volumemode-3434lhbch
STEP: creating a claim
STEP: Creating pod
STEP: Waiting for the pod to fail
Oct 13 16:51:36.796: INFO: Deleting pod "pod-6fcaa221-3df3-48ff-be26-5cf6dd8b829e" in namespace "volumemode-3434"
Oct 13 16:51:36.868: INFO: Wait up to 5m0s for pod "pod-6fcaa221-3df3-48ff-be26-5cf6dd8b829e" to be fully deleted
STEP: Deleting pvc
Oct 13 16:51:39.136: INFO: Deleting PersistentVolumeClaim "aws7zbxg"
Oct 13 16:51:39.202: INFO: Waiting up to 5m0s for PersistentVolume pvc-599a3677-8a4d-4193-852a-0c5be67d63f0 to get deleted
Oct 13 16:51:39.267: INFO: PersistentVolume pvc-599a3677-8a4d-4193-852a-0c5be67d63f0 found and phase=Released (65.408047ms)
... skipping 11 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to use a volume in a pod with mismatched mode [Slow]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
... skipping 128 lines ...
STEP: Deleting pod hostexec-ip-172-20-37-205.us-west-2.compute.internal-r6sbt in namespace volumemode-9679
Oct 13 16:51:46.445: INFO: Deleting pod "pod-c6f139f9-0984-4314-996c-af823371b510" in namespace "volumemode-9679"
Oct 13 16:51:46.513: INFO: Wait up to 5m0s for pod "pod-c6f139f9-0984-4314-996c-af823371b510" to be fully deleted
STEP: Deleting pv and pvc
Oct 13 16:51:52.647: INFO: Deleting PersistentVolumeClaim "pvc-jt6gw"
Oct 13 16:51:52.715: INFO: Deleting PersistentVolume "aws-hgb75"
Oct 13 16:51:53.166: INFO: Couldn't delete PD "aws://us-west-2a/vol-0eeebc61d44407bcc", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0eeebc61d44407bcc is currently attached to i-06b67b49ea933fa11
	status code: 400, request id: 2706d8f4-07dd-4a1c-bbad-9f197d65dcc4
Oct 13 16:51:58.612: INFO: Successfully deleted PD "aws://us-west-2a/vol-0eeebc61d44407bcc".
[AfterEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 16:51:58.612: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volumemode-9679" for this suite.
... skipping 41 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath directory is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240

      Driver supports dynamic provisioning, skipping PreprovisionedPV pattern

      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:233
------------------------------
... skipping 6 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Inline-volume (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath file is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256

    Driver "ebs.csi.aws.com" does not support volume type "InlineVolume" - skipping

    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 14 lines ...
Oct 13 16:51:28.406: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
STEP: creating a test aws volume
Oct 13 16:51:29.093: INFO: Successfully created a new PD: "aws://us-west-2a/vol-0396d62ca2187bff7".
Oct 13 16:51:29.094: INFO: Creating resource for inline volume
STEP: Creating pod exec-volume-test-inlinevolume-kjlx
STEP: Creating a pod to test exec-volume-test
Oct 13 16:51:29.164: INFO: Waiting up to 5m0s for pod "exec-volume-test-inlinevolume-kjlx" in namespace "volume-3731" to be "Succeeded or Failed"
Oct 13 16:51:29.234: INFO: Pod "exec-volume-test-inlinevolume-kjlx": Phase="Pending", Reason="", readiness=false. Elapsed: 70.377918ms
Oct 13 16:51:31.298: INFO: Pod "exec-volume-test-inlinevolume-kjlx": Phase="Pending", Reason="", readiness=false. Elapsed: 2.134436457s
Oct 13 16:51:33.362: INFO: Pod "exec-volume-test-inlinevolume-kjlx": Phase="Pending", Reason="", readiness=false. Elapsed: 4.198586455s
Oct 13 16:51:35.429: INFO: Pod "exec-volume-test-inlinevolume-kjlx": Phase="Pending", Reason="", readiness=false. Elapsed: 6.264814073s
Oct 13 16:51:37.496: INFO: Pod "exec-volume-test-inlinevolume-kjlx": Phase="Pending", Reason="", readiness=false. Elapsed: 8.332257679s
Oct 13 16:51:39.562: INFO: Pod "exec-volume-test-inlinevolume-kjlx": Phase="Pending", Reason="", readiness=false. Elapsed: 10.398003371s
Oct 13 16:51:41.628: INFO: Pod "exec-volume-test-inlinevolume-kjlx": Phase="Succeeded", Reason="", readiness=false. Elapsed: 12.464240245s
STEP: Saw pod success
Oct 13 16:51:41.628: INFO: Pod "exec-volume-test-inlinevolume-kjlx" satisfied condition "Succeeded or Failed"
Oct 13 16:51:41.693: INFO: Trying to get logs from node ip-172-20-37-135.us-west-2.compute.internal pod exec-volume-test-inlinevolume-kjlx container exec-container-inlinevolume-kjlx: <nil>
STEP: delete the pod
Oct 13 16:51:41.843: INFO: Waiting for pod exec-volume-test-inlinevolume-kjlx to disappear
Oct 13 16:51:41.906: INFO: Pod exec-volume-test-inlinevolume-kjlx no longer exists
STEP: Deleting pod exec-volume-test-inlinevolume-kjlx
Oct 13 16:51:41.906: INFO: Deleting pod "exec-volume-test-inlinevolume-kjlx" in namespace "volume-3731"
Oct 13 16:51:42.155: INFO: Couldn't delete PD "aws://us-west-2a/vol-0396d62ca2187bff7", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0396d62ca2187bff7 is currently attached to i-04097d75079331972
	status code: 400, request id: 787ac351-5b65-4958-a348-14d3d7899bac
Oct 13 16:51:47.621: INFO: Couldn't delete PD "aws://us-west-2a/vol-0396d62ca2187bff7", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0396d62ca2187bff7 is currently attached to i-04097d75079331972
	status code: 400, request id: 30e4fe0a-4372-423a-9918-51a1375a724b
Oct 13 16:51:53.022: INFO: Couldn't delete PD "aws://us-west-2a/vol-0396d62ca2187bff7", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0396d62ca2187bff7 is currently attached to i-04097d75079331972
	status code: 400, request id: e28099b3-bf7b-42a1-a9b6-a71d0279cd5f
Oct 13 16:51:58.420: INFO: Couldn't delete PD "aws://us-west-2a/vol-0396d62ca2187bff7", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0396d62ca2187bff7 is currently attached to i-04097d75079331972
	status code: 400, request id: f85f41c1-ce28-48c9-b844-c5f76db637e0
Oct 13 16:52:03.887: INFO: Successfully deleted PD "aws://us-west-2a/vol-0396d62ca2187bff7".
[AfterEach] [Testpattern: Inline-volume (ext4)] volumes
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 16:52:03.887: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-3731" for this suite.
... skipping 80 lines ...
[BeforeEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:52:04.085: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename topology
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to schedule a pod which has topologies that conflict with AllowedTopologies
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192
Oct 13 16:52:04.474: INFO: found topology map[topology.kubernetes.io/zone:us-west-2a]
Oct 13 16:52:04.474: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
Oct 13 16:52:04.474: INFO: Not enough topologies in cluster -- skipping
STEP: Deleting pvc
STEP: Deleting sc
... skipping 7 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (immediate binding)] topology
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [It]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Not enough topologies in cluster -- skipping

      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:199
------------------------------
... skipping 181 lines ...
Oct 13 16:51:32.058: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-3148d7wv
STEP: creating a claim
Oct 13 16:51:32.127: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-7v84
STEP: Creating a pod to test subpath
Oct 13 16:51:32.336: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-7v84" in namespace "provisioning-314" to be "Succeeded or Failed"
Oct 13 16:51:32.406: INFO: Pod "pod-subpath-test-dynamicpv-7v84": Phase="Pending", Reason="", readiness=false. Elapsed: 69.273754ms
Oct 13 16:51:34.473: INFO: Pod "pod-subpath-test-dynamicpv-7v84": Phase="Pending", Reason="", readiness=false. Elapsed: 2.1368396s
Oct 13 16:51:36.541: INFO: Pod "pod-subpath-test-dynamicpv-7v84": Phase="Pending", Reason="", readiness=false. Elapsed: 4.204964366s
Oct 13 16:51:38.610: INFO: Pod "pod-subpath-test-dynamicpv-7v84": Phase="Pending", Reason="", readiness=false. Elapsed: 6.273994807s
Oct 13 16:51:40.677: INFO: Pod "pod-subpath-test-dynamicpv-7v84": Phase="Pending", Reason="", readiness=false. Elapsed: 8.340641668s
Oct 13 16:51:42.744: INFO: Pod "pod-subpath-test-dynamicpv-7v84": Phase="Pending", Reason="", readiness=false. Elapsed: 10.407760366s
... skipping 4 lines ...
Oct 13 16:51:53.080: INFO: Pod "pod-subpath-test-dynamicpv-7v84": Phase="Pending", Reason="", readiness=false. Elapsed: 20.743965463s
Oct 13 16:51:55.147: INFO: Pod "pod-subpath-test-dynamicpv-7v84": Phase="Pending", Reason="", readiness=false. Elapsed: 22.811043295s
Oct 13 16:51:57.215: INFO: Pod "pod-subpath-test-dynamicpv-7v84": Phase="Pending", Reason="", readiness=false. Elapsed: 24.878669973s
Oct 13 16:51:59.283: INFO: Pod "pod-subpath-test-dynamicpv-7v84": Phase="Pending", Reason="", readiness=false. Elapsed: 26.946859238s
Oct 13 16:52:01.351: INFO: Pod "pod-subpath-test-dynamicpv-7v84": Phase="Succeeded", Reason="", readiness=false. Elapsed: 29.014982558s
STEP: Saw pod success
Oct 13 16:52:01.351: INFO: Pod "pod-subpath-test-dynamicpv-7v84" satisfied condition "Succeeded or Failed"
Oct 13 16:52:01.418: INFO: Trying to get logs from node ip-172-20-59-131.us-west-2.compute.internal pod pod-subpath-test-dynamicpv-7v84 container test-container-subpath-dynamicpv-7v84: <nil>
STEP: delete the pod
Oct 13 16:52:01.593: INFO: Waiting for pod pod-subpath-test-dynamicpv-7v84 to disappear
Oct 13 16:52:01.661: INFO: Pod pod-subpath-test-dynamicpv-7v84 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-7v84
Oct 13 16:52:01.661: INFO: Deleting pod "pod-subpath-test-dynamicpv-7v84" in namespace "provisioning-314"
... skipping 38 lines ...
Oct 13 16:51:28.458: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
STEP: creating a test aws volume
Oct 13 16:51:29.040: INFO: Successfully created a new PD: "aws://us-west-2a/vol-0d716685c4b79b1ac".
Oct 13 16:51:29.040: INFO: Creating resource for inline volume
STEP: Creating pod exec-volume-test-inlinevolume-snz4
STEP: Creating a pod to test exec-volume-test
Oct 13 16:51:29.107: INFO: Waiting up to 5m0s for pod "exec-volume-test-inlinevolume-snz4" in namespace "volume-516" to be "Succeeded or Failed"
Oct 13 16:51:29.172: INFO: Pod "exec-volume-test-inlinevolume-snz4": Phase="Pending", Reason="", readiness=false. Elapsed: 65.060494ms
Oct 13 16:51:31.238: INFO: Pod "exec-volume-test-inlinevolume-snz4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.131185005s
Oct 13 16:51:33.303: INFO: Pod "exec-volume-test-inlinevolume-snz4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.196410191s
Oct 13 16:51:35.373: INFO: Pod "exec-volume-test-inlinevolume-snz4": Phase="Pending", Reason="", readiness=false. Elapsed: 6.265934014s
Oct 13 16:51:37.438: INFO: Pod "exec-volume-test-inlinevolume-snz4": Phase="Pending", Reason="", readiness=false. Elapsed: 8.33125792s
Oct 13 16:51:39.503: INFO: Pod "exec-volume-test-inlinevolume-snz4": Phase="Pending", Reason="", readiness=false. Elapsed: 10.395847553s
... skipping 8 lines ...
Oct 13 16:51:58.105: INFO: Pod "exec-volume-test-inlinevolume-snz4": Phase="Pending", Reason="", readiness=false. Elapsed: 28.998048952s
Oct 13 16:52:00.170: INFO: Pod "exec-volume-test-inlinevolume-snz4": Phase="Pending", Reason="", readiness=false. Elapsed: 31.062767324s
Oct 13 16:52:02.235: INFO: Pod "exec-volume-test-inlinevolume-snz4": Phase="Pending", Reason="", readiness=false. Elapsed: 33.127827049s
Oct 13 16:52:04.300: INFO: Pod "exec-volume-test-inlinevolume-snz4": Phase="Pending", Reason="", readiness=false. Elapsed: 35.192925305s
Oct 13 16:52:06.365: INFO: Pod "exec-volume-test-inlinevolume-snz4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 37.258384909s
STEP: Saw pod success
Oct 13 16:52:06.365: INFO: Pod "exec-volume-test-inlinevolume-snz4" satisfied condition "Succeeded or Failed"
Oct 13 16:52:06.430: INFO: Trying to get logs from node ip-172-20-39-49.us-west-2.compute.internal pod exec-volume-test-inlinevolume-snz4 container exec-container-inlinevolume-snz4: <nil>
STEP: delete the pod
Oct 13 16:52:06.566: INFO: Waiting for pod exec-volume-test-inlinevolume-snz4 to disappear
Oct 13 16:52:06.630: INFO: Pod exec-volume-test-inlinevolume-snz4 no longer exists
STEP: Deleting pod exec-volume-test-inlinevolume-snz4
Oct 13 16:52:06.630: INFO: Deleting pod "exec-volume-test-inlinevolume-snz4" in namespace "volume-516"
Oct 13 16:52:06.891: INFO: Couldn't delete PD "aws://us-west-2a/vol-0d716685c4b79b1ac", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0d716685c4b79b1ac is currently attached to i-0f7953e39ddb3373a
	status code: 400, request id: 6c7ad55f-f98b-44d5-af5a-14fca79c4ca4
Oct 13 16:52:12.325: INFO: Couldn't delete PD "aws://us-west-2a/vol-0d716685c4b79b1ac", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0d716685c4b79b1ac is currently attached to i-0f7953e39ddb3373a
	status code: 400, request id: 6137f1fa-32bf-435a-a407-7acc2a3d2ceb
Oct 13 16:52:17.722: INFO: Successfully deleted PD "aws://us-west-2a/vol-0d716685c4b79b1ac".
[AfterEach] [Testpattern: Inline-volume (default fs)] volumes
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 16:52:17.722: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-516" for this suite.
... skipping 62 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to use a volume in a pod with mismatched mode [Slow] [BeforeEach]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296

    Driver "ebs.csi.aws.com" does not support volume type "PreprovisionedPV" - skipping

    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 39 lines ...
Oct 13 16:51:28.572: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-310568kjn
STEP: creating a claim
Oct 13 16:51:28.649: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-tg62
STEP: Creating a pod to test subpath
Oct 13 16:51:28.854: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-tg62" in namespace "provisioning-3105" to be "Succeeded or Failed"
Oct 13 16:51:28.920: INFO: Pod "pod-subpath-test-dynamicpv-tg62": Phase="Pending", Reason="", readiness=false. Elapsed: 65.69773ms
Oct 13 16:51:30.984: INFO: Pod "pod-subpath-test-dynamicpv-tg62": Phase="Pending", Reason="", readiness=false. Elapsed: 2.129785151s
Oct 13 16:51:33.049: INFO: Pod "pod-subpath-test-dynamicpv-tg62": Phase="Pending", Reason="", readiness=false. Elapsed: 4.194920197s
Oct 13 16:51:35.117: INFO: Pod "pod-subpath-test-dynamicpv-tg62": Phase="Pending", Reason="", readiness=false. Elapsed: 6.262756437s
Oct 13 16:51:37.181: INFO: Pod "pod-subpath-test-dynamicpv-tg62": Phase="Pending", Reason="", readiness=false. Elapsed: 8.326403994s
Oct 13 16:51:39.245: INFO: Pod "pod-subpath-test-dynamicpv-tg62": Phase="Pending", Reason="", readiness=false. Elapsed: 10.390264828s
... skipping 4 lines ...
Oct 13 16:51:49.569: INFO: Pod "pod-subpath-test-dynamicpv-tg62": Phase="Pending", Reason="", readiness=false. Elapsed: 20.714469976s
Oct 13 16:51:51.636: INFO: Pod "pod-subpath-test-dynamicpv-tg62": Phase="Pending", Reason="", readiness=false. Elapsed: 22.781577703s
Oct 13 16:51:53.702: INFO: Pod "pod-subpath-test-dynamicpv-tg62": Phase="Pending", Reason="", readiness=false. Elapsed: 24.848051998s
Oct 13 16:51:55.768: INFO: Pod "pod-subpath-test-dynamicpv-tg62": Phase="Pending", Reason="", readiness=false. Elapsed: 26.913723068s
Oct 13 16:51:57.834: INFO: Pod "pod-subpath-test-dynamicpv-tg62": Phase="Succeeded", Reason="", readiness=false. Elapsed: 28.979937479s
STEP: Saw pod success
Oct 13 16:51:57.834: INFO: Pod "pod-subpath-test-dynamicpv-tg62" satisfied condition "Succeeded or Failed"
Oct 13 16:51:57.903: INFO: Trying to get logs from node ip-172-20-37-135.us-west-2.compute.internal pod pod-subpath-test-dynamicpv-tg62 container test-container-subpath-dynamicpv-tg62: <nil>
STEP: delete the pod
Oct 13 16:51:58.044: INFO: Waiting for pod pod-subpath-test-dynamicpv-tg62 to disappear
Oct 13 16:51:58.108: INFO: Pod pod-subpath-test-dynamicpv-tg62 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-tg62
Oct 13 16:51:58.108: INFO: Deleting pod "pod-subpath-test-dynamicpv-tg62" in namespace "provisioning-3105"
... skipping 29 lines ...
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:51:30.878: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278
Oct 13 16:51:32.157: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
Oct 13 16:51:32.157: INFO: Creating resource for dynamic PV
Oct 13 16:51:32.157: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-1769vgvsb
STEP: creating a claim
Oct 13 16:51:32.223: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-7vnp
STEP: Checking for subpath error in container status
Oct 13 16:51:56.575: INFO: Deleting pod "pod-subpath-test-dynamicpv-7vnp" in namespace "provisioning-1769"
Oct 13 16:51:56.645: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-7vnp" to be fully deleted
STEP: Deleting pod
Oct 13 16:52:00.790: INFO: Deleting pod "pod-subpath-test-dynamicpv-7vnp" in namespace "provisioning-1769"
STEP: Deleting pvc
Oct 13 16:52:00.987: INFO: Deleting PersistentVolumeClaim "awskjwpz"
... skipping 14 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (default fs)] subPath
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278
------------------------------
[BeforeEach] [sig-storage] Zone Support [Feature:vsphere]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:52:21.605: INFO: >>> kubeConfig: /root/.kube/config
... skipping 32 lines ...
Oct 13 16:51:58.024: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(ebs.csi.aws.com) supported size:{ 1Gi} 
STEP: creating a StorageClass volume-expand-775-e2e-sckbnx9
STEP: creating a claim
Oct 13 16:51:58.090: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Expanding non-expandable pvc
Oct 13 16:51:58.226: INFO: currentPvcSize {{1073741824 0} {<nil>} 1Gi BinarySI}, newSize {{2147483648 0} {<nil>}  BinarySI}
Oct 13 16:51:58.368: INFO: Error updating pvc ebs.csi.aws.comktfsx: PersistentVolumeClaim "ebs.csi.aws.comktfsx" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-775-e2e-sckbnx9",
  	... // 3 identical fields
  }

Oct 13 16:52:00.501: INFO: Error updating pvc ebs.csi.aws.comktfsx: PersistentVolumeClaim "ebs.csi.aws.comktfsx" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-775-e2e-sckbnx9",
  	... // 3 identical fields
  }

Oct 13 16:52:02.502: INFO: Error updating pvc ebs.csi.aws.comktfsx: PersistentVolumeClaim "ebs.csi.aws.comktfsx" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-775-e2e-sckbnx9",
  	... // 3 identical fields
  }

Oct 13 16:52:04.502: INFO: Error updating pvc ebs.csi.aws.comktfsx: PersistentVolumeClaim "ebs.csi.aws.comktfsx" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-775-e2e-sckbnx9",
  	... // 3 identical fields
  }

Oct 13 16:52:06.502: INFO: Error updating pvc ebs.csi.aws.comktfsx: PersistentVolumeClaim "ebs.csi.aws.comktfsx" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-775-e2e-sckbnx9",
  	... // 3 identical fields
  }

Oct 13 16:52:08.502: INFO: Error updating pvc ebs.csi.aws.comktfsx: PersistentVolumeClaim "ebs.csi.aws.comktfsx" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-775-e2e-sckbnx9",
  	... // 3 identical fields
  }

Oct 13 16:52:10.507: INFO: Error updating pvc ebs.csi.aws.comktfsx: PersistentVolumeClaim "ebs.csi.aws.comktfsx" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-775-e2e-sckbnx9",
  	... // 3 identical fields
  }

Oct 13 16:52:12.501: INFO: Error updating pvc ebs.csi.aws.comktfsx: PersistentVolumeClaim "ebs.csi.aws.comktfsx" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-775-e2e-sckbnx9",
  	... // 3 identical fields
  }

Oct 13 16:52:14.503: INFO: Error updating pvc ebs.csi.aws.comktfsx: PersistentVolumeClaim "ebs.csi.aws.comktfsx" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-775-e2e-sckbnx9",
  	... // 3 identical fields
  }

Oct 13 16:52:16.502: INFO: Error updating pvc ebs.csi.aws.comktfsx: PersistentVolumeClaim "ebs.csi.aws.comktfsx" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-775-e2e-sckbnx9",
  	... // 3 identical fields
  }

Oct 13 16:52:18.501: INFO: Error updating pvc ebs.csi.aws.comktfsx: PersistentVolumeClaim "ebs.csi.aws.comktfsx" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-775-e2e-sckbnx9",
  	... // 3 identical fields
  }

Oct 13 16:52:20.501: INFO: Error updating pvc ebs.csi.aws.comktfsx: PersistentVolumeClaim "ebs.csi.aws.comktfsx" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-775-e2e-sckbnx9",
  	... // 3 identical fields
  }

Oct 13 16:52:22.503: INFO: Error updating pvc ebs.csi.aws.comktfsx: PersistentVolumeClaim "ebs.csi.aws.comktfsx" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-775-e2e-sckbnx9",
  	... // 3 identical fields
  }

Oct 13 16:52:24.502: INFO: Error updating pvc ebs.csi.aws.comktfsx: PersistentVolumeClaim "ebs.csi.aws.comktfsx" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-775-e2e-sckbnx9",
  	... // 3 identical fields
  }

Oct 13 16:52:26.507: INFO: Error updating pvc ebs.csi.aws.comktfsx: PersistentVolumeClaim "ebs.csi.aws.comktfsx" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-775-e2e-sckbnx9",
  	... // 3 identical fields
  }

Oct 13 16:52:28.503: INFO: Error updating pvc ebs.csi.aws.comktfsx: PersistentVolumeClaim "ebs.csi.aws.comktfsx" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-775-e2e-sckbnx9",
  	... // 3 identical fields
  }

Oct 13 16:52:28.636: INFO: Error updating pvc ebs.csi.aws.comktfsx: PersistentVolumeClaim "ebs.csi.aws.comktfsx" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 30 lines ...
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:52:28.976: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename topology
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to schedule a pod which has topologies that conflict with AllowedTopologies
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192
Oct 13 16:52:29.383: INFO: found topology map[topology.kubernetes.io/zone:us-west-2a]
Oct 13 16:52:29.383: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
Oct 13 16:52:29.383: INFO: Not enough topologies in cluster -- skipping
STEP: Deleting pvc
STEP: Deleting sc
... skipping 7 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (delayed binding)] topology
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [It]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Not enough topologies in cluster -- skipping

      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:199
------------------------------
... skipping 37 lines ...
Oct 13 16:51:33.348: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass volume-360ngdjm
STEP: creating a claim
Oct 13 16:51:33.419: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod exec-volume-test-dynamicpv-65gt
STEP: Creating a pod to test exec-volume-test
Oct 13 16:51:33.625: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-65gt" in namespace "volume-360" to be "Succeeded or Failed"
Oct 13 16:51:33.699: INFO: Pod "exec-volume-test-dynamicpv-65gt": Phase="Pending", Reason="", readiness=false. Elapsed: 73.933467ms
Oct 13 16:51:35.762: INFO: Pod "exec-volume-test-dynamicpv-65gt": Phase="Pending", Reason="", readiness=false. Elapsed: 2.136975236s
Oct 13 16:51:37.825: INFO: Pod "exec-volume-test-dynamicpv-65gt": Phase="Pending", Reason="", readiness=false. Elapsed: 4.19973059s
Oct 13 16:51:39.889: INFO: Pod "exec-volume-test-dynamicpv-65gt": Phase="Pending", Reason="", readiness=false. Elapsed: 6.263953029s
Oct 13 16:51:41.952: INFO: Pod "exec-volume-test-dynamicpv-65gt": Phase="Pending", Reason="", readiness=false. Elapsed: 8.326804205s
Oct 13 16:51:44.016: INFO: Pod "exec-volume-test-dynamicpv-65gt": Phase="Pending", Reason="", readiness=false. Elapsed: 10.391280093s
... skipping 5 lines ...
Oct 13 16:51:56.401: INFO: Pod "exec-volume-test-dynamicpv-65gt": Phase="Pending", Reason="", readiness=false. Elapsed: 22.775834175s
Oct 13 16:51:58.465: INFO: Pod "exec-volume-test-dynamicpv-65gt": Phase="Pending", Reason="", readiness=false. Elapsed: 24.840294587s
Oct 13 16:52:00.529: INFO: Pod "exec-volume-test-dynamicpv-65gt": Phase="Pending", Reason="", readiness=false. Elapsed: 26.904075435s
Oct 13 16:52:02.592: INFO: Pod "exec-volume-test-dynamicpv-65gt": Phase="Pending", Reason="", readiness=false. Elapsed: 28.967070257s
Oct 13 16:52:04.656: INFO: Pod "exec-volume-test-dynamicpv-65gt": Phase="Succeeded", Reason="", readiness=false. Elapsed: 31.030898114s
STEP: Saw pod success
Oct 13 16:52:04.656: INFO: Pod "exec-volume-test-dynamicpv-65gt" satisfied condition "Succeeded or Failed"
Oct 13 16:52:04.718: INFO: Trying to get logs from node ip-172-20-37-135.us-west-2.compute.internal pod exec-volume-test-dynamicpv-65gt container exec-container-dynamicpv-65gt: <nil>
STEP: delete the pod
Oct 13 16:52:04.854: INFO: Waiting for pod exec-volume-test-dynamicpv-65gt to disappear
Oct 13 16:52:04.928: INFO: Pod exec-volume-test-dynamicpv-65gt no longer exists
STEP: Deleting pod exec-volume-test-dynamicpv-65gt
Oct 13 16:52:04.928: INFO: Deleting pod "exec-volume-test-dynamicpv-65gt" in namespace "volume-360"
... skipping 38 lines ...
Oct 13 16:51:33.142: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-112xvzbd
STEP: creating a claim
Oct 13 16:51:33.209: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-k9mq
STEP: Creating a pod to test subpath
Oct 13 16:51:33.409: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-k9mq" in namespace "provisioning-112" to be "Succeeded or Failed"
Oct 13 16:51:33.474: INFO: Pod "pod-subpath-test-dynamicpv-k9mq": Phase="Pending", Reason="", readiness=false. Elapsed: 65.606157ms
Oct 13 16:51:35.541: INFO: Pod "pod-subpath-test-dynamicpv-k9mq": Phase="Pending", Reason="", readiness=false. Elapsed: 2.13185267s
Oct 13 16:51:37.608: INFO: Pod "pod-subpath-test-dynamicpv-k9mq": Phase="Pending", Reason="", readiness=false. Elapsed: 4.19931617s
Oct 13 16:51:39.674: INFO: Pod "pod-subpath-test-dynamicpv-k9mq": Phase="Pending", Reason="", readiness=false. Elapsed: 6.265363052s
Oct 13 16:51:41.740: INFO: Pod "pod-subpath-test-dynamicpv-k9mq": Phase="Pending", Reason="", readiness=false. Elapsed: 8.331334713s
Oct 13 16:51:43.806: INFO: Pod "pod-subpath-test-dynamicpv-k9mq": Phase="Pending", Reason="", readiness=false. Elapsed: 10.397094725s
... skipping 6 lines ...
Oct 13 16:51:58.274: INFO: Pod "pod-subpath-test-dynamicpv-k9mq": Phase="Pending", Reason="", readiness=false. Elapsed: 24.864930758s
Oct 13 16:52:00.340: INFO: Pod "pod-subpath-test-dynamicpv-k9mq": Phase="Pending", Reason="", readiness=false. Elapsed: 26.931635882s
Oct 13 16:52:02.407: INFO: Pod "pod-subpath-test-dynamicpv-k9mq": Phase="Pending", Reason="", readiness=false. Elapsed: 28.998171793s
Oct 13 16:52:04.474: INFO: Pod "pod-subpath-test-dynamicpv-k9mq": Phase="Pending", Reason="", readiness=false. Elapsed: 31.064756898s
Oct 13 16:52:06.541: INFO: Pod "pod-subpath-test-dynamicpv-k9mq": Phase="Succeeded", Reason="", readiness=false. Elapsed: 33.131670459s
STEP: Saw pod success
Oct 13 16:52:06.541: INFO: Pod "pod-subpath-test-dynamicpv-k9mq" satisfied condition "Succeeded or Failed"
Oct 13 16:52:06.606: INFO: Trying to get logs from node ip-172-20-37-135.us-west-2.compute.internal pod pod-subpath-test-dynamicpv-k9mq container test-container-subpath-dynamicpv-k9mq: <nil>
STEP: delete the pod
Oct 13 16:52:06.747: INFO: Waiting for pod pod-subpath-test-dynamicpv-k9mq to disappear
Oct 13 16:52:06.812: INFO: Pod pod-subpath-test-dynamicpv-k9mq no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-k9mq
Oct 13 16:52:06.812: INFO: Deleting pod "pod-subpath-test-dynamicpv-k9mq" in namespace "provisioning-112"
... skipping 41 lines ...
Oct 13 16:51:59.170: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-7580-e2e-scn5gqm
STEP: creating a claim
Oct 13 16:51:59.239: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-hkg8
STEP: Creating a pod to test subpath
Oct 13 16:51:59.445: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-hkg8" in namespace "provisioning-7580" to be "Succeeded or Failed"
Oct 13 16:51:59.511: INFO: Pod "pod-subpath-test-dynamicpv-hkg8": Phase="Pending", Reason="", readiness=false. Elapsed: 66.518006ms
Oct 13 16:52:01.581: INFO: Pod "pod-subpath-test-dynamicpv-hkg8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.136115487s
Oct 13 16:52:03.649: INFO: Pod "pod-subpath-test-dynamicpv-hkg8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.203970855s
Oct 13 16:52:05.717: INFO: Pod "pod-subpath-test-dynamicpv-hkg8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.27214072s
Oct 13 16:52:07.785: INFO: Pod "pod-subpath-test-dynamicpv-hkg8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.339876324s
Oct 13 16:52:09.854: INFO: Pod "pod-subpath-test-dynamicpv-hkg8": Phase="Pending", Reason="", readiness=false. Elapsed: 10.409625346s
... skipping 2 lines ...
Oct 13 16:52:16.063: INFO: Pod "pod-subpath-test-dynamicpv-hkg8": Phase="Pending", Reason="", readiness=false. Elapsed: 16.61808936s
Oct 13 16:52:18.130: INFO: Pod "pod-subpath-test-dynamicpv-hkg8": Phase="Pending", Reason="", readiness=false. Elapsed: 18.685569141s
Oct 13 16:52:20.198: INFO: Pod "pod-subpath-test-dynamicpv-hkg8": Phase="Pending", Reason="", readiness=false. Elapsed: 20.753746476s
Oct 13 16:52:22.267: INFO: Pod "pod-subpath-test-dynamicpv-hkg8": Phase="Pending", Reason="", readiness=false. Elapsed: 22.822078414s
Oct 13 16:52:24.334: INFO: Pod "pod-subpath-test-dynamicpv-hkg8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 24.889704664s
STEP: Saw pod success
Oct 13 16:52:24.334: INFO: Pod "pod-subpath-test-dynamicpv-hkg8" satisfied condition "Succeeded or Failed"
Oct 13 16:52:24.401: INFO: Trying to get logs from node ip-172-20-39-49.us-west-2.compute.internal pod pod-subpath-test-dynamicpv-hkg8 container test-container-subpath-dynamicpv-hkg8: <nil>
STEP: delete the pod
Oct 13 16:52:24.544: INFO: Waiting for pod pod-subpath-test-dynamicpv-hkg8 to disappear
Oct 13 16:52:24.610: INFO: Pod pod-subpath-test-dynamicpv-hkg8 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-hkg8
Oct 13 16:52:24.610: INFO: Deleting pod "pod-subpath-test-dynamicpv-hkg8" in namespace "provisioning-7580"
... skipping 131 lines ...
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:52:04.675: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename volumemode
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to use a volume in a pod with mismatched mode [Slow]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
Oct 13 16:52:05.001: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
STEP: creating a test aws volume
Oct 13 16:52:05.357: INFO: Successfully created a new PD: "aws://us-west-2a/vol-0495797c23d1c324e".
Oct 13 16:52:05.357: INFO: Creating resource for pre-provisioned PV
Oct 13 16:52:05.357: INFO: Creating PVC and PV
... skipping 7 lines ...
Oct 13 16:52:13.824: INFO: PersistentVolumeClaim pvc-tzppt found but phase is Pending instead of Bound.
Oct 13 16:52:15.889: INFO: PersistentVolumeClaim pvc-tzppt found but phase is Pending instead of Bound.
Oct 13 16:52:17.953: INFO: PersistentVolumeClaim pvc-tzppt found and phase=Bound (12.456746496s)
Oct 13 16:52:17.953: INFO: Waiting up to 3m0s for PersistentVolume aws-bg88r to have phase Bound
Oct 13 16:52:18.018: INFO: PersistentVolume aws-bg88r found and phase=Bound (64.527095ms)
STEP: Creating pod
STEP: Waiting for the pod to fail
Oct 13 16:52:20.409: INFO: Deleting pod "pod-5d16cd6e-eb6f-44e0-a68e-54398410719c" in namespace "volumemode-8765"
Oct 13 16:52:20.474: INFO: Wait up to 5m0s for pod "pod-5d16cd6e-eb6f-44e0-a68e-54398410719c" to be fully deleted
STEP: Deleting pv and pvc
Oct 13 16:52:22.604: INFO: Deleting PersistentVolumeClaim "pvc-tzppt"
Oct 13 16:52:22.668: INFO: Deleting PersistentVolume "aws-bg88r"
Oct 13 16:52:22.927: INFO: Couldn't delete PD "aws://us-west-2a/vol-0495797c23d1c324e", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0495797c23d1c324e is currently attached to i-06b67b49ea933fa11
	status code: 400, request id: 28fa0101-b235-43b1-9b12-5fb5cc8b892c
Oct 13 16:52:28.303: INFO: Couldn't delete PD "aws://us-west-2a/vol-0495797c23d1c324e", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0495797c23d1c324e is currently attached to i-06b67b49ea933fa11
	status code: 400, request id: 83b78046-747a-4386-9232-839e4bdfff7e
Oct 13 16:52:33.697: INFO: Couldn't delete PD "aws://us-west-2a/vol-0495797c23d1c324e", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0495797c23d1c324e is currently attached to i-06b67b49ea933fa11
	status code: 400, request id: 8aa51107-dce9-4939-8b74-8cae658c32ee
Oct 13 16:52:39.147: INFO: Couldn't delete PD "aws://us-west-2a/vol-0495797c23d1c324e", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0495797c23d1c324e is currently attached to i-06b67b49ea933fa11
	status code: 400, request id: e672be11-dfb2-4b71-ad60-5313d2895a71
Oct 13 16:52:44.603: INFO: Couldn't delete PD "aws://us-west-2a/vol-0495797c23d1c324e", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0495797c23d1c324e is currently attached to i-06b67b49ea933fa11
	status code: 400, request id: bc1a14af-d8c1-47e3-9e71-0b54cb79d02b
Oct 13 16:52:50.021: INFO: Successfully deleted PD "aws://us-west-2a/vol-0495797c23d1c324e".
[AfterEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 16:52:50.022: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volumemode-8765" for this suite.
... skipping 3 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to use a volume in a pod with mismatched mode [Slow]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 16:52:50.159: INFO: Driver "ebs.csi.aws.com" does not support volume type "PreprovisionedPV" - skipping
[AfterEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] multiVolume [Slow]
... skipping 63 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Inline-volume (default fs)] subPath
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278

      Driver supports dynamic provisioning, skipping InlineVolume pattern

      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:233
------------------------------
... skipping 338 lines ...
Oct 13 16:52:36.974: INFO: Pod aws-client still exists
Oct 13 16:52:38.975: INFO: Waiting for pod aws-client to disappear
Oct 13 16:52:39.039: INFO: Pod aws-client still exists
Oct 13 16:52:40.975: INFO: Waiting for pod aws-client to disappear
Oct 13 16:52:41.039: INFO: Pod aws-client no longer exists
STEP: cleaning the environment after aws
Oct 13 16:52:41.237: INFO: Couldn't delete PD "aws://us-west-2a/vol-01f1dca6e8a1ccaff", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-01f1dca6e8a1ccaff is currently attached to i-0f7953e39ddb3373a
	status code: 400, request id: 1c74689c-92c9-4a1d-a6a8-529e8658ae73
Oct 13 16:52:46.672: INFO: Couldn't delete PD "aws://us-west-2a/vol-01f1dca6e8a1ccaff", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-01f1dca6e8a1ccaff is currently attached to i-0f7953e39ddb3373a
	status code: 400, request id: 30256218-660c-47ad-a21b-c97bd0bc9dd8
Oct 13 16:52:52.145: INFO: Couldn't delete PD "aws://us-west-2a/vol-01f1dca6e8a1ccaff", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-01f1dca6e8a1ccaff is currently attached to i-0f7953e39ddb3373a
	status code: 400, request id: 4a8e9c02-b184-431a-99b8-4c0d3c6263c5
Oct 13 16:52:57.578: INFO: Successfully deleted PD "aws://us-west-2a/vol-01f1dca6e8a1ccaff".
[AfterEach] [Testpattern: Inline-volume (xfs)][Slow] volumes
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 16:52:57.578: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-5680" for this suite.
... skipping 20 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278

      Distro debian doesn't support ntfs -- skipping

      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:127
------------------------------
... skipping 685 lines ...
Oct 13 16:53:12.487: INFO: Waiting for pod aws-client to disappear
Oct 13 16:53:12.551: INFO: Pod aws-client no longer exists
STEP: cleaning the environment after aws
STEP: Deleting pv and pvc
Oct 13 16:53:12.551: INFO: Deleting PersistentVolumeClaim "pvc-2mgjk"
Oct 13 16:53:12.617: INFO: Deleting PersistentVolume "aws-k729g"
Oct 13 16:53:13.103: INFO: Couldn't delete PD "aws://us-west-2a/vol-0e4ed538dd7ce1e92", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0e4ed538dd7ce1e92 is currently attached to i-06b67b49ea933fa11
	status code: 400, request id: 9a959c4e-f9c6-49c5-a12f-8e47e84b0f02
Oct 13 16:53:18.504: INFO: Couldn't delete PD "aws://us-west-2a/vol-0e4ed538dd7ce1e92", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0e4ed538dd7ce1e92 is currently attached to i-06b67b49ea933fa11
	status code: 400, request id: e5f003ad-b252-487c-9bc3-e5eb5faa7e52
Oct 13 16:53:23.937: INFO: Successfully deleted PD "aws://us-west-2a/vol-0e4ed538dd7ce1e92".
[AfterEach] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 16:53:23.937: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-226" for this suite.
... skipping 388 lines ...
STEP: Deleting pod aws-client in namespace volume-8454
Oct 13 16:53:27.113: INFO: Waiting for pod aws-client to disappear
Oct 13 16:53:27.177: INFO: Pod aws-client still exists
Oct 13 16:53:29.178: INFO: Waiting for pod aws-client to disappear
Oct 13 16:53:29.251: INFO: Pod aws-client no longer exists
STEP: cleaning the environment after aws
Oct 13 16:53:29.422: INFO: Couldn't delete PD "aws://us-west-2a/vol-01a9a0cbe7e949338", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-01a9a0cbe7e949338 is currently attached to i-0f7953e39ddb3373a
	status code: 400, request id: 9914ec42-2404-4147-a116-46c67767b1e5
Oct 13 16:53:34.874: INFO: Couldn't delete PD "aws://us-west-2a/vol-01a9a0cbe7e949338", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-01a9a0cbe7e949338 is currently attached to i-0f7953e39ddb3373a
	status code: 400, request id: 4db0a23b-e105-4fdf-8aa4-f0a4a8e26e76
Oct 13 16:53:40.344: INFO: Successfully deleted PD "aws://us-west-2a/vol-01a9a0cbe7e949338".
[AfterEach] [Testpattern: Inline-volume (default fs)] volumes
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 16:53:40.344: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-8454" for this suite.
... skipping 325 lines ...
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:52:30.074: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail if subpath file is outside the volume [Slow][LinuxOnly]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256
Oct 13 16:52:30.411: INFO: Creating resource for dynamic PV
Oct 13 16:52:30.411: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-6216-e2e-sc8d7n5
STEP: creating a claim
Oct 13 16:52:30.478: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-bwgl
STEP: Checking for subpath error in container status
Oct 13 16:53:14.814: INFO: Deleting pod "pod-subpath-test-dynamicpv-bwgl" in namespace "provisioning-6216"
Oct 13 16:53:14.881: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-bwgl" to be fully deleted
STEP: Deleting pod
Oct 13 16:53:17.009: INFO: Deleting pod "pod-subpath-test-dynamicpv-bwgl" in namespace "provisioning-6216"
STEP: Deleting pvc
Oct 13 16:53:17.203: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.combb574"
... skipping 15 lines ...

• [SLOW TEST:82.914 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath file is outside the volume [Slow][LinuxOnly]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext3)] volumes
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 16:53:52.991: INFO: Driver "ebs.csi.aws.com" does not support volume type "PreprovisionedPV" - skipping
[AfterEach] [Testpattern: Pre-provisioned PV (ext3)] volumes
... skipping 372 lines ...
Oct 13 16:52:58.032: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-8461-e2e-scxrrlg
STEP: creating a claim
Oct 13 16:52:58.097: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-x9p4
STEP: Creating a pod to test subpath
Oct 13 16:52:58.299: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-x9p4" in namespace "provisioning-8461" to be "Succeeded or Failed"
Oct 13 16:52:58.364: INFO: Pod "pod-subpath-test-dynamicpv-x9p4": Phase="Pending", Reason="", readiness=false. Elapsed: 64.891768ms
Oct 13 16:53:00.431: INFO: Pod "pod-subpath-test-dynamicpv-x9p4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.13195913s
Oct 13 16:53:02.495: INFO: Pod "pod-subpath-test-dynamicpv-x9p4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.196259601s
Oct 13 16:53:04.560: INFO: Pod "pod-subpath-test-dynamicpv-x9p4": Phase="Pending", Reason="", readiness=false. Elapsed: 6.261333501s
Oct 13 16:53:06.627: INFO: Pod "pod-subpath-test-dynamicpv-x9p4": Phase="Pending", Reason="", readiness=false. Elapsed: 8.327746892s
Oct 13 16:53:08.692: INFO: Pod "pod-subpath-test-dynamicpv-x9p4": Phase="Pending", Reason="", readiness=false. Elapsed: 10.39296124s
... skipping 2 lines ...
Oct 13 16:53:14.896: INFO: Pod "pod-subpath-test-dynamicpv-x9p4": Phase="Pending", Reason="", readiness=false. Elapsed: 16.596738324s
Oct 13 16:53:16.961: INFO: Pod "pod-subpath-test-dynamicpv-x9p4": Phase="Pending", Reason="", readiness=false. Elapsed: 18.661794378s
Oct 13 16:53:19.025: INFO: Pod "pod-subpath-test-dynamicpv-x9p4": Phase="Pending", Reason="", readiness=false. Elapsed: 20.726047773s
Oct 13 16:53:21.089: INFO: Pod "pod-subpath-test-dynamicpv-x9p4": Phase="Pending", Reason="", readiness=false. Elapsed: 22.790533804s
Oct 13 16:53:23.154: INFO: Pod "pod-subpath-test-dynamicpv-x9p4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 24.855605843s
STEP: Saw pod success
Oct 13 16:53:23.155: INFO: Pod "pod-subpath-test-dynamicpv-x9p4" satisfied condition "Succeeded or Failed"
Oct 13 16:53:23.243: INFO: Trying to get logs from node ip-172-20-37-135.us-west-2.compute.internal pod pod-subpath-test-dynamicpv-x9p4 container test-container-subpath-dynamicpv-x9p4: <nil>
STEP: delete the pod
Oct 13 16:53:23.379: INFO: Waiting for pod pod-subpath-test-dynamicpv-x9p4 to disappear
Oct 13 16:53:23.445: INFO: Pod pod-subpath-test-dynamicpv-x9p4 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-x9p4
Oct 13 16:53:23.445: INFO: Deleting pod "pod-subpath-test-dynamicpv-x9p4" in namespace "provisioning-8461"
... skipping 174 lines ...
STEP: Deleting pod hostexec-ip-172-20-37-135.us-west-2.compute.internal-v7cn5 in namespace volumemode-4701
Oct 13 16:53:39.425: INFO: Deleting pod "pod-a8a03991-4e4b-4fd2-967a-731fb067ccd4" in namespace "volumemode-4701"
Oct 13 16:53:39.512: INFO: Wait up to 5m0s for pod "pod-a8a03991-4e4b-4fd2-967a-731fb067ccd4" to be fully deleted
STEP: Deleting pv and pvc
Oct 13 16:53:43.644: INFO: Deleting PersistentVolumeClaim "pvc-749ps"
Oct 13 16:53:43.710: INFO: Deleting PersistentVolume "aws-vrdvx"
Oct 13 16:53:43.959: INFO: Couldn't delete PD "aws://us-west-2a/vol-05976cfd950f88cbc", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-05976cfd950f88cbc is currently attached to i-04097d75079331972
	status code: 400, request id: 92ac4da5-535a-4a86-bdb0-a206f4a955be
Oct 13 16:53:49.371: INFO: Couldn't delete PD "aws://us-west-2a/vol-05976cfd950f88cbc", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-05976cfd950f88cbc is currently attached to i-04097d75079331972
	status code: 400, request id: 8d503066-4ebe-4631-bac5-ffffd1139cb5
Oct 13 16:53:54.782: INFO: Couldn't delete PD "aws://us-west-2a/vol-05976cfd950f88cbc", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-05976cfd950f88cbc is currently attached to i-04097d75079331972
	status code: 400, request id: 95850d50-4ff6-4e71-948e-72086d41f6b8
Oct 13 16:54:00.224: INFO: Couldn't delete PD "aws://us-west-2a/vol-05976cfd950f88cbc", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-05976cfd950f88cbc is currently attached to i-04097d75079331972
	status code: 400, request id: 80252806-863c-472c-ad4b-ae33f15b67f3
Oct 13 16:54:05.639: INFO: Successfully deleted PD "aws://us-west-2a/vol-05976cfd950f88cbc".
[AfterEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 16:54:05.639: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volumemode-4701" for this suite.
... skipping 492 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.000 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath directory is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240

    Driver ebs.csi.aws.com doesn't support ntfs -- skipping

    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:121
------------------------------
... skipping 383 lines ...
Oct 13 16:53:19.674: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass volume-4414f7trm
STEP: creating a claim
Oct 13 16:53:19.741: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod exec-volume-test-dynamicpv-n7n2
STEP: Creating a pod to test exec-volume-test
Oct 13 16:53:19.945: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-n7n2" in namespace "volume-4414" to be "Succeeded or Failed"
Oct 13 16:53:20.012: INFO: Pod "exec-volume-test-dynamicpv-n7n2": Phase="Pending", Reason="", readiness=false. Elapsed: 66.622245ms
Oct 13 16:53:22.080: INFO: Pod "exec-volume-test-dynamicpv-n7n2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.134330141s
Oct 13 16:53:24.150: INFO: Pod "exec-volume-test-dynamicpv-n7n2": Phase="Pending", Reason="", readiness=false. Elapsed: 4.204484466s
Oct 13 16:53:26.218: INFO: Pod "exec-volume-test-dynamicpv-n7n2": Phase="Pending", Reason="", readiness=false. Elapsed: 6.272849184s
Oct 13 16:53:28.286: INFO: Pod "exec-volume-test-dynamicpv-n7n2": Phase="Pending", Reason="", readiness=false. Elapsed: 8.340615048s
Oct 13 16:53:30.353: INFO: Pod "exec-volume-test-dynamicpv-n7n2": Phase="Pending", Reason="", readiness=false. Elapsed: 10.407872868s
Oct 13 16:53:32.422: INFO: Pod "exec-volume-test-dynamicpv-n7n2": Phase="Pending", Reason="", readiness=false. Elapsed: 12.476672201s
Oct 13 16:53:34.491: INFO: Pod "exec-volume-test-dynamicpv-n7n2": Phase="Pending", Reason="", readiness=false. Elapsed: 14.545816839s
Oct 13 16:53:36.558: INFO: Pod "exec-volume-test-dynamicpv-n7n2": Phase="Pending", Reason="", readiness=false. Elapsed: 16.612709519s
Oct 13 16:53:38.626: INFO: Pod "exec-volume-test-dynamicpv-n7n2": Phase="Pending", Reason="", readiness=false. Elapsed: 18.680735424s
Oct 13 16:53:40.694: INFO: Pod "exec-volume-test-dynamicpv-n7n2": Phase="Pending", Reason="", readiness=false. Elapsed: 20.748362598s
Oct 13 16:53:42.761: INFO: Pod "exec-volume-test-dynamicpv-n7n2": Phase="Succeeded", Reason="", readiness=false. Elapsed: 22.815342495s
STEP: Saw pod success
Oct 13 16:53:42.761: INFO: Pod "exec-volume-test-dynamicpv-n7n2" satisfied condition "Succeeded or Failed"
Oct 13 16:53:42.840: INFO: Trying to get logs from node ip-172-20-37-205.us-west-2.compute.internal pod exec-volume-test-dynamicpv-n7n2 container exec-container-dynamicpv-n7n2: <nil>
STEP: delete the pod
Oct 13 16:53:42.999: INFO: Waiting for pod exec-volume-test-dynamicpv-n7n2 to disappear
Oct 13 16:53:43.066: INFO: Pod exec-volume-test-dynamicpv-n7n2 no longer exists
STEP: Deleting pod exec-volume-test-dynamicpv-n7n2
Oct 13 16:53:43.066: INFO: Deleting pod "exec-volume-test-dynamicpv-n7n2" in namespace "volume-4414"
... skipping 61 lines ...
Oct 13 16:53:43.053: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass volume-33844bblv
STEP: creating a claim
Oct 13 16:53:43.120: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod exec-volume-test-dynamicpv-rjpj
STEP: Creating a pod to test exec-volume-test
Oct 13 16:53:43.338: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-rjpj" in namespace "volume-3384" to be "Succeeded or Failed"
Oct 13 16:53:43.404: INFO: Pod "exec-volume-test-dynamicpv-rjpj": Phase="Pending", Reason="", readiness=false. Elapsed: 65.660348ms
Oct 13 16:53:45.470: INFO: Pod "exec-volume-test-dynamicpv-rjpj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.131922579s
Oct 13 16:53:47.537: INFO: Pod "exec-volume-test-dynamicpv-rjpj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.198512698s
Oct 13 16:53:49.606: INFO: Pod "exec-volume-test-dynamicpv-rjpj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.267162542s
Oct 13 16:53:51.674: INFO: Pod "exec-volume-test-dynamicpv-rjpj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.33542705s
Oct 13 16:53:53.743: INFO: Pod "exec-volume-test-dynamicpv-rjpj": Phase="Pending", Reason="", readiness=false. Elapsed: 10.40446917s
Oct 13 16:53:55.809: INFO: Pod "exec-volume-test-dynamicpv-rjpj": Phase="Pending", Reason="", readiness=false. Elapsed: 12.470490759s
Oct 13 16:53:57.875: INFO: Pod "exec-volume-test-dynamicpv-rjpj": Phase="Pending", Reason="", readiness=false. Elapsed: 14.536690909s
Oct 13 16:53:59.943: INFO: Pod "exec-volume-test-dynamicpv-rjpj": Phase="Pending", Reason="", readiness=false. Elapsed: 16.604504464s
Oct 13 16:54:02.010: INFO: Pod "exec-volume-test-dynamicpv-rjpj": Phase="Pending", Reason="", readiness=false. Elapsed: 18.671604009s
Oct 13 16:54:04.078: INFO: Pod "exec-volume-test-dynamicpv-rjpj": Phase="Pending", Reason="", readiness=false. Elapsed: 20.739897302s
Oct 13 16:54:06.145: INFO: Pod "exec-volume-test-dynamicpv-rjpj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 22.806256509s
STEP: Saw pod success
Oct 13 16:54:06.145: INFO: Pod "exec-volume-test-dynamicpv-rjpj" satisfied condition "Succeeded or Failed"
Oct 13 16:54:06.211: INFO: Trying to get logs from node ip-172-20-37-135.us-west-2.compute.internal pod exec-volume-test-dynamicpv-rjpj container exec-container-dynamicpv-rjpj: <nil>
STEP: delete the pod
Oct 13 16:54:06.352: INFO: Waiting for pod exec-volume-test-dynamicpv-rjpj to disappear
Oct 13 16:54:06.417: INFO: Pod exec-volume-test-dynamicpv-rjpj no longer exists
STEP: Deleting pod exec-volume-test-dynamicpv-rjpj
Oct 13 16:54:06.417: INFO: Deleting pod "exec-volume-test-dynamicpv-rjpj" in namespace "volume-3384"
... skipping 27 lines ...
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:53:24.888: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267
Oct 13 16:53:25.210: INFO: Creating resource for dynamic PV
Oct 13 16:53:25.210: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-9339-e2e-scwl4kt
STEP: creating a claim
Oct 13 16:53:25.275: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-8tjw
STEP: Checking for subpath error in container status
Oct 13 16:53:49.602: INFO: Deleting pod "pod-subpath-test-dynamicpv-8tjw" in namespace "provisioning-9339"
Oct 13 16:53:49.670: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-8tjw" to be fully deleted
STEP: Deleting pod
Oct 13 16:53:51.800: INFO: Deleting pod "pod-subpath-test-dynamicpv-8tjw" in namespace "provisioning-9339"
STEP: Deleting pvc
Oct 13 16:53:51.993: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.coml5q8v"
... skipping 15 lines ...

• [SLOW TEST:62.899 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 16:54:27.789: INFO: Driver "ebs.csi.aws.com" does not support volume type "InlineVolume" - skipping
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
... skipping 2 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Inline-volume (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278

    Driver "ebs.csi.aws.com" does not support volume type "InlineVolume" - skipping

    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 30 lines ...
Oct 13 16:53:34.822: INFO: Creating resource for dynamic PV
Oct 13 16:53:34.822: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-422352mth
STEP: creating a claim
Oct 13 16:53:34.890: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod to format volume volume-prep-provisioning-4223
Oct 13 16:53:35.104: INFO: Waiting up to 5m0s for pod "volume-prep-provisioning-4223" in namespace "provisioning-4223" to be "Succeeded or Failed"
Oct 13 16:53:35.173: INFO: Pod "volume-prep-provisioning-4223": Phase="Pending", Reason="", readiness=false. Elapsed: 68.231675ms
Oct 13 16:53:37.241: INFO: Pod "volume-prep-provisioning-4223": Phase="Pending", Reason="", readiness=false. Elapsed: 2.136936463s
Oct 13 16:53:39.311: INFO: Pod "volume-prep-provisioning-4223": Phase="Pending", Reason="", readiness=false. Elapsed: 4.206291595s
Oct 13 16:53:41.380: INFO: Pod "volume-prep-provisioning-4223": Phase="Pending", Reason="", readiness=false. Elapsed: 6.275765609s
Oct 13 16:53:43.448: INFO: Pod "volume-prep-provisioning-4223": Phase="Pending", Reason="", readiness=false. Elapsed: 8.34392273s
Oct 13 16:53:45.525: INFO: Pod "volume-prep-provisioning-4223": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.420155817s
STEP: Saw pod success
Oct 13 16:53:45.525: INFO: Pod "volume-prep-provisioning-4223" satisfied condition "Succeeded or Failed"
Oct 13 16:53:45.525: INFO: Deleting pod "volume-prep-provisioning-4223" in namespace "provisioning-4223"
Oct 13 16:53:45.598: INFO: Wait up to 5m0s for pod "volume-prep-provisioning-4223" to be fully deleted
STEP: Creating pod pod-subpath-test-dynamicpv-kqg4
STEP: Checking for subpath error in container status
Oct 13 16:54:19.872: INFO: Deleting pod "pod-subpath-test-dynamicpv-kqg4" in namespace "provisioning-4223"
Oct 13 16:54:19.946: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-kqg4" to be fully deleted
STEP: Deleting pod
Oct 13 16:54:20.014: INFO: Deleting pod "pod-subpath-test-dynamicpv-kqg4" in namespace "provisioning-4223"
STEP: Deleting pvc
Oct 13 16:54:20.219: INFO: Deleting PersistentVolumeClaim "awsrphzj"
... skipping 215 lines ...
Oct 13 16:54:15.297: INFO: PersistentVolumeClaim pvc-8btv7 found but phase is Pending instead of Bound.
Oct 13 16:54:17.364: INFO: PersistentVolumeClaim pvc-8btv7 found and phase=Bound (8.330814077s)
Oct 13 16:54:17.364: INFO: Waiting up to 3m0s for PersistentVolume aws-nf6j4 to have phase Bound
Oct 13 16:54:17.437: INFO: PersistentVolume aws-nf6j4 found and phase=Bound (72.285305ms)
STEP: Creating pod exec-volume-test-preprovisionedpv-pztz
STEP: Creating a pod to test exec-volume-test
Oct 13 16:54:17.637: INFO: Waiting up to 5m0s for pod "exec-volume-test-preprovisionedpv-pztz" in namespace "volume-7475" to be "Succeeded or Failed"
Oct 13 16:54:17.702: INFO: Pod "exec-volume-test-preprovisionedpv-pztz": Phase="Pending", Reason="", readiness=false. Elapsed: 65.603012ms
Oct 13 16:54:19.768: INFO: Pod "exec-volume-test-preprovisionedpv-pztz": Phase="Pending", Reason="", readiness=false. Elapsed: 2.131574531s
Oct 13 16:54:21.844: INFO: Pod "exec-volume-test-preprovisionedpv-pztz": Phase="Pending", Reason="", readiness=false. Elapsed: 4.206985556s
Oct 13 16:54:23.910: INFO: Pod "exec-volume-test-preprovisionedpv-pztz": Phase="Pending", Reason="", readiness=false. Elapsed: 6.273375333s
Oct 13 16:54:25.978: INFO: Pod "exec-volume-test-preprovisionedpv-pztz": Phase="Pending", Reason="", readiness=false. Elapsed: 8.340848144s
Oct 13 16:54:28.045: INFO: Pod "exec-volume-test-preprovisionedpv-pztz": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.408769289s
STEP: Saw pod success
Oct 13 16:54:28.046: INFO: Pod "exec-volume-test-preprovisionedpv-pztz" satisfied condition "Succeeded or Failed"
Oct 13 16:54:28.111: INFO: Trying to get logs from node ip-172-20-39-49.us-west-2.compute.internal pod exec-volume-test-preprovisionedpv-pztz container exec-container-preprovisionedpv-pztz: <nil>
STEP: delete the pod
Oct 13 16:54:28.255: INFO: Waiting for pod exec-volume-test-preprovisionedpv-pztz to disappear
Oct 13 16:54:28.321: INFO: Pod exec-volume-test-preprovisionedpv-pztz no longer exists
STEP: Deleting pod exec-volume-test-preprovisionedpv-pztz
Oct 13 16:54:28.321: INFO: Deleting pod "exec-volume-test-preprovisionedpv-pztz" in namespace "volume-7475"
STEP: Deleting pv and pvc
Oct 13 16:54:28.392: INFO: Deleting PersistentVolumeClaim "pvc-8btv7"
Oct 13 16:54:28.458: INFO: Deleting PersistentVolume "aws-nf6j4"
Oct 13 16:54:28.754: INFO: Couldn't delete PD "aws://us-west-2a/vol-039d32b31e01232da", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-039d32b31e01232da is currently attached to i-0f7953e39ddb3373a
	status code: 400, request id: 87efca93-21fd-4e7e-9f9a-7804e2badf21
Oct 13 16:54:34.133: INFO: Couldn't delete PD "aws://us-west-2a/vol-039d32b31e01232da", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-039d32b31e01232da is currently attached to i-0f7953e39ddb3373a
	status code: 400, request id: c9000f34-7d3d-494d-b658-d336a010d99c
Oct 13 16:54:39.597: INFO: Successfully deleted PD "aws://us-west-2a/vol-039d32b31e01232da".
[AfterEach] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 16:54:39.597: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-7475" for this suite.
... skipping 150 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278

    Driver ebs.csi.aws.com doesn't support ntfs -- skipping

    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:121
------------------------------
... skipping 230 lines ...
Oct 13 16:54:06.580: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-8178zdhm6
STEP: creating a claim
Oct 13 16:54:06.646: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-6gl2
STEP: Creating a pod to test subpath
Oct 13 16:54:06.847: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-6gl2" in namespace "provisioning-8178" to be "Succeeded or Failed"
Oct 13 16:54:06.912: INFO: Pod "pod-subpath-test-dynamicpv-6gl2": Phase="Pending", Reason="", readiness=false. Elapsed: 65.289667ms
Oct 13 16:54:08.979: INFO: Pod "pod-subpath-test-dynamicpv-6gl2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.132418272s
Oct 13 16:54:11.046: INFO: Pod "pod-subpath-test-dynamicpv-6gl2": Phase="Pending", Reason="", readiness=false. Elapsed: 4.19891287s
Oct 13 16:54:13.113: INFO: Pod "pod-subpath-test-dynamicpv-6gl2": Phase="Pending", Reason="", readiness=false. Elapsed: 6.266703149s
Oct 13 16:54:15.180: INFO: Pod "pod-subpath-test-dynamicpv-6gl2": Phase="Pending", Reason="", readiness=false. Elapsed: 8.333075745s
Oct 13 16:54:17.247: INFO: Pod "pod-subpath-test-dynamicpv-6gl2": Phase="Pending", Reason="", readiness=false. Elapsed: 10.400372277s
Oct 13 16:54:19.314: INFO: Pod "pod-subpath-test-dynamicpv-6gl2": Phase="Pending", Reason="", readiness=false. Elapsed: 12.467403301s
Oct 13 16:54:21.387: INFO: Pod "pod-subpath-test-dynamicpv-6gl2": Phase="Pending", Reason="", readiness=false. Elapsed: 14.539934646s
Oct 13 16:54:23.452: INFO: Pod "pod-subpath-test-dynamicpv-6gl2": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.605351998s
STEP: Saw pod success
Oct 13 16:54:23.452: INFO: Pod "pod-subpath-test-dynamicpv-6gl2" satisfied condition "Succeeded or Failed"
Oct 13 16:54:23.518: INFO: Trying to get logs from node ip-172-20-37-135.us-west-2.compute.internal pod pod-subpath-test-dynamicpv-6gl2 container test-container-volume-dynamicpv-6gl2: <nil>
STEP: delete the pod
Oct 13 16:54:23.662: INFO: Waiting for pod pod-subpath-test-dynamicpv-6gl2 to disappear
Oct 13 16:54:23.728: INFO: Pod pod-subpath-test-dynamicpv-6gl2 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-6gl2
Oct 13 16:54:23.728: INFO: Deleting pod "pod-subpath-test-dynamicpv-6gl2" in namespace "provisioning-8178"
... skipping 153 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath directory is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240

      Distro debian doesn't support ntfs -- skipping

      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:127
------------------------------
... skipping 159 lines ...
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:54:16.829: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail if subpath directory is outside the volume [Slow][LinuxOnly]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240
Oct 13 16:54:17.147: INFO: Creating resource for dynamic PV
Oct 13 16:54:17.147: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-4387-e2e-scfw64g
STEP: creating a claim
Oct 13 16:54:17.212: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-xg9q
STEP: Checking for subpath error in container status
Oct 13 16:54:43.541: INFO: Deleting pod "pod-subpath-test-dynamicpv-xg9q" in namespace "provisioning-4387"
Oct 13 16:54:43.605: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-xg9q" to be fully deleted
STEP: Deleting pod
Oct 13 16:54:45.734: INFO: Deleting pod "pod-subpath-test-dynamicpv-xg9q" in namespace "provisioning-4387"
STEP: Deleting pvc
Oct 13 16:54:45.925: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.commswgw"
... skipping 11 lines ...

• [SLOW TEST:44.619 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath directory is outside the volume [Slow][LinuxOnly]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 16:55:01.450: INFO: Driver supports dynamic provisioning, skipping PreprovisionedPV pattern
[AfterEach] [Testpattern: Pre-provisioned PV (block volmode)] multiVolume [Slow]
... skipping 554 lines ...
Oct 13 16:54:40.068: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(aws) supported size:{ 1Gi} 
STEP: creating a StorageClass volume-expand-9207hpwsg
STEP: creating a claim
Oct 13 16:54:40.135: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Expanding non-expandable pvc
Oct 13 16:54:40.268: INFO: currentPvcSize {{1073741824 0} {<nil>} 1Gi BinarySI}, newSize {{2147483648 0} {<nil>}  BinarySI}
Oct 13 16:54:40.409: INFO: Error updating pvc awss87qq: PersistentVolumeClaim "awss87qq" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-9207hpwsg",
  	... // 3 identical fields
  }

Oct 13 16:54:42.541: INFO: Error updating pvc awss87qq: PersistentVolumeClaim "awss87qq" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-9207hpwsg",
  	... // 3 identical fields
  }

Oct 13 16:54:44.546: INFO: Error updating pvc awss87qq: PersistentVolumeClaim "awss87qq" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-9207hpwsg",
  	... // 3 identical fields
  }

Oct 13 16:54:46.554: INFO: Error updating pvc awss87qq: PersistentVolumeClaim "awss87qq" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-9207hpwsg",
  	... // 3 identical fields
  }

Oct 13 16:54:48.541: INFO: Error updating pvc awss87qq: PersistentVolumeClaim "awss87qq" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-9207hpwsg",
  	... // 3 identical fields
  }

Oct 13 16:54:50.545: INFO: Error updating pvc awss87qq: PersistentVolumeClaim "awss87qq" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-9207hpwsg",
  	... // 3 identical fields
  }

Oct 13 16:54:52.542: INFO: Error updating pvc awss87qq: PersistentVolumeClaim "awss87qq" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-9207hpwsg",
  	... // 3 identical fields
  }

Oct 13 16:54:54.541: INFO: Error updating pvc awss87qq: PersistentVolumeClaim "awss87qq" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-9207hpwsg",
  	... // 3 identical fields
  }

Oct 13 16:54:56.542: INFO: Error updating pvc awss87qq: PersistentVolumeClaim "awss87qq" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-9207hpwsg",
  	... // 3 identical fields
  }

Oct 13 16:54:58.542: INFO: Error updating pvc awss87qq: PersistentVolumeClaim "awss87qq" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-9207hpwsg",
  	... // 3 identical fields
  }

Oct 13 16:55:00.547: INFO: Error updating pvc awss87qq: PersistentVolumeClaim "awss87qq" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-9207hpwsg",
  	... // 3 identical fields
  }

Oct 13 16:55:02.541: INFO: Error updating pvc awss87qq: PersistentVolumeClaim "awss87qq" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-9207hpwsg",
  	... // 3 identical fields
  }

Oct 13 16:55:04.541: INFO: Error updating pvc awss87qq: PersistentVolumeClaim "awss87qq" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-9207hpwsg",
  	... // 3 identical fields
  }

Oct 13 16:55:06.546: INFO: Error updating pvc awss87qq: PersistentVolumeClaim "awss87qq" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-9207hpwsg",
  	... // 3 identical fields
  }

Oct 13 16:55:08.542: INFO: Error updating pvc awss87qq: PersistentVolumeClaim "awss87qq" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-9207hpwsg",
  	... // 3 identical fields
  }

Oct 13 16:55:10.544: INFO: Error updating pvc awss87qq: PersistentVolumeClaim "awss87qq" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-9207hpwsg",
  	... // 3 identical fields
  }

Oct 13 16:55:10.675: INFO: Error updating pvc awss87qq: PersistentVolumeClaim "awss87qq" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 41 lines ...
Oct 13 16:53:54.230: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-9967-e2e-sc74wzd
STEP: creating a claim
Oct 13 16:53:54.294: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-ww6t
STEP: Creating a pod to test subpath
Oct 13 16:53:54.486: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-ww6t" in namespace "provisioning-9967" to be "Succeeded or Failed"
Oct 13 16:53:54.549: INFO: Pod "pod-subpath-test-dynamicpv-ww6t": Phase="Pending", Reason="", readiness=false. Elapsed: 62.563274ms
Oct 13 16:53:56.613: INFO: Pod "pod-subpath-test-dynamicpv-ww6t": Phase="Pending", Reason="", readiness=false. Elapsed: 2.126450639s
Oct 13 16:53:58.679: INFO: Pod "pod-subpath-test-dynamicpv-ww6t": Phase="Pending", Reason="", readiness=false. Elapsed: 4.192965175s
Oct 13 16:54:00.744: INFO: Pod "pod-subpath-test-dynamicpv-ww6t": Phase="Pending", Reason="", readiness=false. Elapsed: 6.2579253s
Oct 13 16:54:02.808: INFO: Pod "pod-subpath-test-dynamicpv-ww6t": Phase="Pending", Reason="", readiness=false. Elapsed: 8.321364292s
Oct 13 16:54:04.871: INFO: Pod "pod-subpath-test-dynamicpv-ww6t": Phase="Pending", Reason="", readiness=false. Elapsed: 10.38453267s
... skipping 10 lines ...
Oct 13 16:54:27.577: INFO: Pod "pod-subpath-test-dynamicpv-ww6t": Phase="Pending", Reason="", readiness=false. Elapsed: 33.090878021s
Oct 13 16:54:29.641: INFO: Pod "pod-subpath-test-dynamicpv-ww6t": Phase="Pending", Reason="", readiness=false. Elapsed: 35.155068433s
Oct 13 16:54:31.707: INFO: Pod "pod-subpath-test-dynamicpv-ww6t": Phase="Pending", Reason="", readiness=false. Elapsed: 37.22081309s
Oct 13 16:54:33.771: INFO: Pod "pod-subpath-test-dynamicpv-ww6t": Phase="Pending", Reason="", readiness=false. Elapsed: 39.284678602s
Oct 13 16:54:35.839: INFO: Pod "pod-subpath-test-dynamicpv-ww6t": Phase="Succeeded", Reason="", readiness=false. Elapsed: 41.352397488s
STEP: Saw pod success
Oct 13 16:54:35.839: INFO: Pod "pod-subpath-test-dynamicpv-ww6t" satisfied condition "Succeeded or Failed"
Oct 13 16:54:35.902: INFO: Trying to get logs from node ip-172-20-37-205.us-west-2.compute.internal pod pod-subpath-test-dynamicpv-ww6t container test-container-volume-dynamicpv-ww6t: <nil>
STEP: delete the pod
Oct 13 16:54:36.037: INFO: Waiting for pod pod-subpath-test-dynamicpv-ww6t to disappear
Oct 13 16:54:36.100: INFO: Pod pod-subpath-test-dynamicpv-ww6t no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-ww6t
Oct 13 16:54:36.101: INFO: Deleting pod "pod-subpath-test-dynamicpv-ww6t" in namespace "provisioning-9967"
... skipping 64 lines ...
Oct 13 16:53:59.812: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-1424-e2e-sc25q7g
STEP: creating a claim
Oct 13 16:53:59.877: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-vgph
STEP: Creating a pod to test subpath
Oct 13 16:54:00.075: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-vgph" in namespace "provisioning-1424" to be "Succeeded or Failed"
Oct 13 16:54:00.140: INFO: Pod "pod-subpath-test-dynamicpv-vgph": Phase="Pending", Reason="", readiness=false. Elapsed: 64.305528ms
Oct 13 16:54:02.204: INFO: Pod "pod-subpath-test-dynamicpv-vgph": Phase="Pending", Reason="", readiness=false. Elapsed: 2.128941289s
Oct 13 16:54:04.270: INFO: Pod "pod-subpath-test-dynamicpv-vgph": Phase="Pending", Reason="", readiness=false. Elapsed: 4.194177605s
Oct 13 16:54:06.340: INFO: Pod "pod-subpath-test-dynamicpv-vgph": Phase="Pending", Reason="", readiness=false. Elapsed: 6.264911034s
Oct 13 16:54:08.405: INFO: Pod "pod-subpath-test-dynamicpv-vgph": Phase="Pending", Reason="", readiness=false. Elapsed: 8.329523321s
Oct 13 16:54:10.470: INFO: Pod "pod-subpath-test-dynamicpv-vgph": Phase="Pending", Reason="", readiness=false. Elapsed: 10.394159273s
... skipping 11 lines ...
Oct 13 16:54:35.254: INFO: Pod "pod-subpath-test-dynamicpv-vgph": Phase="Pending", Reason="", readiness=false. Elapsed: 35.178690015s
Oct 13 16:54:37.319: INFO: Pod "pod-subpath-test-dynamicpv-vgph": Phase="Pending", Reason="", readiness=false. Elapsed: 37.243719534s
Oct 13 16:54:39.383: INFO: Pod "pod-subpath-test-dynamicpv-vgph": Phase="Pending", Reason="", readiness=false. Elapsed: 39.307783593s
Oct 13 16:54:41.448: INFO: Pod "pod-subpath-test-dynamicpv-vgph": Phase="Pending", Reason="", readiness=false. Elapsed: 41.372975246s
Oct 13 16:54:43.514: INFO: Pod "pod-subpath-test-dynamicpv-vgph": Phase="Succeeded", Reason="", readiness=false. Elapsed: 43.438624247s
STEP: Saw pod success
Oct 13 16:54:43.514: INFO: Pod "pod-subpath-test-dynamicpv-vgph" satisfied condition "Succeeded or Failed"
Oct 13 16:54:43.578: INFO: Trying to get logs from node ip-172-20-37-205.us-west-2.compute.internal pod pod-subpath-test-dynamicpv-vgph container test-container-subpath-dynamicpv-vgph: <nil>
STEP: delete the pod
Oct 13 16:54:43.715: INFO: Waiting for pod pod-subpath-test-dynamicpv-vgph to disappear
Oct 13 16:54:43.779: INFO: Pod pod-subpath-test-dynamicpv-vgph no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-vgph
Oct 13 16:54:43.779: INFO: Deleting pod "pod-subpath-test-dynamicpv-vgph" in namespace "provisioning-1424"
... skipping 362 lines ...
Oct 13 16:54:15.871: INFO: In creating storage class object and pvc objects for driver - sc: &StorageClass{ObjectMeta:{provisioning-3890-e2e-scq8jlf      0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] []  []},Provisioner:ebs.csi.aws.com,Parameters:map[string]string{},ReclaimPolicy:nil,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*WaitForFirstConsumer,AllowedTopologies:[]TopologySelectorTerm{},}, pvc: &PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-3890    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] []  []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1073741824 0} {<nil>} 1Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-3890-e2e-scq8jlf,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},}, src-pvc: &PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-3890    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] []  []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1073741824 0} {<nil>} 1Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-3890-e2e-scq8jlf,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},}
STEP: Creating a StorageClass
STEP: creating claim=&PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-3890    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] []  []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1073741824 0} {<nil>} 1Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-3890-e2e-scq8jlf,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},}
STEP: creating a pod referring to the class=&StorageClass{ObjectMeta:{provisioning-3890-e2e-scq8jlf    168d2981-5e86-41f2-a88b-0f9dca1889da 7326 0 2021-10-13 16:54:15 +0000 UTC <nil> <nil> map[] map[] [] []  [{e2e-kubernetes.test Update storage.k8s.io/v1 2021-10-13 16:54:15 +0000 UTC FieldsV1 {"f:mountOptions":{},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:ebs.csi.aws.com,Parameters:map[string]string{},ReclaimPolicy:*Delete,MountOptions:[dirsync],AllowVolumeExpansion:nil,VolumeBindingMode:*WaitForFirstConsumer,AllowedTopologies:[]TopologySelectorTerm{},} claim=&PersistentVolumeClaim{ObjectMeta:{pvc-7v7zn pvc- provisioning-3890  312c55b4-a017-4bfa-9cb8-2c9a8a849db2 7340 0 2021-10-13 16:54:16 +0000 UTC <nil> <nil> map[] map[] [] [kubernetes.io/pvc-protection]  [{e2e-kubernetes.test Update v1 2021-10-13 16:54:16 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:storageClassName":{},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1073741824 0} {<nil>} 1Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-3890-e2e-scq8jlf,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},}
STEP: Deleting pod pod-7032572e-dd78-45ec-be65-0abedd628c87 in namespace provisioning-3890
STEP: checking the created volume is writable on node {Name: Selector:map[] Affinity:nil}
Oct 13 16:54:26.625: INFO: Waiting up to 15m0s for pod "pvc-volume-tester-writer-jkwj9" in namespace "provisioning-3890" to be "Succeeded or Failed"
Oct 13 16:54:26.691: INFO: Pod "pvc-volume-tester-writer-jkwj9": Phase="Pending", Reason="", readiness=false. Elapsed: 65.84788ms
Oct 13 16:54:28.760: INFO: Pod "pvc-volume-tester-writer-jkwj9": Phase="Pending", Reason="", readiness=false. Elapsed: 2.134823194s
Oct 13 16:54:30.829: INFO: Pod "pvc-volume-tester-writer-jkwj9": Phase="Pending", Reason="", readiness=false. Elapsed: 4.203517121s
Oct 13 16:54:32.896: INFO: Pod "pvc-volume-tester-writer-jkwj9": Phase="Pending", Reason="", readiness=false. Elapsed: 6.270927167s
Oct 13 16:54:34.967: INFO: Pod "pvc-volume-tester-writer-jkwj9": Phase="Pending", Reason="", readiness=false. Elapsed: 8.341526228s
Oct 13 16:54:37.034: INFO: Pod "pvc-volume-tester-writer-jkwj9": Phase="Pending", Reason="", readiness=false. Elapsed: 10.408937558s
... skipping 7 lines ...
Oct 13 16:54:53.581: INFO: Pod "pvc-volume-tester-writer-jkwj9": Phase="Pending", Reason="", readiness=false. Elapsed: 26.955102993s
Oct 13 16:54:55.648: INFO: Pod "pvc-volume-tester-writer-jkwj9": Phase="Pending", Reason="", readiness=false. Elapsed: 29.022571164s
Oct 13 16:54:57.717: INFO: Pod "pvc-volume-tester-writer-jkwj9": Phase="Pending", Reason="", readiness=false. Elapsed: 31.091072322s
Oct 13 16:54:59.783: INFO: Pod "pvc-volume-tester-writer-jkwj9": Phase="Pending", Reason="", readiness=false. Elapsed: 33.157514674s
Oct 13 16:55:01.849: INFO: Pod "pvc-volume-tester-writer-jkwj9": Phase="Succeeded", Reason="", readiness=false. Elapsed: 35.223894076s
STEP: Saw pod success
Oct 13 16:55:01.849: INFO: Pod "pvc-volume-tester-writer-jkwj9" satisfied condition "Succeeded or Failed"
Oct 13 16:55:01.988: INFO: Pod pvc-volume-tester-writer-jkwj9 has the following logs: 
Oct 13 16:55:01.988: INFO: Deleting pod "pvc-volume-tester-writer-jkwj9" in namespace "provisioning-3890"
Oct 13 16:55:02.067: INFO: Wait up to 5m0s for pod "pvc-volume-tester-writer-jkwj9" to be fully deleted
STEP: checking the created volume has the correct mount options, is readable and retains data on the same node "ip-172-20-37-205.us-west-2.compute.internal"
Oct 13 16:55:02.341: INFO: Waiting up to 15m0s for pod "pvc-volume-tester-reader-btq2x" in namespace "provisioning-3890" to be "Succeeded or Failed"
Oct 13 16:55:02.407: INFO: Pod "pvc-volume-tester-reader-btq2x": Phase="Pending", Reason="", readiness=false. Elapsed: 66.159046ms
Oct 13 16:55:04.473: INFO: Pod "pvc-volume-tester-reader-btq2x": Phase="Pending", Reason="", readiness=false. Elapsed: 2.132278647s
Oct 13 16:55:06.543: INFO: Pod "pvc-volume-tester-reader-btq2x": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.202282605s
STEP: Saw pod success
Oct 13 16:55:06.543: INFO: Pod "pvc-volume-tester-reader-btq2x" satisfied condition "Succeeded or Failed"
Oct 13 16:55:06.697: INFO: Pod pvc-volume-tester-reader-btq2x has the following logs: hello world

Oct 13 16:55:06.697: INFO: Deleting pod "pvc-volume-tester-reader-btq2x" in namespace "provisioning-3890"
Oct 13 16:55:06.771: INFO: Wait up to 5m0s for pod "pvc-volume-tester-reader-btq2x" to be fully deleted
Oct 13 16:55:06.840: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-7v7zn] to have phase Bound
Oct 13 16:55:06.906: INFO: PersistentVolumeClaim pvc-7v7zn found and phase=Bound (65.825413ms)
... skipping 77 lines ...
Oct 13 16:54:28.115: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-3462-e2e-schnsh6
STEP: creating a claim
Oct 13 16:54:28.179: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-dfxn
STEP: Creating a pod to test subpath
Oct 13 16:54:28.381: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-dfxn" in namespace "provisioning-3462" to be "Succeeded or Failed"
Oct 13 16:54:28.446: INFO: Pod "pod-subpath-test-dynamicpv-dfxn": Phase="Pending", Reason="", readiness=false. Elapsed: 64.492474ms
Oct 13 16:54:30.510: INFO: Pod "pod-subpath-test-dynamicpv-dfxn": Phase="Pending", Reason="", readiness=false. Elapsed: 2.129004127s
Oct 13 16:54:32.576: INFO: Pod "pod-subpath-test-dynamicpv-dfxn": Phase="Pending", Reason="", readiness=false. Elapsed: 4.194502269s
Oct 13 16:54:34.641: INFO: Pod "pod-subpath-test-dynamicpv-dfxn": Phase="Pending", Reason="", readiness=false. Elapsed: 6.259880312s
Oct 13 16:54:36.707: INFO: Pod "pod-subpath-test-dynamicpv-dfxn": Phase="Pending", Reason="", readiness=false. Elapsed: 8.325323031s
Oct 13 16:54:38.772: INFO: Pod "pod-subpath-test-dynamicpv-dfxn": Phase="Pending", Reason="", readiness=false. Elapsed: 10.390373537s
... skipping 10 lines ...
Oct 13 16:55:01.508: INFO: Pod "pod-subpath-test-dynamicpv-dfxn": Phase="Pending", Reason="", readiness=false. Elapsed: 33.126789102s
Oct 13 16:55:03.573: INFO: Pod "pod-subpath-test-dynamicpv-dfxn": Phase="Pending", Reason="", readiness=false. Elapsed: 35.192059485s
Oct 13 16:55:05.638: INFO: Pod "pod-subpath-test-dynamicpv-dfxn": Phase="Pending", Reason="", readiness=false. Elapsed: 37.256770411s
Oct 13 16:55:07.703: INFO: Pod "pod-subpath-test-dynamicpv-dfxn": Phase="Pending", Reason="", readiness=false. Elapsed: 39.321896686s
Oct 13 16:55:09.768: INFO: Pod "pod-subpath-test-dynamicpv-dfxn": Phase="Succeeded", Reason="", readiness=false. Elapsed: 41.38651641s
STEP: Saw pod success
Oct 13 16:55:09.768: INFO: Pod "pod-subpath-test-dynamicpv-dfxn" satisfied condition "Succeeded or Failed"
Oct 13 16:55:09.833: INFO: Trying to get logs from node ip-172-20-37-135.us-west-2.compute.internal pod pod-subpath-test-dynamicpv-dfxn container test-container-volume-dynamicpv-dfxn: <nil>
STEP: delete the pod
Oct 13 16:55:09.976: INFO: Waiting for pod pod-subpath-test-dynamicpv-dfxn to disappear
Oct 13 16:55:10.040: INFO: Pod pod-subpath-test-dynamicpv-dfxn no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-dfxn
Oct 13 16:55:10.040: INFO: Deleting pod "pod-subpath-test-dynamicpv-dfxn" in namespace "provisioning-3462"
... skipping 244 lines ...
Oct 13 16:55:23.201: INFO: Waiting for pod aws-client to disappear
Oct 13 16:55:23.266: INFO: Pod aws-client no longer exists
STEP: cleaning the environment after aws
STEP: Deleting pv and pvc
Oct 13 16:55:23.266: INFO: Deleting PersistentVolumeClaim "pvc-nxfdb"
Oct 13 16:55:23.336: INFO: Deleting PersistentVolume "aws-b8cnt"
Oct 13 16:55:23.584: INFO: Couldn't delete PD "aws://us-west-2a/vol-03e85b5927054cf30", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-03e85b5927054cf30 is currently attached to i-06b67b49ea933fa11
	status code: 400, request id: f056a8e8-67cb-4ec8-ae6e-7b41e9090d1d
Oct 13 16:55:29.028: INFO: Couldn't delete PD "aws://us-west-2a/vol-03e85b5927054cf30", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-03e85b5927054cf30 is currently attached to i-06b67b49ea933fa11
	status code: 400, request id: 630bc2c9-3352-4f1d-8853-691789a7e459
Oct 13 16:55:34.457: INFO: Successfully deleted PD "aws://us-west-2a/vol-03e85b5927054cf30".
[AfterEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 16:55:34.457: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-1160" for this suite.
... skipping 24 lines ...
Oct 13 16:55:01.777: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-55514ccjn
STEP: creating a claim
Oct 13 16:55:01.841: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-n8h7
STEP: Creating a pod to test subpath
Oct 13 16:55:02.043: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-n8h7" in namespace "provisioning-5551" to be "Succeeded or Failed"
Oct 13 16:55:02.110: INFO: Pod "pod-subpath-test-dynamicpv-n8h7": Phase="Pending", Reason="", readiness=false. Elapsed: 66.574185ms
Oct 13 16:55:04.174: INFO: Pod "pod-subpath-test-dynamicpv-n8h7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.130945158s
Oct 13 16:55:06.238: INFO: Pod "pod-subpath-test-dynamicpv-n8h7": Phase="Pending", Reason="", readiness=false. Elapsed: 4.194841096s
Oct 13 16:55:08.303: INFO: Pod "pod-subpath-test-dynamicpv-n8h7": Phase="Pending", Reason="", readiness=false. Elapsed: 6.259776537s
Oct 13 16:55:10.368: INFO: Pod "pod-subpath-test-dynamicpv-n8h7": Phase="Pending", Reason="", readiness=false. Elapsed: 8.324273992s
Oct 13 16:55:12.432: INFO: Pod "pod-subpath-test-dynamicpv-n8h7": Phase="Pending", Reason="", readiness=false. Elapsed: 10.388861638s
Oct 13 16:55:14.497: INFO: Pod "pod-subpath-test-dynamicpv-n8h7": Phase="Pending", Reason="", readiness=false. Elapsed: 12.453860719s
Oct 13 16:55:16.566: INFO: Pod "pod-subpath-test-dynamicpv-n8h7": Phase="Pending", Reason="", readiness=false. Elapsed: 14.522851525s
Oct 13 16:55:18.634: INFO: Pod "pod-subpath-test-dynamicpv-n8h7": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.590638182s
STEP: Saw pod success
Oct 13 16:55:18.634: INFO: Pod "pod-subpath-test-dynamicpv-n8h7" satisfied condition "Succeeded or Failed"
Oct 13 16:55:18.698: INFO: Trying to get logs from node ip-172-20-59-131.us-west-2.compute.internal pod pod-subpath-test-dynamicpv-n8h7 container test-container-volume-dynamicpv-n8h7: <nil>
STEP: delete the pod
Oct 13 16:55:18.839: INFO: Waiting for pod pod-subpath-test-dynamicpv-n8h7 to disappear
Oct 13 16:55:18.905: INFO: Pod pod-subpath-test-dynamicpv-n8h7 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-n8h7
Oct 13 16:55:18.905: INFO: Deleting pod "pod-subpath-test-dynamicpv-n8h7" in namespace "provisioning-5551"
... skipping 266 lines ...
Oct 13 16:54:15.443: INFO: In creating storage class object and pvc objects for driver - sc: &StorageClass{ObjectMeta:{provisioning-556j2llr      0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] []  []},Provisioner:kubernetes.io/aws-ebs,Parameters:map[string]string{},ReclaimPolicy:nil,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*WaitForFirstConsumer,AllowedTopologies:[]TopologySelectorTerm{},}, pvc: &PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-556    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] []  []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1073741824 0} {<nil>} 1Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-556j2llr,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},}, src-pvc: &PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-556    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] []  []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1073741824 0} {<nil>} 1Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-556j2llr,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},}
STEP: Creating a StorageClass
STEP: creating claim=&PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-556    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] []  []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1073741824 0} {<nil>} 1Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-556j2llr,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},}
STEP: creating a pod referring to the class=&StorageClass{ObjectMeta:{provisioning-556j2llr    358d3eac-9132-4eb7-bb8c-7298c3ab75b7 7308 0 2021-10-13 16:54:15 +0000 UTC <nil> <nil> map[] map[] [] []  [{e2e-kubernetes.test Update storage.k8s.io/v1 2021-10-13 16:54:15 +0000 UTC FieldsV1 {"f:mountOptions":{},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:kubernetes.io/aws-ebs,Parameters:map[string]string{},ReclaimPolicy:*Delete,MountOptions:[debug nouid32],AllowVolumeExpansion:nil,VolumeBindingMode:*WaitForFirstConsumer,AllowedTopologies:[]TopologySelectorTerm{},} claim=&PersistentVolumeClaim{ObjectMeta:{pvc-z9z78 pvc- provisioning-556  d4262397-1a1e-4c1a-a952-b57304835a77 7318 0 2021-10-13 16:54:15 +0000 UTC <nil> <nil> map[] map[] [] [kubernetes.io/pvc-protection]  [{e2e-kubernetes.test Update v1 2021-10-13 16:54:15 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:storageClassName":{},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1073741824 0} {<nil>} 1Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-556j2llr,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},}
STEP: Deleting pod pod-db664b19-2178-408b-93c8-231623e8a6d4 in namespace provisioning-556
STEP: checking the created volume is writable on node {Name: Selector:map[] Affinity:nil}
Oct 13 16:54:36.152: INFO: Waiting up to 15m0s for pod "pvc-volume-tester-writer-hdtxj" in namespace "provisioning-556" to be "Succeeded or Failed"
Oct 13 16:54:36.215: INFO: Pod "pvc-volume-tester-writer-hdtxj": Phase="Pending", Reason="", readiness=false. Elapsed: 62.940232ms
Oct 13 16:54:38.281: INFO: Pod "pvc-volume-tester-writer-hdtxj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.129122998s
Oct 13 16:54:40.348: INFO: Pod "pvc-volume-tester-writer-hdtxj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.196206249s
Oct 13 16:54:42.412: INFO: Pod "pvc-volume-tester-writer-hdtxj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.26017663s
Oct 13 16:54:44.478: INFO: Pod "pvc-volume-tester-writer-hdtxj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.326406083s
Oct 13 16:54:46.542: INFO: Pod "pvc-volume-tester-writer-hdtxj": Phase="Pending", Reason="", readiness=false. Elapsed: 10.390695756s
... skipping 7 lines ...
Oct 13 16:55:03.055: INFO: Pod "pvc-volume-tester-writer-hdtxj": Phase="Pending", Reason="", readiness=false. Elapsed: 26.903196171s
Oct 13 16:55:05.119: INFO: Pod "pvc-volume-tester-writer-hdtxj": Phase="Pending", Reason="", readiness=false. Elapsed: 28.966789107s
Oct 13 16:55:07.195: INFO: Pod "pvc-volume-tester-writer-hdtxj": Phase="Pending", Reason="", readiness=false. Elapsed: 31.042942893s
Oct 13 16:55:09.259: INFO: Pod "pvc-volume-tester-writer-hdtxj": Phase="Pending", Reason="", readiness=false. Elapsed: 33.10721807s
Oct 13 16:55:11.322: INFO: Pod "pvc-volume-tester-writer-hdtxj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 35.170578717s
STEP: Saw pod success
Oct 13 16:55:11.322: INFO: Pod "pvc-volume-tester-writer-hdtxj" satisfied condition "Succeeded or Failed"
Oct 13 16:55:11.453: INFO: Pod pvc-volume-tester-writer-hdtxj has the following logs: 
Oct 13 16:55:11.453: INFO: Deleting pod "pvc-volume-tester-writer-hdtxj" in namespace "provisioning-556"
Oct 13 16:55:11.528: INFO: Wait up to 5m0s for pod "pvc-volume-tester-writer-hdtxj" to be fully deleted
STEP: checking the created volume has the correct mount options, is readable and retains data on the same node "ip-172-20-37-205.us-west-2.compute.internal"
Oct 13 16:55:11.793: INFO: Waiting up to 15m0s for pod "pvc-volume-tester-reader-wbwsb" in namespace "provisioning-556" to be "Succeeded or Failed"
Oct 13 16:55:11.856: INFO: Pod "pvc-volume-tester-reader-wbwsb": Phase="Pending", Reason="", readiness=false. Elapsed: 63.392461ms
Oct 13 16:55:13.920: INFO: Pod "pvc-volume-tester-reader-wbwsb": Phase="Pending", Reason="", readiness=false. Elapsed: 2.126988281s
Oct 13 16:55:15.983: INFO: Pod "pvc-volume-tester-reader-wbwsb": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.190181606s
STEP: Saw pod success
Oct 13 16:55:15.983: INFO: Pod "pvc-volume-tester-reader-wbwsb" satisfied condition "Succeeded or Failed"
Oct 13 16:55:16.153: INFO: Pod pvc-volume-tester-reader-wbwsb has the following logs: hello world

Oct 13 16:55:16.153: INFO: Deleting pod "pvc-volume-tester-reader-wbwsb" in namespace "provisioning-556"
Oct 13 16:55:16.226: INFO: Wait up to 5m0s for pod "pvc-volume-tester-reader-wbwsb" to be fully deleted
Oct 13 16:55:16.289: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-z9z78] to have phase Bound
Oct 13 16:55:16.352: INFO: PersistentVolumeClaim pvc-z9z78 found and phase=Bound (63.085945ms)
... skipping 163 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath file is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256

      Distro debian doesn't support ntfs -- skipping

      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:127
------------------------------
... skipping 387 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to use a volume in a pod with mismatched mode [Slow] [BeforeEach]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296

    Driver "ebs.csi.aws.com" does not support volume type "PreprovisionedPV" - skipping

    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 15 lines ...
Oct 13 16:56:18.111: INFO: AfterEach: Cleaning up test resources


S [SKIPPING] in Spec Setup (BeforeEach) [0.444 seconds]
[sig-storage] PersistentVolumes:vsphere [Feature:vsphere]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  should test that deleting a PVC before the pod does not cause pod deletion to fail on vsphere volume detach [BeforeEach]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/vsphere/persistent_volumes-vsphere.go:148

  Only supported for providers [vsphere] (not aws)

  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/vsphere/persistent_volumes-vsphere.go:64
------------------------------
... skipping 2 lines ...
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:55:31.344: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename volumemode
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to use a volume in a pod with mismatched mode [Slow]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
Oct 13 16:55:31.670: INFO: Creating resource for dynamic PV
Oct 13 16:55:31.670: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass volumemode-3723-e2e-scnqhs4
STEP: creating a claim
STEP: Creating pod
STEP: Waiting for the pod to fail
Oct 13 16:55:38.128: INFO: Deleting pod "pod-9247f7f5-61e7-4de5-b199-8f4c1e257943" in namespace "volumemode-3723"
Oct 13 16:55:38.193: INFO: Wait up to 5m0s for pod "pod-9247f7f5-61e7-4de5-b199-8f4c1e257943" to be fully deleted
STEP: Deleting pvc
Oct 13 16:55:42.449: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.com8w5z2"
Oct 13 16:55:42.514: INFO: Waiting up to 5m0s for PersistentVolume pvc-52c1cf77-6a94-4115-b5fd-8922df41c7a4 to get deleted
Oct 13 16:55:42.578: INFO: PersistentVolume pvc-52c1cf77-6a94-4115-b5fd-8922df41c7a4 found and phase=Released (63.526274ms)
... skipping 13 lines ...

• [SLOW TEST:46.884 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to use a volume in a pod with mismatched mode [Slow]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
... skipping 227 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if non-existent subpath is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267

    Driver ebs.csi.aws.com doesn't support ntfs -- skipping

    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:121
------------------------------
... skipping 128 lines ...
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:55:42.193: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail if subpath directory is outside the volume [Slow][LinuxOnly]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240
Oct 13 16:55:42.510: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
Oct 13 16:55:42.510: INFO: Creating resource for dynamic PV
Oct 13 16:55:42.510: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-33842g8zw
STEP: creating a claim
Oct 13 16:55:42.574: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-84xd
STEP: Checking for subpath error in container status
Oct 13 16:56:06.892: INFO: Deleting pod "pod-subpath-test-dynamicpv-84xd" in namespace "provisioning-3384"
Oct 13 16:56:06.959: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-84xd" to be fully deleted
STEP: Deleting pod
Oct 13 16:56:09.085: INFO: Deleting pod "pod-subpath-test-dynamicpv-84xd" in namespace "provisioning-3384"
STEP: Deleting pvc
Oct 13 16:56:09.275: INFO: Deleting PersistentVolumeClaim "aws6k9qb"
... skipping 12 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (default fs)] subPath
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath directory is outside the volume [Slow][LinuxOnly]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240
------------------------------
[BeforeEach] [sig-storage] PersistentVolumes [Feature:vsphere][Feature:ReclaimPolicy]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:56:19.445: INFO: >>> kubeConfig: /root/.kube/config
... skipping 555 lines ...
Oct 13 16:55:35.478: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass volume-8312-e2e-sc24ng4
STEP: creating a claim
Oct 13 16:55:35.543: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod exec-volume-test-dynamicpv-4qtm
STEP: Creating a pod to test exec-volume-test
Oct 13 16:55:35.736: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-4qtm" in namespace "volume-8312" to be "Succeeded or Failed"
Oct 13 16:55:35.800: INFO: Pod "exec-volume-test-dynamicpv-4qtm": Phase="Pending", Reason="", readiness=false. Elapsed: 63.340678ms
Oct 13 16:55:37.865: INFO: Pod "exec-volume-test-dynamicpv-4qtm": Phase="Pending", Reason="", readiness=false. Elapsed: 2.128531332s
Oct 13 16:55:39.929: INFO: Pod "exec-volume-test-dynamicpv-4qtm": Phase="Pending", Reason="", readiness=false. Elapsed: 4.192380619s
Oct 13 16:55:41.992: INFO: Pod "exec-volume-test-dynamicpv-4qtm": Phase="Pending", Reason="", readiness=false. Elapsed: 6.256226056s
Oct 13 16:55:44.056: INFO: Pod "exec-volume-test-dynamicpv-4qtm": Phase="Pending", Reason="", readiness=false. Elapsed: 8.319954646s
Oct 13 16:55:46.131: INFO: Pod "exec-volume-test-dynamicpv-4qtm": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.394320877s
STEP: Saw pod success
Oct 13 16:55:46.131: INFO: Pod "exec-volume-test-dynamicpv-4qtm" satisfied condition "Succeeded or Failed"
Oct 13 16:55:46.194: INFO: Trying to get logs from node ip-172-20-37-135.us-west-2.compute.internal pod exec-volume-test-dynamicpv-4qtm container exec-container-dynamicpv-4qtm: <nil>
STEP: delete the pod
Oct 13 16:55:46.339: INFO: Waiting for pod exec-volume-test-dynamicpv-4qtm to disappear
Oct 13 16:55:46.402: INFO: Pod exec-volume-test-dynamicpv-4qtm no longer exists
STEP: Deleting pod exec-volume-test-dynamicpv-4qtm
Oct 13 16:55:46.402: INFO: Deleting pod "exec-volume-test-dynamicpv-4qtm" in namespace "volume-8312"
... skipping 121 lines ...
Oct 13 16:55:59.231: INFO: PersistentVolumeClaim pvc-qrk67 found but phase is Pending instead of Bound.
Oct 13 16:56:01.301: INFO: PersistentVolumeClaim pvc-qrk67 found and phase=Bound (14.548810528s)
Oct 13 16:56:01.301: INFO: Waiting up to 3m0s for PersistentVolume aws-s6z2v to have phase Bound
Oct 13 16:56:01.368: INFO: PersistentVolume aws-s6z2v found and phase=Bound (67.207007ms)
STEP: Creating pod exec-volume-test-preprovisionedpv-q4fg
STEP: Creating a pod to test exec-volume-test
Oct 13 16:56:01.585: INFO: Waiting up to 5m0s for pod "exec-volume-test-preprovisionedpv-q4fg" in namespace "volume-9986" to be "Succeeded or Failed"
Oct 13 16:56:01.656: INFO: Pod "exec-volume-test-preprovisionedpv-q4fg": Phase="Pending", Reason="", readiness=false. Elapsed: 70.636457ms
Oct 13 16:56:03.724: INFO: Pod "exec-volume-test-preprovisionedpv-q4fg": Phase="Pending", Reason="", readiness=false. Elapsed: 2.138863663s
Oct 13 16:56:05.793: INFO: Pod "exec-volume-test-preprovisionedpv-q4fg": Phase="Pending", Reason="", readiness=false. Elapsed: 4.207160933s
Oct 13 16:56:07.861: INFO: Pod "exec-volume-test-preprovisionedpv-q4fg": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.275827237s
STEP: Saw pod success
Oct 13 16:56:07.861: INFO: Pod "exec-volume-test-preprovisionedpv-q4fg" satisfied condition "Succeeded or Failed"
Oct 13 16:56:07.930: INFO: Trying to get logs from node ip-172-20-37-135.us-west-2.compute.internal pod exec-volume-test-preprovisionedpv-q4fg container exec-container-preprovisionedpv-q4fg: <nil>
STEP: delete the pod
Oct 13 16:56:08.078: INFO: Waiting for pod exec-volume-test-preprovisionedpv-q4fg to disappear
Oct 13 16:56:08.145: INFO: Pod exec-volume-test-preprovisionedpv-q4fg no longer exists
STEP: Deleting pod exec-volume-test-preprovisionedpv-q4fg
Oct 13 16:56:08.145: INFO: Deleting pod "exec-volume-test-preprovisionedpv-q4fg" in namespace "volume-9986"
STEP: Deleting pv and pvc
Oct 13 16:56:08.212: INFO: Deleting PersistentVolumeClaim "pvc-qrk67"
Oct 13 16:56:08.280: INFO: Deleting PersistentVolume "aws-s6z2v"
Oct 13 16:56:08.560: INFO: Couldn't delete PD "aws://us-west-2a/vol-0e977c104ecef6034", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0e977c104ecef6034 is currently attached to i-04097d75079331972
	status code: 400, request id: a7a1b9c8-2600-4c44-bfe3-aaa045c651d4
Oct 13 16:56:14.062: INFO: Couldn't delete PD "aws://us-west-2a/vol-0e977c104ecef6034", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0e977c104ecef6034 is currently attached to i-04097d75079331972
	status code: 400, request id: 46bec318-a819-4af3-97ff-9665d0725095
Oct 13 16:56:19.492: INFO: Couldn't delete PD "aws://us-west-2a/vol-0e977c104ecef6034", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0e977c104ecef6034 is currently attached to i-04097d75079331972
	status code: 400, request id: 1bf0cf55-8831-470a-b4a0-fa4474ab7253
Oct 13 16:56:24.919: INFO: Successfully deleted PD "aws://us-west-2a/vol-0e977c104ecef6034".
[AfterEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 16:56:24.919: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-9986" for this suite.
... skipping 301 lines ...
Oct 13 16:55:34.149: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-5176-e2e-schrml7
STEP: creating a claim
Oct 13 16:55:34.217: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-s8rn
STEP: Creating a pod to test multi_subpath
Oct 13 16:55:34.424: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-s8rn" in namespace "provisioning-5176" to be "Succeeded or Failed"
Oct 13 16:55:34.495: INFO: Pod "pod-subpath-test-dynamicpv-s8rn": Phase="Pending", Reason="", readiness=false. Elapsed: 70.440327ms
Oct 13 16:55:36.562: INFO: Pod "pod-subpath-test-dynamicpv-s8rn": Phase="Pending", Reason="", readiness=false. Elapsed: 2.137996236s
Oct 13 16:55:38.630: INFO: Pod "pod-subpath-test-dynamicpv-s8rn": Phase="Pending", Reason="", readiness=false. Elapsed: 4.205939246s
Oct 13 16:55:40.698: INFO: Pod "pod-subpath-test-dynamicpv-s8rn": Phase="Pending", Reason="", readiness=false. Elapsed: 6.27332279s
Oct 13 16:55:42.765: INFO: Pod "pod-subpath-test-dynamicpv-s8rn": Phase="Pending", Reason="", readiness=false. Elapsed: 8.340526978s
Oct 13 16:55:44.836: INFO: Pod "pod-subpath-test-dynamicpv-s8rn": Phase="Pending", Reason="", readiness=false. Elapsed: 10.412069081s
Oct 13 16:55:46.904: INFO: Pod "pod-subpath-test-dynamicpv-s8rn": Phase="Pending", Reason="", readiness=false. Elapsed: 12.479532237s
Oct 13 16:55:48.972: INFO: Pod "pod-subpath-test-dynamicpv-s8rn": Phase="Pending", Reason="", readiness=false. Elapsed: 14.547341811s
Oct 13 16:55:51.040: INFO: Pod "pod-subpath-test-dynamicpv-s8rn": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.615671542s
STEP: Saw pod success
Oct 13 16:55:51.040: INFO: Pod "pod-subpath-test-dynamicpv-s8rn" satisfied condition "Succeeded or Failed"
Oct 13 16:55:51.107: INFO: Trying to get logs from node ip-172-20-37-205.us-west-2.compute.internal pod pod-subpath-test-dynamicpv-s8rn container test-container-subpath-dynamicpv-s8rn: <nil>
STEP: delete the pod
Oct 13 16:55:51.249: INFO: Waiting for pod pod-subpath-test-dynamicpv-s8rn to disappear
Oct 13 16:55:51.315: INFO: Pod pod-subpath-test-dynamicpv-s8rn no longer exists
STEP: Deleting pod
Oct 13 16:55:51.316: INFO: Deleting pod "pod-subpath-test-dynamicpv-s8rn" in namespace "provisioning-5176"
... skipping 36 lines ...
Oct 13 16:55:56.631: INFO: Creating resource for dynamic PV
Oct 13 16:55:56.631: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(ebs.csi.aws.com) supported size:{ 1Gi} 
STEP: creating a StorageClass volume-expand-7856-e2e-scv8v58
STEP: creating a claim
STEP: Expanding non-expandable pvc
Oct 13 16:55:56.835: INFO: currentPvcSize {{1073741824 0} {<nil>} 1Gi BinarySI}, newSize {{2147483648 0} {<nil>}  BinarySI}
Oct 13 16:55:56.969: INFO: Error updating pvc ebs.csi.aws.comln5gz: PersistentVolumeClaim "ebs.csi.aws.comln5gz" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7856-e2e-scv8v58",
  	... // 3 identical fields
  }

Oct 13 16:55:59.104: INFO: Error updating pvc ebs.csi.aws.comln5gz: PersistentVolumeClaim "ebs.csi.aws.comln5gz" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7856-e2e-scv8v58",
  	... // 3 identical fields
  }

Oct 13 16:56:01.103: INFO: Error updating pvc ebs.csi.aws.comln5gz: PersistentVolumeClaim "ebs.csi.aws.comln5gz" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7856-e2e-scv8v58",
  	... // 3 identical fields
  }

Oct 13 16:56:03.103: INFO: Error updating pvc ebs.csi.aws.comln5gz: PersistentVolumeClaim "ebs.csi.aws.comln5gz" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7856-e2e-scv8v58",
  	... // 3 identical fields
  }

Oct 13 16:56:05.102: INFO: Error updating pvc ebs.csi.aws.comln5gz: PersistentVolumeClaim "ebs.csi.aws.comln5gz" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7856-e2e-scv8v58",
  	... // 3 identical fields
  }

Oct 13 16:56:07.104: INFO: Error updating pvc ebs.csi.aws.comln5gz: PersistentVolumeClaim "ebs.csi.aws.comln5gz" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7856-e2e-scv8v58",
  	... // 3 identical fields
  }

Oct 13 16:56:09.103: INFO: Error updating pvc ebs.csi.aws.comln5gz: PersistentVolumeClaim "ebs.csi.aws.comln5gz" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7856-e2e-scv8v58",
  	... // 3 identical fields
  }

Oct 13 16:56:11.102: INFO: Error updating pvc ebs.csi.aws.comln5gz: PersistentVolumeClaim "ebs.csi.aws.comln5gz" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7856-e2e-scv8v58",
  	... // 3 identical fields
  }

Oct 13 16:56:13.165: INFO: Error updating pvc ebs.csi.aws.comln5gz: PersistentVolumeClaim "ebs.csi.aws.comln5gz" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7856-e2e-scv8v58",
  	... // 3 identical fields
  }

Oct 13 16:56:15.104: INFO: Error updating pvc ebs.csi.aws.comln5gz: PersistentVolumeClaim "ebs.csi.aws.comln5gz" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7856-e2e-scv8v58",
  	... // 3 identical fields
  }

Oct 13 16:56:17.102: INFO: Error updating pvc ebs.csi.aws.comln5gz: PersistentVolumeClaim "ebs.csi.aws.comln5gz" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7856-e2e-scv8v58",
  	... // 3 identical fields
  }

Oct 13 16:56:19.105: INFO: Error updating pvc ebs.csi.aws.comln5gz: PersistentVolumeClaim "ebs.csi.aws.comln5gz" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7856-e2e-scv8v58",
  	... // 3 identical fields
  }

Oct 13 16:56:21.103: INFO: Error updating pvc ebs.csi.aws.comln5gz: PersistentVolumeClaim "ebs.csi.aws.comln5gz" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7856-e2e-scv8v58",
  	... // 3 identical fields
  }

Oct 13 16:56:23.103: INFO: Error updating pvc ebs.csi.aws.comln5gz: PersistentVolumeClaim "ebs.csi.aws.comln5gz" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7856-e2e-scv8v58",
  	... // 3 identical fields
  }

Oct 13 16:56:25.105: INFO: Error updating pvc ebs.csi.aws.comln5gz: PersistentVolumeClaim "ebs.csi.aws.comln5gz" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7856-e2e-scv8v58",
  	... // 3 identical fields
  }

Oct 13 16:56:27.116: INFO: Error updating pvc ebs.csi.aws.comln5gz: PersistentVolumeClaim "ebs.csi.aws.comln5gz" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7856-e2e-scv8v58",
  	... // 3 identical fields
  }

Oct 13 16:56:27.255: INFO: Error updating pvc ebs.csi.aws.comln5gz: PersistentVolumeClaim "ebs.csi.aws.comln5gz" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 36 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Inline-volume (default fs)] subPath
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if non-existent subpath is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267

      Driver supports dynamic provisioning, skipping InlineVolume pattern

      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:233
------------------------------
... skipping 4 lines ...
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:56:27.361: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename topology
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to schedule a pod which has topologies that conflict with AllowedTopologies
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192
Oct 13 16:56:27.783: INFO: found topology map[topology.ebs.csi.aws.com/zone:us-west-2a]
Oct 13 16:56:27.783: INFO: Not enough topologies in cluster -- skipping
STEP: Deleting pvc
STEP: Deleting sc
[AfterEach] [Testpattern: Dynamic PV (delayed binding)] topology
... skipping 4 lines ...

S [SKIPPING] [0.630 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (delayed binding)] topology
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to schedule a pod which has topologies that conflict with AllowedTopologies [It]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

    Not enough topologies in cluster -- skipping

    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:199
------------------------------
... skipping 804 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if non-existent subpath is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267

      Driver supports dynamic provisioning, skipping PreprovisionedPV pattern

      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:233
------------------------------
... skipping 394 lines ...
Oct 13 16:56:25.410: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass volume-3700-e2e-sc2qxl4
STEP: creating a claim
Oct 13 16:56:25.478: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod exec-volume-test-dynamicpv-ptqx
STEP: Creating a pod to test exec-volume-test
Oct 13 16:56:25.700: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-ptqx" in namespace "volume-3700" to be "Succeeded or Failed"
Oct 13 16:56:25.769: INFO: Pod "exec-volume-test-dynamicpv-ptqx": Phase="Pending", Reason="", readiness=false. Elapsed: 69.159518ms
Oct 13 16:56:27.842: INFO: Pod "exec-volume-test-dynamicpv-ptqx": Phase="Pending", Reason="", readiness=false. Elapsed: 2.14137363s
Oct 13 16:56:29.910: INFO: Pod "exec-volume-test-dynamicpv-ptqx": Phase="Pending", Reason="", readiness=false. Elapsed: 4.209943926s
Oct 13 16:56:31.979: INFO: Pod "exec-volume-test-dynamicpv-ptqx": Phase="Pending", Reason="", readiness=false. Elapsed: 6.278654631s
Oct 13 16:56:34.048: INFO: Pod "exec-volume-test-dynamicpv-ptqx": Phase="Pending", Reason="", readiness=false. Elapsed: 8.34771889s
Oct 13 16:56:36.116: INFO: Pod "exec-volume-test-dynamicpv-ptqx": Phase="Pending", Reason="", readiness=false. Elapsed: 10.416216084s
Oct 13 16:56:38.187: INFO: Pod "exec-volume-test-dynamicpv-ptqx": Phase="Pending", Reason="", readiness=false. Elapsed: 12.48640414s
Oct 13 16:56:40.254: INFO: Pod "exec-volume-test-dynamicpv-ptqx": Phase="Pending", Reason="", readiness=false. Elapsed: 14.553750848s
Oct 13 16:56:42.322: INFO: Pod "exec-volume-test-dynamicpv-ptqx": Phase="Succeeded", Reason="", readiness=false. Elapsed: 16.622017912s
STEP: Saw pod success
Oct 13 16:56:42.322: INFO: Pod "exec-volume-test-dynamicpv-ptqx" satisfied condition "Succeeded or Failed"
Oct 13 16:56:42.389: INFO: Trying to get logs from node ip-172-20-59-131.us-west-2.compute.internal pod exec-volume-test-dynamicpv-ptqx container exec-container-dynamicpv-ptqx: <nil>
STEP: delete the pod
Oct 13 16:56:42.571: INFO: Waiting for pod exec-volume-test-dynamicpv-ptqx to disappear
Oct 13 16:56:42.639: INFO: Pod exec-volume-test-dynamicpv-ptqx no longer exists
STEP: Deleting pod exec-volume-test-dynamicpv-ptqx
Oct 13 16:56:42.640: INFO: Deleting pod "exec-volume-test-dynamicpv-ptqx" in namespace "volume-3700"
... skipping 30 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Inline-volume (default fs)] subPath
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath file is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256

      Driver supports dynamic provisioning, skipping InlineVolume pattern

      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:233
------------------------------
... skipping 67 lines ...
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:56:20.200: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename volumemode
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to use a volume in a pod with mismatched mode [Slow]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
Oct 13 16:56:20.536: INFO: Creating resource for dynamic PV
Oct 13 16:56:20.536: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass volumemode-9306-e2e-sc6t4ql
STEP: creating a claim
STEP: Creating pod
STEP: Waiting for the pod to fail
Oct 13 16:56:27.015: INFO: Deleting pod "pod-d7e953f8-96c5-4bfb-9cd1-31cd49bc652e" in namespace "volumemode-9306"
Oct 13 16:56:27.083: INFO: Wait up to 5m0s for pod "pod-d7e953f8-96c5-4bfb-9cd1-31cd49bc652e" to be fully deleted
STEP: Deleting pvc
Oct 13 16:56:29.350: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comzdp87"
Oct 13 16:56:29.418: INFO: Waiting up to 5m0s for PersistentVolume pvc-4a4b47c1-6603-43c4-81fc-059da8f86769 to get deleted
Oct 13 16:56:29.485: INFO: PersistentVolume pvc-4a4b47c1-6603-43c4-81fc-059da8f86769 found and phase=Released (66.738861ms)
... skipping 13 lines ...

• [SLOW TEST:44.968 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (block volmode)] volumeMode
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to use a volume in a pod with mismatched mode [Slow]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
... skipping 7 lines ...
Oct 13 16:55:34.957: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-4994-e2e-sc2qsrc
STEP: creating a claim
Oct 13 16:55:35.022: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-hgm8
STEP: Creating a pod to test subpath
Oct 13 16:55:35.222: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-hgm8" in namespace "provisioning-4994" to be "Succeeded or Failed"
Oct 13 16:55:35.286: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 64.095871ms
Oct 13 16:55:37.351: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.129072127s
Oct 13 16:55:39.416: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.193498813s
Oct 13 16:55:41.488: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.265876885s
Oct 13 16:55:43.554: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.331414804s
Oct 13 16:55:45.618: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 10.395666503s
... skipping 3 lines ...
Oct 13 16:55:53.880: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 18.657204378s
Oct 13 16:55:55.944: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 20.721215371s
Oct 13 16:55:58.011: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 22.788282602s
Oct 13 16:56:00.081: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 24.858467684s
Oct 13 16:56:02.150: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 26.927327453s
STEP: Saw pod success
Oct 13 16:56:02.150: INFO: Pod "pod-subpath-test-dynamicpv-hgm8" satisfied condition "Succeeded or Failed"
Oct 13 16:56:02.214: INFO: Trying to get logs from node ip-172-20-39-49.us-west-2.compute.internal pod pod-subpath-test-dynamicpv-hgm8 container test-container-subpath-dynamicpv-hgm8: <nil>
STEP: delete the pod
Oct 13 16:56:02.366: INFO: Waiting for pod pod-subpath-test-dynamicpv-hgm8 to disappear
Oct 13 16:56:02.429: INFO: Pod pod-subpath-test-dynamicpv-hgm8 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-hgm8
Oct 13 16:56:02.429: INFO: Deleting pod "pod-subpath-test-dynamicpv-hgm8" in namespace "provisioning-4994"
STEP: Creating pod pod-subpath-test-dynamicpv-hgm8
STEP: Creating a pod to test subpath
Oct 13 16:56:02.558: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-hgm8" in namespace "provisioning-4994" to be "Succeeded or Failed"
Oct 13 16:56:02.622: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 64.032652ms
Oct 13 16:56:04.687: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.128461076s
Oct 13 16:56:06.753: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.19486596s
Oct 13 16:56:08.818: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.259497246s
Oct 13 16:56:10.884: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.326224086s
Oct 13 16:56:12.949: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 10.390539651s
... skipping 7 lines ...
Oct 13 16:56:29.481: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 26.923160377s
Oct 13 16:56:31.547: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 28.988832619s
Oct 13 16:56:33.617: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 31.058397609s
Oct 13 16:56:35.682: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Pending", Reason="", readiness=false. Elapsed: 33.123760785s
Oct 13 16:56:37.747: INFO: Pod "pod-subpath-test-dynamicpv-hgm8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 35.189118624s
STEP: Saw pod success
Oct 13 16:56:37.747: INFO: Pod "pod-subpath-test-dynamicpv-hgm8" satisfied condition "Succeeded or Failed"
Oct 13 16:56:37.812: INFO: Trying to get logs from node ip-172-20-37-205.us-west-2.compute.internal pod pod-subpath-test-dynamicpv-hgm8 container test-container-subpath-dynamicpv-hgm8: <nil>
STEP: delete the pod
Oct 13 16:56:37.950: INFO: Waiting for pod pod-subpath-test-dynamicpv-hgm8 to disappear
Oct 13 16:56:38.014: INFO: Pod pod-subpath-test-dynamicpv-hgm8 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-hgm8
Oct 13 16:56:38.014: INFO: Deleting pod "pod-subpath-test-dynamicpv-hgm8" in namespace "provisioning-4994"
... skipping 86 lines ...
Oct 13 16:56:48.461: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-3723wr69f
STEP: creating a claim
Oct 13 16:56:48.528: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-84g7
STEP: Creating a pod to test multi_subpath
Oct 13 16:56:48.740: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-84g7" in namespace "provisioning-3723" to be "Succeeded or Failed"
Oct 13 16:56:48.826: INFO: Pod "pod-subpath-test-dynamicpv-84g7": Phase="Pending", Reason="", readiness=false. Elapsed: 86.586716ms
Oct 13 16:56:50.895: INFO: Pod "pod-subpath-test-dynamicpv-84g7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.15521489s
Oct 13 16:56:52.964: INFO: Pod "pod-subpath-test-dynamicpv-84g7": Phase="Pending", Reason="", readiness=false. Elapsed: 4.22413071s
Oct 13 16:56:55.033: INFO: Pod "pod-subpath-test-dynamicpv-84g7": Phase="Pending", Reason="", readiness=false. Elapsed: 6.292905478s
Oct 13 16:56:57.102: INFO: Pod "pod-subpath-test-dynamicpv-84g7": Phase="Pending", Reason="", readiness=false. Elapsed: 8.36200518s
Oct 13 16:56:59.169: INFO: Pod "pod-subpath-test-dynamicpv-84g7": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.429142473s
STEP: Saw pod success
Oct 13 16:56:59.169: INFO: Pod "pod-subpath-test-dynamicpv-84g7" satisfied condition "Succeeded or Failed"
Oct 13 16:56:59.237: INFO: Trying to get logs from node ip-172-20-37-205.us-west-2.compute.internal pod pod-subpath-test-dynamicpv-84g7 container test-container-subpath-dynamicpv-84g7: <nil>
STEP: delete the pod
Oct 13 16:56:59.376: INFO: Waiting for pod pod-subpath-test-dynamicpv-84g7 to disappear
Oct 13 16:56:59.442: INFO: Pod pod-subpath-test-dynamicpv-84g7 no longer exists
STEP: Deleting pod
Oct 13 16:56:59.442: INFO: Deleting pod "pod-subpath-test-dynamicpv-84g7" in namespace "provisioning-3723"
... skipping 47 lines ...
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:56:27.996: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267
Oct 13 16:56:28.331: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
Oct 13 16:56:28.331: INFO: Creating resource for dynamic PV
Oct 13 16:56:28.331: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-3266lzd6
STEP: creating a claim
Oct 13 16:56:28.399: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-b6gk
STEP: Checking for subpath error in container status
Oct 13 16:56:52.739: INFO: Deleting pod "pod-subpath-test-dynamicpv-b6gk" in namespace "provisioning-326"
Oct 13 16:56:52.808: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-b6gk" to be fully deleted
STEP: Deleting pod
Oct 13 16:56:54.944: INFO: Deleting pod "pod-subpath-test-dynamicpv-b6gk" in namespace "provisioning-326"
STEP: Deleting pvc
Oct 13 16:56:55.144: INFO: Deleting PersistentVolumeClaim "awshr7r9"
... skipping 14 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (default fs)] subPath
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267
------------------------------
[BeforeEach] [sig-storage] Storage Policy Based Volume Provisioning [Feature:vsphere]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:57:15.765: INFO: >>> kubeConfig: /root/.kube/config
... skipping 54 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Inline-volume (default fs)] subPath
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath directory is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240

      Driver supports dynamic provisioning, skipping InlineVolume pattern

      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:233
------------------------------
... skipping 6 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Inline-volume (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath directory is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240

    Driver "ebs.csi.aws.com" does not support volume type "InlineVolume" - skipping

    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 106 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if non-existent subpath is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267

      Distro debian doesn't support ntfs -- skipping

      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:127
------------------------------
... skipping 13 lines ...
Oct 13 16:56:18.874: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass volume-2387-e2e-sczd798
STEP: creating a claim
Oct 13 16:56:18.937: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod exec-volume-test-dynamicpv-glkn
STEP: Creating a pod to test exec-volume-test
Oct 13 16:56:19.129: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-glkn" in namespace "volume-2387" to be "Succeeded or Failed"
Oct 13 16:56:19.191: INFO: Pod "exec-volume-test-dynamicpv-glkn": Phase="Pending", Reason="", readiness=false. Elapsed: 62.110752ms
Oct 13 16:56:21.253: INFO: Pod "exec-volume-test-dynamicpv-glkn": Phase="Pending", Reason="", readiness=false. Elapsed: 2.124834309s
Oct 13 16:56:23.318: INFO: Pod "exec-volume-test-dynamicpv-glkn": Phase="Pending", Reason="", readiness=false. Elapsed: 4.189242399s
Oct 13 16:56:25.382: INFO: Pod "exec-volume-test-dynamicpv-glkn": Phase="Pending", Reason="", readiness=false. Elapsed: 6.253653363s
Oct 13 16:56:27.459: INFO: Pod "exec-volume-test-dynamicpv-glkn": Phase="Pending", Reason="", readiness=false. Elapsed: 8.330674629s
Oct 13 16:56:29.524: INFO: Pod "exec-volume-test-dynamicpv-glkn": Phase="Pending", Reason="", readiness=false. Elapsed: 10.395705399s
... skipping 2 lines ...
Oct 13 16:56:35.718: INFO: Pod "exec-volume-test-dynamicpv-glkn": Phase="Pending", Reason="", readiness=false. Elapsed: 16.589732001s
Oct 13 16:56:37.788: INFO: Pod "exec-volume-test-dynamicpv-glkn": Phase="Pending", Reason="", readiness=false. Elapsed: 18.659434607s
Oct 13 16:56:39.852: INFO: Pod "exec-volume-test-dynamicpv-glkn": Phase="Pending", Reason="", readiness=false. Elapsed: 20.723364745s
Oct 13 16:56:41.915: INFO: Pod "exec-volume-test-dynamicpv-glkn": Phase="Pending", Reason="", readiness=false. Elapsed: 22.786058616s
Oct 13 16:56:43.982: INFO: Pod "exec-volume-test-dynamicpv-glkn": Phase="Succeeded", Reason="", readiness=false. Elapsed: 24.853656591s
STEP: Saw pod success
Oct 13 16:56:43.982: INFO: Pod "exec-volume-test-dynamicpv-glkn" satisfied condition "Succeeded or Failed"
Oct 13 16:56:44.045: INFO: Trying to get logs from node ip-172-20-37-135.us-west-2.compute.internal pod exec-volume-test-dynamicpv-glkn container exec-container-dynamicpv-glkn: <nil>
STEP: delete the pod
Oct 13 16:56:44.509: INFO: Waiting for pod exec-volume-test-dynamicpv-glkn to disappear
Oct 13 16:56:44.571: INFO: Pod exec-volume-test-dynamicpv-glkn no longer exists
STEP: Deleting pod exec-volume-test-dynamicpv-glkn
Oct 13 16:56:44.571: INFO: Deleting pod "exec-volume-test-dynamicpv-glkn" in namespace "volume-2387"
... skipping 28 lines ...
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:56:29.092: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail if subpath file is outside the volume [Slow][LinuxOnly]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256
Oct 13 16:56:29.422: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
Oct 13 16:56:29.422: INFO: Creating resource for dynamic PV
Oct 13 16:56:29.423: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-4153l8qx7
STEP: creating a claim
Oct 13 16:56:29.489: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-f74p
STEP: Checking for subpath error in container status
Oct 13 16:56:53.826: INFO: Deleting pod "pod-subpath-test-dynamicpv-f74p" in namespace "provisioning-4153"
Oct 13 16:56:53.893: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-f74p" to be fully deleted
STEP: Deleting pod
Oct 13 16:56:56.027: INFO: Deleting pod "pod-subpath-test-dynamicpv-f74p" in namespace "provisioning-4153"
STEP: Deleting pvc
Oct 13 16:56:56.225: INFO: Deleting PersistentVolumeClaim "awsw5g47"
... skipping 15 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (default fs)] subPath
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath file is outside the volume [Slow][LinuxOnly]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
... skipping 165 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278

      Driver supports dynamic provisioning, skipping PreprovisionedPV pattern

      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:233
------------------------------
... skipping 339 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Inline-volume (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if non-existent subpath is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267

    Driver "ebs.csi.aws.com" does not support volume type "InlineVolume" - skipping

    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 11 lines ...
Oct 13 16:56:58.731: INFO: Creating resource for dynamic PV
Oct 13 16:56:58.731: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(aws) supported size:{ 1Gi} 
STEP: creating a StorageClass volume-expand-3574schn2
STEP: creating a claim
STEP: Expanding non-expandable pvc
Oct 13 16:56:58.938: INFO: currentPvcSize {{1073741824 0} {<nil>} 1Gi BinarySI}, newSize {{2147483648 0} {<nil>}  BinarySI}
Oct 13 16:56:59.081: INFO: Error updating pvc awsprrht: PersistentVolumeClaim "awsprrht" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-3574schn2",
  	... // 3 identical fields
  }

Oct 13 16:57:01.229: INFO: Error updating pvc awsprrht: PersistentVolumeClaim "awsprrht" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-3574schn2",
  	... // 3 identical fields
  }

Oct 13 16:57:03.222: INFO: Error updating pvc awsprrht: PersistentVolumeClaim "awsprrht" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-3574schn2",
  	... // 3 identical fields
  }

Oct 13 16:57:05.222: INFO: Error updating pvc awsprrht: PersistentVolumeClaim "awsprrht" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-3574schn2",
  	... // 3 identical fields
  }

Oct 13 16:57:07.222: INFO: Error updating pvc awsprrht: PersistentVolumeClaim "awsprrht" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-3574schn2",
  	... // 3 identical fields
  }

Oct 13 16:57:09.220: INFO: Error updating pvc awsprrht: PersistentVolumeClaim "awsprrht" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-3574schn2",
  	... // 3 identical fields
  }

Oct 13 16:57:11.222: INFO: Error updating pvc awsprrht: PersistentVolumeClaim "awsprrht" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-3574schn2",
  	... // 3 identical fields
  }

Oct 13 16:57:13.218: INFO: Error updating pvc awsprrht: PersistentVolumeClaim "awsprrht" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-3574schn2",
  	... // 3 identical fields
  }

Oct 13 16:57:15.222: INFO: Error updating pvc awsprrht: PersistentVolumeClaim "awsprrht" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-3574schn2",
  	... // 3 identical fields
  }

Oct 13 16:57:17.220: INFO: Error updating pvc awsprrht: PersistentVolumeClaim "awsprrht" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-3574schn2",
  	... // 3 identical fields
  }

Oct 13 16:57:19.221: INFO: Error updating pvc awsprrht: PersistentVolumeClaim "awsprrht" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-3574schn2",
  	... // 3 identical fields
  }

Oct 13 16:57:21.219: INFO: Error updating pvc awsprrht: PersistentVolumeClaim "awsprrht" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-3574schn2",
  	... // 3 identical fields
  }

Oct 13 16:57:23.225: INFO: Error updating pvc awsprrht: PersistentVolumeClaim "awsprrht" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-3574schn2",
  	... // 3 identical fields
  }

Oct 13 16:57:25.219: INFO: Error updating pvc awsprrht: PersistentVolumeClaim "awsprrht" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-3574schn2",
  	... // 3 identical fields
  }

Oct 13 16:57:27.223: INFO: Error updating pvc awsprrht: PersistentVolumeClaim "awsprrht" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-3574schn2",
  	... // 3 identical fields
  }

Oct 13 16:57:29.226: INFO: Error updating pvc awsprrht: PersistentVolumeClaim "awsprrht" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-3574schn2",
  	... // 3 identical fields
  }

Oct 13 16:57:29.361: INFO: Error updating pvc awsprrht: PersistentVolumeClaim "awsprrht" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 147 lines ...
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:57:15.181: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename volumemode
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to use a volume in a pod with mismatched mode [Slow]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
Oct 13 16:57:15.511: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
Oct 13 16:57:15.512: INFO: Creating resource for dynamic PV
Oct 13 16:57:15.512: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass volumemode-34919xhwf
STEP: creating a claim
STEP: Creating pod
STEP: Waiting for the pod to fail
Oct 13 16:57:19.982: INFO: Deleting pod "pod-0315fa2b-1a0e-4ba3-8f3e-da89e04f9211" in namespace "volumemode-3491"
Oct 13 16:57:20.050: INFO: Wait up to 5m0s for pod "pod-0315fa2b-1a0e-4ba3-8f3e-da89e04f9211" to be fully deleted
STEP: Deleting pvc
Oct 13 16:57:22.332: INFO: Deleting PersistentVolumeClaim "awsz5d2j"
Oct 13 16:57:22.403: INFO: Waiting up to 5m0s for PersistentVolume pvc-6735012c-daf3-46c9-83b6-cd33df5b4331 to get deleted
Oct 13 16:57:22.470: INFO: PersistentVolume pvc-6735012c-daf3-46c9-83b6-cd33df5b4331 found and phase=Released (66.363756ms)
... skipping 11 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (block volmode)] volumeMode
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to use a volume in a pod with mismatched mode [Slow]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 16:57:37.886: INFO: Driver "ebs.csi.aws.com" does not support volume type "PreprovisionedPV" - skipping
[AfterEach] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes
... skipping 17 lines ...
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:56:55.737: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename volumemode
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to use a volume in a pod with mismatched mode [Slow]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
Oct 13 16:56:56.065: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
STEP: creating a test aws volume
Oct 13 16:56:56.650: INFO: Successfully created a new PD: "aws://us-west-2a/vol-0811b21b63f04c244".
Oct 13 16:56:56.651: INFO: Creating resource for pre-provisioned PV
Oct 13 16:56:56.651: INFO: Creating PVC and PV
... skipping 4 lines ...
Oct 13 16:56:58.919: INFO: PersistentVolumeClaim pvc-jhfx6 found but phase is Pending instead of Bound.
Oct 13 16:57:00.993: INFO: PersistentVolumeClaim pvc-jhfx6 found but phase is Pending instead of Bound.
Oct 13 16:57:03.059: INFO: PersistentVolumeClaim pvc-jhfx6 found and phase=Bound (6.272413537s)
Oct 13 16:57:03.059: INFO: Waiting up to 3m0s for PersistentVolume aws-7qq7j to have phase Bound
Oct 13 16:57:03.126: INFO: PersistentVolume aws-7qq7j found and phase=Bound (66.769533ms)
STEP: Creating pod
STEP: Waiting for the pod to fail
Oct 13 16:57:05.522: INFO: Deleting pod "pod-0a8bf6d7-5826-4e61-94fb-7ff0677b3254" in namespace "volumemode-4319"
Oct 13 16:57:05.589: INFO: Wait up to 5m0s for pod "pod-0a8bf6d7-5826-4e61-94fb-7ff0677b3254" to be fully deleted
STEP: Deleting pv and pvc
Oct 13 16:57:07.720: INFO: Deleting PersistentVolumeClaim "pvc-jhfx6"
Oct 13 16:57:07.786: INFO: Deleting PersistentVolume "aws-7qq7j"
Oct 13 16:57:08.058: INFO: Couldn't delete PD "aws://us-west-2a/vol-0811b21b63f04c244", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0811b21b63f04c244 is currently attached to i-0f7953e39ddb3373a
	status code: 400, request id: f8dce25d-649d-4afb-8d84-ae4b7f2bdeec
Oct 13 16:57:13.497: INFO: Couldn't delete PD "aws://us-west-2a/vol-0811b21b63f04c244", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0811b21b63f04c244 is currently attached to i-0f7953e39ddb3373a
	status code: 400, request id: 3c59b489-7b99-4da4-8e9d-118cf268e62e
Oct 13 16:57:18.914: INFO: Couldn't delete PD "aws://us-west-2a/vol-0811b21b63f04c244", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0811b21b63f04c244 is currently attached to i-0f7953e39ddb3373a
	status code: 400, request id: e34bcc86-450d-478f-a366-eee3af97aa7e
Oct 13 16:57:24.650: INFO: Couldn't delete PD "aws://us-west-2a/vol-0811b21b63f04c244", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0811b21b63f04c244 is currently attached to i-0f7953e39ddb3373a
	status code: 400, request id: f8765cab-229c-4ea4-9071-459b8d337ae8
Oct 13 16:57:30.028: INFO: Couldn't delete PD "aws://us-west-2a/vol-0811b21b63f04c244", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0811b21b63f04c244 is currently attached to i-0f7953e39ddb3373a
	status code: 400, request id: 65556326-8d93-4b05-aab9-28c216c34f27
Oct 13 16:57:35.441: INFO: Couldn't delete PD "aws://us-west-2a/vol-0811b21b63f04c244", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0811b21b63f04c244 is currently attached to i-0f7953e39ddb3373a
	status code: 400, request id: fbc66cdd-13a7-48aa-b4f9-e0cc6f32dff1
Oct 13 16:57:40.868: INFO: Successfully deleted PD "aws://us-west-2a/vol-0811b21b63f04c244".
[AfterEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 16:57:40.868: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volumemode-4319" for this suite.
... skipping 3 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to use a volume in a pod with mismatched mode [Slow]
      /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
... skipping 151 lines ...
Oct 13 16:57:03.998: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
STEP: creating a test aws volume
Oct 13 16:57:04.568: INFO: Successfully created a new PD: "aws://us-west-2a/vol-07cdb27359c5d654d".
Oct 13 16:57:04.568: INFO: Creating resource for inline volume
STEP: Creating pod exec-volume-test-inlinevolume-4qb6
STEP: Creating a pod to test exec-volume-test
Oct 13 16:57:04.635: INFO: Waiting up to 5m0s for pod "exec-volume-test-inlinevolume-4qb6" in namespace "volume-4936" to be "Succeeded or Failed"
Oct 13 16:57:04.701: INFO: Pod "exec-volume-test-inlinevolume-4qb6": Phase="Pending", Reason="", readiness=false. Elapsed: 65.317479ms
Oct 13 16:57:06.767: INFO: Pod "exec-volume-test-inlinevolume-4qb6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.131216218s
Oct 13 16:57:08.833: INFO: Pod "exec-volume-test-inlinevolume-4qb6": Phase="Pending", Reason="", readiness=false. Elapsed: 4.197394047s
Oct 13 16:57:10.900: INFO: Pod "exec-volume-test-inlinevolume-4qb6": Phase="Pending", Reason="", readiness=false. Elapsed: 6.264185051s
Oct 13 16:57:12.966: INFO: Pod "exec-volume-test-inlinevolume-4qb6": Phase="Pending", Reason="", readiness=false. Elapsed: 8.330292438s
Oct 13 16:57:15.033: INFO: Pod "exec-volume-test-inlinevolume-4qb6": Phase="Pending", Reason="", readiness=false. Elapsed: 10.397844487s
Oct 13 16:57:17.100: INFO: Pod "exec-volume-test-inlinevolume-4qb6": Phase="Pending", Reason="", readiness=false. Elapsed: 12.464553782s
Oct 13 16:57:19.166: INFO: Pod "exec-volume-test-inlinevolume-4qb6": Phase="Pending", Reason="", readiness=false. Elapsed: 14.530291713s
Oct 13 16:57:21.232: INFO: Pod "exec-volume-test-inlinevolume-4qb6": Phase="Pending", Reason="", readiness=false. Elapsed: 16.596078586s
Oct 13 16:57:23.301: INFO: Pod "exec-volume-test-inlinevolume-4qb6": Phase="Succeeded", Reason="", readiness=false. Elapsed: 18.665961257s
STEP: Saw pod success
Oct 13 16:57:23.301: INFO: Pod "exec-volume-test-inlinevolume-4qb6" satisfied condition "Succeeded or Failed"
Oct 13 16:57:23.367: INFO: Trying to get logs from node ip-172-20-59-131.us-west-2.compute.internal pod exec-volume-test-inlinevolume-4qb6 container exec-container-inlinevolume-4qb6: <nil>
STEP: delete the pod
Oct 13 16:57:23.508: INFO: Waiting for pod exec-volume-test-inlinevolume-4qb6 to disappear
Oct 13 16:57:23.573: INFO: Pod exec-volume-test-inlinevolume-4qb6 no longer exists
STEP: Deleting pod exec-volume-test-inlinevolume-4qb6
Oct 13 16:57:23.574: INFO: Deleting pod "exec-volume-test-inlinevolume-4qb6" in namespace "volume-4936"
Oct 13 16:57:23.829: INFO: Couldn't delete PD "aws://us-west-2a/vol-07cdb27359c5d654d", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-07cdb27359c5d654d is currently attached to i-0c48bf1c12bdb40d4
	status code: 400, request id: 61e7bd6f-8c23-49f1-8b36-8cef77dabefc
Oct 13 16:57:29.247: INFO: Couldn't delete PD "aws://us-west-2a/vol-07cdb27359c5d654d", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-07cdb27359c5d654d is currently attached to i-0c48bf1c12bdb40d4
	status code: 400, request id: 221dec1d-f0f1-46ea-a086-08ef8a55c9b7
Oct 13 16:57:34.675: INFO: Couldn't delete PD "aws://us-west-2a/vol-07cdb27359c5d654d", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-07cdb27359c5d654d is currently attached to i-0c48bf1c12bdb40d4
	status code: 400, request id: 75895d7e-3a90-49bc-b405-60c66af61612
Oct 13 16:57:40.074: INFO: Couldn't delete PD "aws://us-west-2a/vol-07cdb27359c5d654d", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-07cdb27359c5d654d is currently attached to i-0c48bf1c12bdb40d4
	status code: 400, request id: ea65d542-7507-4696-8286-365e07f50a2a
Oct 13 16:57:45.488: INFO: Couldn't delete PD "aws://us-west-2a/vol-07cdb27359c5d654d", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-07cdb27359c5d654d is currently attached to i-0c48bf1c12bdb40d4
	status code: 400, request id: b4c6daca-9382-4b9b-97c9-af6f32dfe79a
Oct 13 16:57:50.902: INFO: Successfully deleted PD "aws://us-west-2a/vol-07cdb27359c5d654d".
[AfterEach] [Testpattern: Inline-volume (xfs)][Slow] volumes
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 16:57:50.902: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-4936" for this suite.
... skipping 199 lines ...
Oct 13 16:57:57.720: INFO: Waiting for pod aws-client to disappear
Oct 13 16:57:57.787: INFO: Pod aws-client no longer exists
STEP: cleaning the environment after aws
STEP: Deleting pv and pvc
Oct 13 16:57:57.787: INFO: Deleting PersistentVolumeClaim "pvc-5v7sc"
Oct 13 16:57:57.857: INFO: Deleting PersistentVolume "aws-brztc"
Oct 13 16:57:58.305: INFO: Couldn't delete PD "aws://us-west-2a/vol-03b17d6b0f9d914cf", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-03b17d6b0f9d914cf is currently attached to i-0f7953e39ddb3373a
	status code: 400, request id: a3024b23-c445-4deb-afba-45bcdcc337e8
Oct 13 16:58:03.705: INFO: Couldn't delete PD "aws://us-west-2a/vol-03b17d6b0f9d914cf", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-03b17d6b0f9d914cf is currently attached to i-0f7953e39ddb3373a
	status code: 400, request id: 3bbc3288-e409-42af-95e4-f1380a5352ee
Oct 13 16:58:09.145: INFO: Successfully deleted PD "aws://us-west-2a/vol-03b17d6b0f9d914cf".
[AfterEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 16:58:09.145: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-1384" for this suite.
... skipping 111 lines ...
Oct 13 16:57:57.480: INFO: Pod aws-client still exists
Oct 13 16:57:59.481: INFO: Waiting for pod aws-client to disappear
Oct 13 16:57:59.545: INFO: Pod aws-client still exists
Oct 13 16:58:01.480: INFO: Waiting for pod aws-client to disappear
Oct 13 16:58:01.548: INFO: Pod aws-client no longer exists
STEP: cleaning the environment after aws
Oct 13 16:58:01.759: INFO: Couldn't delete PD "aws://us-west-2a/vol-03b1731d73b04a0f6", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-03b1731d73b04a0f6 is currently attached to i-06b67b49ea933fa11
	status code: 400, request id: 4aa5d3cd-e01a-4d73-86e9-dca0e394a4cd
Oct 13 16:58:07.156: INFO: Couldn't delete PD "aws://us-west-2a/vol-03b1731d73b04a0f6", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-03b1731d73b04a0f6 is currently attached to i-06b67b49ea933fa11
	status code: 400, request id: 8672e612-e5e1-441c-ac9f-ab6598b3203a
Oct 13 16:58:12.624: INFO: Successfully deleted PD "aws://us-west-2a/vol-03b1731d73b04a0f6".
[AfterEach] [Testpattern: Inline-volume (ext4)] volumes
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 16:58:12.624: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-6861" for this suite.
... skipping 93 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Pre-provisioned PV (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath file is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256

    Driver "ebs.csi.aws.com" does not support volume type "PreprovisionedPV" - skipping

    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 14 lines ...
Oct 13 16:57:22.468: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-77179rk9n
STEP: creating a claim
Oct 13 16:57:22.534: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-xztm
STEP: Creating a pod to test subpath
Oct 13 16:57:22.727: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-xztm" in namespace "provisioning-7717" to be "Succeeded or Failed"
Oct 13 16:57:22.793: INFO: Pod "pod-subpath-test-dynamicpv-xztm": Phase="Pending", Reason="", readiness=false. Elapsed: 66.352067ms
Oct 13 16:57:24.857: INFO: Pod "pod-subpath-test-dynamicpv-xztm": Phase="Pending", Reason="", readiness=false. Elapsed: 2.130077723s
Oct 13 16:57:26.925: INFO: Pod "pod-subpath-test-dynamicpv-xztm": Phase="Pending", Reason="", readiness=false. Elapsed: 4.197806152s
Oct 13 16:57:28.990: INFO: Pod "pod-subpath-test-dynamicpv-xztm": Phase="Pending", Reason="", readiness=false. Elapsed: 6.263289953s
Oct 13 16:57:31.055: INFO: Pod "pod-subpath-test-dynamicpv-xztm": Phase="Pending", Reason="", readiness=false. Elapsed: 8.327938514s
Oct 13 16:57:33.119: INFO: Pod "pod-subpath-test-dynamicpv-xztm": Phase="Pending", Reason="", readiness=false. Elapsed: 10.392366657s
... skipping 2 lines ...
Oct 13 16:57:39.314: INFO: Pod "pod-subpath-test-dynamicpv-xztm": Phase="Pending", Reason="", readiness=false. Elapsed: 16.587299365s
Oct 13 16:57:41.378: INFO: Pod "pod-subpath-test-dynamicpv-xztm": Phase="Pending", Reason="", readiness=false. Elapsed: 18.650645822s
Oct 13 16:57:43.441: INFO: Pod "pod-subpath-test-dynamicpv-xztm": Phase="Pending", Reason="", readiness=false. Elapsed: 20.71423913s
Oct 13 16:57:45.506: INFO: Pod "pod-subpath-test-dynamicpv-xztm": Phase="Pending", Reason="", readiness=false. Elapsed: 22.779400809s
Oct 13 16:57:47.573: INFO: Pod "pod-subpath-test-dynamicpv-xztm": Phase="Succeeded", Reason="", readiness=false. Elapsed: 24.846428171s
STEP: Saw pod success
Oct 13 16:57:47.573: INFO: Pod "pod-subpath-test-dynamicpv-xztm" satisfied condition "Succeeded or Failed"
Oct 13 16:57:47.637: INFO: Trying to get logs from node ip-172-20-59-131.us-west-2.compute.internal pod pod-subpath-test-dynamicpv-xztm container test-container-subpath-dynamicpv-xztm: <nil>
STEP: delete the pod
Oct 13 16:57:47.775: INFO: Waiting for pod pod-subpath-test-dynamicpv-xztm to disappear
Oct 13 16:57:47.839: INFO: Pod pod-subpath-test-dynamicpv-xztm no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-xztm
Oct 13 16:57:47.839: INFO: Deleting pod "pod-subpath-test-dynamicpv-xztm" in namespace "provisioning-7717"
STEP: Creating pod pod-subpath-test-dynamicpv-xztm
STEP: Creating a pod to test subpath
Oct 13 16:57:47.972: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-xztm" in namespace "provisioning-7717" to be "Succeeded or Failed"
Oct 13 16:57:48.035: INFO: Pod "pod-subpath-test-dynamicpv-xztm": Phase="Pending", Reason="", readiness=false. Elapsed: 63.414188ms
Oct 13 16:57:50.100: INFO: Pod "pod-subpath-test-dynamicpv-xztm": Phase="Pending", Reason="", readiness=false. Elapsed: 2.127886538s
Oct 13 16:57:52.164: INFO: Pod "pod-subpath-test-dynamicpv-xztm": Phase="Pending", Reason="", readiness=false. Elapsed: 4.192133024s
Oct 13 16:57:54.228: INFO: Pod "pod-subpath-test-dynamicpv-xztm": Phase="Pending", Reason="", readiness=false. Elapsed: 6.255895787s
Oct 13 16:57:56.295: INFO: Pod "pod-subpath-test-dynamicpv-xztm": Phase="Pending", Reason="", readiness=false. Elapsed: 8.323616816s
Oct 13 16:57:58.360: INFO: Pod "pod-subpath-test-dynamicpv-xztm": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.388231s
STEP: Saw pod success
Oct 13 16:57:58.360: INFO: Pod "pod-subpath-test-dynamicpv-xztm" satisfied condition "Succeeded or Failed"
Oct 13 16:57:58.424: INFO: Trying to get logs from node ip-172-20-59-131.us-west-2.compute.internal pod pod-subpath-test-dynamicpv-xztm container test-container-subpath-dynamicpv-xztm: <nil>
STEP: delete the pod
Oct 13 16:57:58.568: INFO: Waiting for pod pod-subpath-test-dynamicpv-xztm to disappear
Oct 13 16:57:58.631: INFO: Pod pod-subpath-test-dynamicpv-xztm no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-xztm
Oct 13 16:57:58.631: INFO: Deleting pod "pod-subpath-test-dynamicpv-xztm" in namespace "provisioning-7717"
... skipping 51 lines ...
Oct 13 16:57:44.107: INFO: PersistentVolumeClaim pvc-5x8mh found but phase is Pending instead of Bound.
Oct 13 16:57:46.176: INFO: PersistentVolumeClaim pvc-5x8mh found and phase=Bound (14.529505414s)
Oct 13 16:57:46.176: INFO: Waiting up to 3m0s for PersistentVolume aws-7wgjk to have phase Bound
Oct 13 16:57:46.251: INFO: PersistentVolume aws-7wgjk found and phase=Bound (75.129549ms)
STEP: Creating pod exec-volume-test-preprovisionedpv-4kj5
STEP: Creating a pod to test exec-volume-test
Oct 13 16:57:46.450: INFO: Waiting up to 5m0s for pod "exec-volume-test-preprovisionedpv-4kj5" in namespace "volume-3018" to be "Succeeded or Failed"
Oct 13 16:57:46.515: INFO: Pod "exec-volume-test-preprovisionedpv-4kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 65.332754ms
Oct 13 16:57:48.581: INFO: Pod "exec-volume-test-preprovisionedpv-4kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.13109561s
Oct 13 16:57:50.648: INFO: Pod "exec-volume-test-preprovisionedpv-4kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.198297502s
Oct 13 16:57:52.714: INFO: Pod "exec-volume-test-preprovisionedpv-4kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.264858952s
Oct 13 16:57:54.780: INFO: Pod "exec-volume-test-preprovisionedpv-4kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 8.330615164s
Oct 13 16:57:56.846: INFO: Pod "exec-volume-test-preprovisionedpv-4kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 10.396630777s
Oct 13 16:57:58.912: INFO: Pod "exec-volume-test-preprovisionedpv-4kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 12.462608351s
Oct 13 16:58:00.979: INFO: Pod "exec-volume-test-preprovisionedpv-4kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 14.529014276s
Oct 13 16:58:03.046: INFO: Pod "exec-volume-test-preprovisionedpv-4kj5": Phase="Pending", Reason="", readiness=false. Elapsed: 16.596662971s
Oct 13 16:58:05.114: INFO: Pod "exec-volume-test-preprovisionedpv-4kj5": Phase="Running", Reason="", readiness=true. Elapsed: 18.664236759s
Oct 13 16:58:07.182: INFO: Pod "exec-volume-test-preprovisionedpv-4kj5": Phase="Succeeded", Reason="", readiness=false. Elapsed: 20.7328348s
STEP: Saw pod success
Oct 13 16:58:07.183: INFO: Pod "exec-volume-test-preprovisionedpv-4kj5" satisfied condition "Succeeded or Failed"
Oct 13 16:58:07.248: INFO: Trying to get logs from node ip-172-20-59-131.us-west-2.compute.internal pod exec-volume-test-preprovisionedpv-4kj5 container exec-container-preprovisionedpv-4kj5: <nil>
STEP: delete the pod
Oct 13 16:58:07.385: INFO: Waiting for pod exec-volume-test-preprovisionedpv-4kj5 to disappear
Oct 13 16:58:07.450: INFO: Pod exec-volume-test-preprovisionedpv-4kj5 no longer exists
STEP: Deleting pod exec-volume-test-preprovisionedpv-4kj5
Oct 13 16:58:07.450: INFO: Deleting pod "exec-volume-test-preprovisionedpv-4kj5" in namespace "volume-3018"
STEP: Deleting pv and pvc
Oct 13 16:58:07.515: INFO: Deleting PersistentVolumeClaim "pvc-5x8mh"
Oct 13 16:58:07.582: INFO: Deleting PersistentVolume "aws-7wgjk"
Oct 13 16:58:07.898: INFO: Couldn't delete PD "aws://us-west-2a/vol-0765da6d604ddd137", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0765da6d604ddd137 is currently attached to i-0c48bf1c12bdb40d4
	status code: 400, request id: 3434c093-44a4-4955-bc00-3fa149a09d90
Oct 13 16:58:13.306: INFO: Couldn't delete PD "aws://us-west-2a/vol-0765da6d604ddd137", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0765da6d604ddd137 is currently attached to i-0c48bf1c12bdb40d4
	status code: 400, request id: 46b805bf-59bf-4445-ae14-852798aab350
Oct 13 16:58:18.745: INFO: Couldn't delete PD "aws://us-west-2a/vol-0765da6d604ddd137", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0765da6d604ddd137 is currently attached to i-0c48bf1c12bdb40d4
	status code: 400, request id: 15dd308e-7b5d-437a-859e-0319081a3369
Oct 13 16:58:24.250: INFO: Successfully deleted PD "aws://us-west-2a/vol-0765da6d604ddd137".
[AfterEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 16:58:24.250: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-3018" for this suite.
... skipping 24 lines ...
Oct 13 16:57:22.746: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-929w7595
STEP: creating a claim
Oct 13 16:57:22.812: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-xtgx
STEP: Creating a pod to test atomic-volume-subpath
Oct 13 16:57:23.016: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-xtgx" in namespace "provisioning-929" to be "Succeeded or Failed"
Oct 13 16:57:23.082: INFO: Pod "pod-subpath-test-dynamicpv-xtgx": Phase="Pending", Reason="", readiness=false. Elapsed: 66.04673ms
Oct 13 16:57:25.150: INFO: Pod "pod-subpath-test-dynamicpv-xtgx": Phase="Pending", Reason="", readiness=false. Elapsed: 2.133250065s
Oct 13 16:57:27.223: INFO: Pod "pod-subpath-test-dynamicpv-xtgx": Phase="Pending", Reason="", readiness=false. Elapsed: 4.20702229s
Oct 13 16:57:29.291: INFO: Pod "pod-subpath-test-dynamicpv-xtgx": Phase="Pending", Reason="", readiness=false. Elapsed: 6.274463323s
Oct 13 16:57:31.358: INFO: Pod "pod-subpath-test-dynamicpv-xtgx": Phase="Pending", Reason="", readiness=false. Elapsed: 8.341331437s
Oct 13 16:57:33.427: INFO: Pod "pod-subpath-test-dynamicpv-xtgx": Phase="Pending", Reason="", readiness=false. Elapsed: 10.41068633s
... skipping 11 lines ...
Oct 13 16:57:58.232: INFO: Pod "pod-subpath-test-dynamicpv-xtgx": Phase="Running", Reason="", readiness=true. Elapsed: 35.215313028s
Oct 13 16:58:00.298: INFO: Pod "pod-subpath-test-dynamicpv-xtgx": Phase="Running", Reason="", readiness=true. Elapsed: 37.281864425s
Oct 13 16:58:02.365: INFO: Pod "pod-subpath-test-dynamicpv-xtgx": Phase="Running", Reason="", readiness=true. Elapsed: 39.348376082s
Oct 13 16:58:04.431: INFO: Pod "pod-subpath-test-dynamicpv-xtgx": Phase="Running", Reason="", readiness=true. Elapsed: 41.414887554s
Oct 13 16:58:06.497: INFO: Pod "pod-subpath-test-dynamicpv-xtgx": Phase="Succeeded", Reason="", readiness=false. Elapsed: 43.481178139s
STEP: Saw pod success
Oct 13 16:58:06.498: INFO: Pod "pod-subpath-test-dynamicpv-xtgx" satisfied condition "Succeeded or Failed"
Oct 13 16:58:06.564: INFO: Trying to get logs from node ip-172-20-37-135.us-west-2.compute.internal pod pod-subpath-test-dynamicpv-xtgx container test-container-subpath-dynamicpv-xtgx: <nil>
STEP: delete the pod
Oct 13 16:58:06.708: INFO: Waiting for pod pod-subpath-test-dynamicpv-xtgx to disappear
Oct 13 16:58:06.775: INFO: Pod pod-subpath-test-dynamicpv-xtgx no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-xtgx
Oct 13 16:58:06.775: INFO: Deleting pod "pod-subpath-test-dynamicpv-xtgx" in namespace "provisioning-929"
... skipping 109 lines ...
Oct 13 16:57:18.491: INFO: Creating resource for dynamic PV
Oct 13 16:57:18.491: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-8818-e2e-scgkwz5
STEP: creating a claim
Oct 13 16:57:18.558: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod to format volume volume-prep-provisioning-8818
Oct 13 16:57:18.776: INFO: Waiting up to 5m0s for pod "volume-prep-provisioning-8818" in namespace "provisioning-8818" to be "Succeeded or Failed"
Oct 13 16:57:18.843: INFO: Pod "volume-prep-provisioning-8818": Phase="Pending", Reason="", readiness=false. Elapsed: 66.972407ms
Oct 13 16:57:20.912: INFO: Pod "volume-prep-provisioning-8818": Phase="Pending", Reason="", readiness=false. Elapsed: 2.136721357s
Oct 13 16:57:22.981: INFO: Pod "volume-prep-provisioning-8818": Phase="Pending", Reason="", readiness=false. Elapsed: 4.204932602s
Oct 13 16:57:25.049: INFO: Pod "volume-prep-provisioning-8818": Phase="Pending", Reason="", readiness=false. Elapsed: 6.273371347s
Oct 13 16:57:27.120: INFO: Pod "volume-prep-provisioning-8818": Phase="Pending", Reason="", readiness=false. Elapsed: 8.343976256s
Oct 13 16:57:29.186: INFO: Pod "volume-prep-provisioning-8818": Phase="Pending", Reason="", readiness=false. Elapsed: 10.410783382s
Oct 13 16:57:31.258: INFO: Pod "volume-prep-provisioning-8818": Phase="Pending", Reason="", readiness=false. Elapsed: 12.482067588s
Oct 13 16:57:33.325: INFO: Pod "volume-prep-provisioning-8818": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.54945519s
STEP: Saw pod success
Oct 13 16:57:33.325: INFO: Pod "volume-prep-provisioning-8818" satisfied condition "Succeeded or Failed"
Oct 13 16:57:33.325: INFO: Deleting pod "volume-prep-provisioning-8818" in namespace "provisioning-8818"
Oct 13 16:57:33.399: INFO: Wait up to 5m0s for pod "volume-prep-provisioning-8818" to be fully deleted
STEP: Creating pod pod-subpath-test-dynamicpv-d6pb
STEP: Checking for subpath error in container status
Oct 13 16:58:07.673: INFO: Deleting pod "pod-subpath-test-dynamicpv-d6pb" in namespace "provisioning-8818"
Oct 13 16:58:07.761: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-d6pb" to be fully deleted
STEP: Deleting pod
Oct 13 16:58:07.828: INFO: Deleting pod "pod-subpath-test-dynamicpv-d6pb" in namespace "provisioning-8818"
STEP: Deleting pvc
Oct 13 16:58:08.029: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comkqgtq"
... skipping 23 lines ...
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 16:57:54.594: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278
Oct 13 16:57:54.911: INFO: Creating resource for dynamic PV
Oct 13 16:57:54.911: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-5885-e2e-sc698j2
STEP: creating a claim
Oct 13 16:57:54.975: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-22nc
STEP: Checking for subpath error in container status
Oct 13 16:58:11.296: INFO: Deleting pod "pod-subpath-test-dynamicpv-22nc" in namespace "provisioning-5885"
Oct 13 16:58:11.361: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-22nc" to be fully deleted
STEP: Deleting pod
Oct 13 16:58:13.488: INFO: Deleting pod "pod-subpath-test-dynamicpv-22nc" in namespace "provisioning-5885"
STEP: Deleting pvc
Oct 13 16:58:13.677: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.com2xckv"
... skipping 11 lines ...

• [SLOW TEST:34.631 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
... skipping 205 lines ...
Oct 13 16:57:29.245: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-6113-e2e-sctq5kd
STEP: creating a claim
Oct 13 16:57:29.311: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-l5hn
STEP: Creating a pod to test atomic-volume-subpath
Oct 13 16:57:29.513: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-l5hn" in namespace "provisioning-6113" to be "Succeeded or Failed"
Oct 13 16:57:29.579: INFO: Pod "pod-subpath-test-dynamicpv-l5hn": Phase="Pending", Reason="", readiness=false. Elapsed: 65.520461ms
Oct 13 16:57:31.649: INFO: Pod "pod-subpath-test-dynamicpv-l5hn": Phase="Pending", Reason="", readiness=false. Elapsed: 2.1355022s
Oct 13 16:57:33.715: INFO: Pod "pod-subpath-test-dynamicpv-l5hn": Phase="Pending", Reason="", readiness=false. Elapsed: 4.201593173s
Oct 13 16:57:35.784: INFO: Pod "pod-subpath-test-dynamicpv-l5hn": Phase="Pending", Reason="", readiness=false. Elapsed: 6.270350655s
Oct 13 16:57:37.852: INFO: Pod "pod-subpath-test-dynamicpv-l5hn": Phase="Pending", Reason="", readiness=false. Elapsed: 8.338333423s
Oct 13 16:57:39.918: INFO: Pod "pod-subpath-test-dynamicpv-l5hn": Phase="Pending", Reason="", readiness=false. Elapsed: 10.404394077s
... skipping 7 lines ...
Oct 13 16:57:56.451: INFO: Pod "pod-subpath-test-dynamicpv-l5hn": Phase="Running", Reason="", readiness=true. Elapsed: 26.937918489s
Oct 13 16:57:58.517: INFO: Pod "pod-subpath-test-dynamicpv-l5hn": Phase="Running", Reason="", readiness=true. Elapsed: 29.003913528s
Oct 13 16:58:00.583: INFO: Pod "pod-subpath-test-dynamicpv-l5hn": Phase="Running", Reason="", readiness=true. Elapsed: 31.069964467s
Oct 13 16:58:02.650: INFO: Pod "pod-subpath-test-dynamicpv-l5hn": Phase="Running", Reason="", readiness=true. Elapsed: 33.136388383s
Oct 13 16:58:04.716: INFO: Pod "pod-subpath-test-dynamicpv-l5hn": Phase="Succeeded", Reason="", readiness=false. Elapsed: 35.203115946s
STEP: Saw pod success
Oct 13 16:58:04.716: INFO: Pod "pod-subpath-test-dynamicpv-l5hn" satisfied condition "Succeeded or Failed"
Oct 13 16:58:04.782: INFO: Trying to get logs from node ip-172-20-39-49.us-west-2.compute.internal pod pod-subpath-test-dynamicpv-l5hn container test-container-subpath-dynamicpv-l5hn: <nil>
STEP: delete the pod
Oct 13 16:58:04.921: INFO: Waiting for pod pod-subpath-test-dynamicpv-l5hn to disappear
Oct 13 16:58:04.986: INFO: Pod pod-subpath-test-dynamicpv-l5hn no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-l5hn
Oct 13 16:58:04.986: INFO: Deleting pod "pod-subpath-test-dynamicpv-l5hn" in namespace "provisioning-6113"
... skipping 651 lines ...
Oct 13 16:58:52.769: INFO: Waiting for pod aws-client to disappear
Oct 13 16:58:52.835: INFO: Pod aws-client no longer exists
STEP: cleaning the environment after aws
STEP: Deleting pv and pvc
Oct 13 16:58:52.835: INFO: Deleting PersistentVolumeClaim "pvc-7ckfv"
Oct 13 16:58:52.902: INFO: Deleting PersistentVolume "aws-2tpqg"
Oct 13 16:58:53.379: INFO: Couldn't delete PD "aws://us-west-2a/vol-08cdefe8105bb6eaa", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-08cdefe8105bb6eaa is currently attached to i-04097d75079331972
	status code: 400, request id: 61389206-15ea-470b-801f-42dbda25323c
Oct 13 16:58:59.014: INFO: Couldn't delete PD "aws://us-west-2a/vol-08cdefe8105bb6eaa", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-08cdefe8105bb6eaa is currently attached to i-04097d75079331972
	status code: 400, request id: a1c1f505-8637-4cf6-9de8-259424c73ed8
Oct 13 16:59:04.455: INFO: Successfully deleted PD "aws://us-west-2a/vol-08cdefe8105bb6eaa".
[AfterEach] [Testpattern: Pre-provisioned PV (block volmode)] volumes
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 16:59:04.455: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-2040" for this suite.
... skipping 200 lines ...
Oct 13 16:59:25.417: INFO: At 2021-10-13 16:51:39 +0000 UTC - event for pod-19f5c2e6-d556-4f0d-aa30-10f27c176ffe: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-9530a1b5-6f71-45d8-8e73-c3232b650524" 
Oct 13 16:59:25.417: INFO: At 2021-10-13 16:51:49 +0000 UTC - event for pod-19f5c2e6-d556-4f0d-aa30-10f27c176ffe: {kubelet ip-172-20-37-205.us-west-2.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/busybox:1.29-1" already present on machine
Oct 13 16:59:25.417: INFO: At 2021-10-13 16:51:49 +0000 UTC - event for pod-19f5c2e6-d556-4f0d-aa30-10f27c176ffe: {kubelet ip-172-20-37-205.us-west-2.compute.internal} Created: Created container write-pod
Oct 13 16:59:25.417: INFO: At 2021-10-13 16:51:49 +0000 UTC - event for pod-19f5c2e6-d556-4f0d-aa30-10f27c176ffe: {kubelet ip-172-20-37-205.us-west-2.compute.internal} Started: Started container write-pod
Oct 13 16:59:25.417: INFO: At 2021-10-13 16:52:01 +0000 UTC - event for pod-19f5c2e6-d556-4f0d-aa30-10f27c176ffe: {kubelet ip-172-20-37-205.us-west-2.compute.internal} Killing: Stopping container write-pod
Oct 13 16:59:25.417: INFO: At 2021-10-13 16:52:05 +0000 UTC - event for pod-e7b7afa2-4416-436f-a5c2-434698d99348: {default-scheduler } Scheduled: Successfully assigned multivolume-892/pod-e7b7afa2-4416-436f-a5c2-434698d99348 to ip-172-20-37-135.us-west-2.compute.internal
Oct 13 16:59:25.417: INFO: At 2021-10-13 16:52:24 +0000 UTC - event for pod-e7b7afa2-4416-436f-a5c2-434698d99348: {attachdetach-controller } FailedAttachVolume: Multi-Attach error for volume "pvc-9530a1b5-6f71-45d8-8e73-c3232b650524" Volume is already exclusively attached to one node and can't be attached to another
Oct 13 16:59:25.417: INFO: At 2021-10-13 16:52:34 +0000 UTC - event for pod-e7b7afa2-4416-436f-a5c2-434698d99348: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-f61e0962-965c-4fc4-826e-3e1e1c0b82b7" 
Oct 13 16:59:25.417: INFO: At 2021-10-13 16:52:45 +0000 UTC - event for pod-e7b7afa2-4416-436f-a5c2-434698d99348: {attachdetach-controller } FailedAttachVolume: AttachVolume.Attach failed for volume "pvc-9530a1b5-6f71-45d8-8e73-c3232b650524" : rpc error: code = DeadlineExceeded desc = context deadline exceeded
Oct 13 16:59:25.417: INFO: At 2021-10-13 16:52:50 +0000 UTC - event for pod-e7b7afa2-4416-436f-a5c2-434698d99348: {attachdetach-controller } FailedAttachVolume: AttachVolume.Attach failed for volume "pvc-9530a1b5-6f71-45d8-8e73-c3232b650524" : rpc error: code = Internal desc = Could not attach volume "vol-0eee0178d9db0bb3b" to node "i-04097d75079331972": attachment of disk "vol-0eee0178d9db0bb3b" failed, expected device to be attached but was attaching
Oct 13 16:59:25.417: INFO: At 2021-10-13 16:54:08 +0000 UTC - event for pod-e7b7afa2-4416-436f-a5c2-434698d99348: {kubelet ip-172-20-37-135.us-west-2.compute.internal} FailedMount: Unable to attach or mount volumes: unmounted volumes=[volume1], unattached volumes=[volume1 volume2 kube-api-access-cwdt6]: timed out waiting for the condition
Oct 13 16:59:25.480: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Oct 13 16:59:25.480: INFO: 
Oct 13 16:59:25.545: INFO: 
Logging node info for node ip-172-20-37-135.us-west-2.compute.internal
Oct 13 16:59:25.608: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-37-135.us-west-2.compute.internal    af65b462-4037-4236-bd02-4440f60874a4 15420 0 2021-10-13 16:47:41 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/instancegroup:nodes-us-west-2a kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-37-135.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-04097d75079331972"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.37.135/19 projectcalico.org/IPv4IPIPTunnelAddr:100.111.85.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  [{kops-controller Update v1 2021-10-13 16:47:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}}} {kubelet Update v1 2021-10-13 16:47:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}}} {calico-node Update v1 2021-10-13 16:47:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-10-13 16:48:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}}} {kubelet Update v1 2021-10-13 16:59:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-10-13 16:59:13 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-04097d75079331972,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49895047168 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4059734016 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44905542377 0} {<nil>} 44905542377 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3954876416 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-10-13 16:47:59 +0000 UTC,LastTransitionTime:2021-10-13 16:47:59 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-10-13 16:59:22 +0000 UTC,LastTransitionTime:2021-10-13 16:47:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-10-13 16:59:22 +0000 UTC,LastTransitionTime:2021-10-13 16:47:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-10-13 16:59:22 +0000 UTC,LastTransitionTime:2021-10-13 16:47:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-10-13 16:59:22 +0000 UTC,LastTransitionTime:2021-10-13 16:48:01 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.135,},NodeAddress{Type:ExternalIP,Address:34.220.30.94,},NodeAddress{Type:Hostname,Address:ip-172-20-37-135.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-37-135.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-220-30-94.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2012eee5b5bee331d4c2e18caf86f1,SystemUUID:ec2012ee-e5b5-bee3-31d4-c2e18caf86f1,BootID:e7d3d676-1ac7-4d5a-ba03-0507252e4530,KernelVersion:5.11.0-1019-aws,OSImage:Ubuntu 20.04.3 LTS,ContainerRuntimeVersion:containerd://1.4.11,KubeletVersion:v1.22.1,KubeProxyVersion:v1.22.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/provider-aws/aws-ebs-csi-driver@sha256:5c03401df9e8fa384b66efc8bfd954a0371ad584a9430eca7d4d9338654d7fe0 k8s.gcr.io/provider-aws/aws-ebs-csi-driver:v1.4.0],SizeBytes:116606616,},ContainerImage{Names:[docker.io/calico/node@sha256:1ae8f57edec7c3a84cd48dd94132a1dcfd7c61bfff819c559f9379d4a56fe3b1 docker.io/calico/node:v3.20.2],SizeBytes:57637498,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:8bd76a6a7778e203b61e18e5ee85b1faf52e6a30eb07e445a165ab90fe9633e3 k8s.gcr.io/e2e-test-images/agnhost:2.31],SizeBytes:49692421,},ContainerImage{Names:[docker.io/calico/cni@sha256:3dae26de7388ff3c124b9abd7e8d12863887391f23549c4aebfbfa20cc0700a5 docker.io/calico/cni:v3.20.2],SizeBytes:48389252,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:abe8cef9e116f2d5ec1175c386e33841ff3386779138b425af876384b0fd7ccb k8s.gcr.io/build-image/debian-iptables:buster-v1.5.0],SizeBytes:38088315,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:efcf1d5fb2fc95d28841f534f1385a4884230c7c876fb1b7cf66d2777ad6dc56 k8s.gcr.io/kube-proxy:v1.22.1],SizeBytes:35941601,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:4514cc1b2f7536fe1d514fad8a2c46103382243bb9db5ea2d0063fcd2001e8f7 docker.io/calico/pod2daemon-flexvol:v3.20.2],SizeBytes:9359081,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:48da0e4ed7238ad461ea05f68c25921783c37b315f21a5c5a2780157a6460994 k8s.gcr.io/sig-storage/livenessprobe:v2.2.0],SizeBytes:8279778,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00bd4883456091f92 kubernetes.io/csi/ebs.csi.aws.com^vol-00c86b006498497d3 kubernetes.io/csi/ebs.csi.aws.com^vol-00fcd1c6742e6e4bd kubernetes.io/csi/ebs.csi.aws.com^vol-010f4547cb9c2b53e kubernetes.io/csi/ebs.csi.aws.com^vol-01571f67d40f68665 kubernetes.io/csi/ebs.csi.aws.com^vol-01f341f864a3642ad kubernetes.io/csi/ebs.csi.aws.com^vol-023a0581ccdbdb9e7 kubernetes.io/csi/ebs.csi.aws.com^vol-024bac6199ab5ddaa kubernetes.io/csi/ebs.csi.aws.com^vol-03392b1595827b256 kubernetes.io/csi/ebs.csi.aws.com^vol-0406aec6dcb72b563 kubernetes.io/csi/ebs.csi.aws.com^vol-084807447db7db4e0 kubernetes.io/csi/ebs.csi.aws.com^vol-0873e345d9e090f4f kubernetes.io/csi/ebs.csi.aws.com^vol-087e8ca9d094de8e8 kubernetes.io/csi/ebs.csi.aws.com^vol-0918c1a066df52aa7 kubernetes.io/csi/ebs.csi.aws.com^vol-09dcc81afeb4ae68a kubernetes.io/csi/ebs.csi.aws.com^vol-0a0ca87133c427341 kubernetes.io/csi/ebs.csi.aws.com^vol-0ab0595c23443a468 kubernetes.io/csi/ebs.csi.aws.com^vol-0d2388a1eaf6a3a6a kubernetes.io/csi/ebs.csi.aws.com^vol-0fbcdde3c043c04c0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ab0595c23443a468,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0a0ca87133c427341,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00c86b006498497d3,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0fbcdde3c043c04c0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00bd4883456091f92,DevicePath:,},},Config:nil,},}
... skipping 152 lines ...
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow]
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly] [It]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:164

    Unexpected error:
        <*errors.errorString | 0xc0005b6d60>: {
            s: "pod \"pod-e7b7afa2-4416-436f-a5c2-434698d99348\" is not Running: timed out waiting for the condition",
        }
        pod "pod-e7b7afa2-4416-436f-a5c2-434698d99348" is not Running: timed out waiting for the condition
    occurred

... skipping 111 lines ...
Oct 13 16:58:51.306: INFO: Waiting for pod external-injector to disappear
Oct 13 16:58:51.375: INFO: Pod external-injector still exists
Oct 13 16:58:53.305: INFO: Waiting for pod external-injector to disappear
Oct 13 16:58:53.370: INFO: Pod external-injector still exists
Oct 13 16:58:55.305: INFO: Waiting for pod external-injector to disappear
Oct 13 16:58:55.370: INFO: Pod external-injector no longer exists
Oct 13 16:58:55.370: FAIL: Failed to create injector pod: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func3()
	/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:186 +0x438
github.com/kubernetes-sigs/aws-ebs-csi-driver/tests/e2e-kubernetes.TestEBSCSI(0x407c59)
	/tmp/kops.SddEmXFEi/tests/e2e-kubernetes/e2e_test.go:82 +0x319
... skipping 20 lines ...
STEP: Found 8 events.
Oct 13 16:59:31.218: INFO: At 2021-10-13 16:52:18 +0000 UTC - event for ebs.csi.aws.com5lrnd: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Oct 13 16:59:31.218: INFO: At 2021-10-13 16:52:18 +0000 UTC - event for ebs.csi.aws.com5lrnd: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Oct 13 16:59:31.218: INFO: At 2021-10-13 16:52:18 +0000 UTC - event for ebs.csi.aws.com5lrnd: {ebs.csi.aws.com_ebs-csi-controller-54dc46fc7b-z7zhv_b0c3c199-b47a-4307-b47c-e462bdeeb2ea } Provisioning: External provisioner is provisioning volume for claim "volume-6004/ebs.csi.aws.com5lrnd"
Oct 13 16:59:31.218: INFO: At 2021-10-13 16:52:22 +0000 UTC - event for ebs.csi.aws.com5lrnd: {ebs.csi.aws.com_ebs-csi-controller-54dc46fc7b-z7zhv_b0c3c199-b47a-4307-b47c-e462bdeeb2ea } ProvisioningSucceeded: Successfully provisioned volume pvc-806ef7d9-8954-4891-99d8-9a1f4eddcd4e
Oct 13 16:59:31.218: INFO: At 2021-10-13 16:52:22 +0000 UTC - event for external-injector: {default-scheduler } Scheduled: Successfully assigned volume-6004/external-injector to ip-172-20-37-135.us-west-2.compute.internal
Oct 13 16:59:31.218: INFO: At 2021-10-13 16:52:39 +0000 UTC - event for external-injector: {attachdetach-controller } FailedAttachVolume: AttachVolume.Attach failed for volume "pvc-806ef7d9-8954-4891-99d8-9a1f4eddcd4e" : rpc error: code = DeadlineExceeded desc = context deadline exceeded
Oct 13 16:59:31.218: INFO: At 2021-10-13 16:52:49 +0000 UTC - event for external-injector: {attachdetach-controller } FailedAttachVolume: AttachVolume.Attach failed for volume "pvc-806ef7d9-8954-4891-99d8-9a1f4eddcd4e" : rpc error: code = Internal desc = Could not attach volume "vol-0c66c4bc3b04079b8" to node "i-04097d75079331972": attachment of disk "vol-0c66c4bc3b04079b8" failed, expected device to be attached but was attaching
Oct 13 16:59:31.218: INFO: At 2021-10-13 16:54:26 +0000 UTC - event for external-injector: {kubelet ip-172-20-37-135.us-west-2.compute.internal} FailedMount: Unable to attach or mount volumes: unmounted volumes=[external-volume-0], unattached volumes=[external-volume-0 kube-api-access-rskwt]: timed out waiting for the condition
Oct 13 16:59:31.282: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Oct 13 16:59:31.282: INFO: 
Oct 13 16:59:31.348: INFO: 
Logging node info for node ip-172-20-37-135.us-west-2.compute.internal
Oct 13 16:59:31.412: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-37-135.us-west-2.compute.internal    af65b462-4037-4236-bd02-4440f60874a4 15479 0 2021-10-13 16:47:41 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/instancegroup:nodes-us-west-2a kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-37-135.us-west-2.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-04097d75079331972"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.37.135/19 projectcalico.org/IPv4IPIPTunnelAddr:100.111.85.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  [{kops-controller Update v1 2021-10-13 16:47:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}}} {kubelet Update v1 2021-10-13 16:47:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}}} {calico-node Update v1 2021-10-13 16:47:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-10-13 16:48:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}}} {kubelet Update v1 2021-10-13 16:59:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2021-10-13 16:59:13 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-04097d75079331972,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49895047168 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4059734016 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44905542377 0} {<nil>} 44905542377 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3954876416 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-10-13 16:47:59 +0000 UTC,LastTransitionTime:2021-10-13 16:47:59 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-10-13 16:59:22 +0000 UTC,LastTransitionTime:2021-10-13 16:47:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-10-13 16:59:22 +0000 UTC,LastTransitionTime:2021-10-13 16:47:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-10-13 16:59:22 +0000 UTC,LastTransitionTime:2021-10-13 16:47:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-10-13 16:59:22 +0000 UTC,LastTransitionTime:2021-10-13 16:48:01 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.37.135,},NodeAddress{Type:ExternalIP,Address:34.220.30.94,},NodeAddress{Type:Hostname,Address:ip-172-20-37-135.us-west-2.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-37-135.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-220-30-94.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2012eee5b5bee331d4c2e18caf86f1,SystemUUID:ec2012ee-e5b5-bee3-31d4-c2e18caf86f1,BootID:e7d3d676-1ac7-4d5a-ba03-0507252e4530,KernelVersion:5.11.0-1019-aws,OSImage:Ubuntu 20.04.3 LTS,ContainerRuntimeVersion:containerd://1.4.11,KubeletVersion:v1.22.1,KubeProxyVersion:v1.22.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/provider-aws/aws-ebs-csi-driver@sha256:5c03401df9e8fa384b66efc8bfd954a0371ad584a9430eca7d4d9338654d7fe0 k8s.gcr.io/provider-aws/aws-ebs-csi-driver:v1.4.0],SizeBytes:116606616,},ContainerImage{Names:[docker.io/calico/node@sha256:1ae8f57edec7c3a84cd48dd94132a1dcfd7c61bfff819c559f9379d4a56fe3b1 docker.io/calico/node:v3.20.2],SizeBytes:57637498,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:8bd76a6a7778e203b61e18e5ee85b1faf52e6a30eb07e445a165ab90fe9633e3 k8s.gcr.io/e2e-test-images/agnhost:2.31],SizeBytes:49692421,},ContainerImage{Names:[docker.io/calico/cni@sha256:3dae26de7388ff3c124b9abd7e8d12863887391f23549c4aebfbfa20cc0700a5 docker.io/calico/cni:v3.20.2],SizeBytes:48389252,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:abe8cef9e116f2d5ec1175c386e33841ff3386779138b425af876384b0fd7ccb k8s.gcr.io/build-image/debian-iptables:buster-v1.5.0],SizeBytes:38088315,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:efcf1d5fb2fc95d28841f534f1385a4884230c7c876fb1b7cf66d2777ad6dc56 k8s.gcr.io/kube-proxy:v1.22.1],SizeBytes:35941601,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:4514cc1b2f7536fe1d514fad8a2c46103382243bb9db5ea2d0063fcd2001e8f7 docker.io/calico/pod2daemon-flexvol:v3.20.2],SizeBytes:9359081,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:48da0e4ed7238ad461ea05f68c25921783c37b315f21a5c5a2780157a6460994 k8s.gcr.io/sig-storage/livenessprobe:v2.2.0],SizeBytes:8279778,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00bd4883456091f92 kubernetes.io/csi/ebs.csi.aws.com^vol-00c86b006498497d3 kubernetes.io/csi/ebs.csi.aws.com^vol-00fcd1c6742e6e4bd kubernetes.io/csi/ebs.csi.aws.com^vol-010f4547cb9c2b53e kubernetes.io/csi/ebs.csi.aws.com^vol-01571f67d40f68665 kubernetes.io/csi/ebs.csi.aws.com^vol-01f341f864a3642ad kubernetes.io/csi/ebs.csi.aws.com^vol-023a0581ccdbdb9e7 kubernetes.io/csi/ebs.csi.aws.com^vol-024bac6199ab5ddaa kubernetes.io/csi/ebs.csi.aws.com^vol-03392b1595827b256 kubernetes.io/csi/ebs.csi.aws.com^vol-0406aec6dcb72b563 kubernetes.io/csi/ebs.csi.aws.com^vol-084807447db7db4e0 kubernetes.io/csi/ebs.csi.aws.com^vol-0873e345d9e090f4f kubernetes.io/csi/ebs.csi.aws.com^vol-087e8ca9d094de8e8 kubernetes.io/csi/ebs.csi.aws.com^vol-0918c1a066df52aa7 kubernetes.io/csi/ebs.csi.aws.com^vol-09dcc81afeb4ae68a kubernetes.io/csi/ebs.csi.aws.com^vol-0a0ca87133c427341 kubernetes.io/csi/ebs.csi.aws.com^vol-0ab0595c23443a468 kubernetes.io/csi/ebs.csi.aws.com^vol-0d2388a1eaf6a3a6a kubernetes.io/csi/ebs.csi.aws.com^vol-0fbcdde3c043c04c0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00bd4883456091f92,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0a0ca87133c427341,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-024bac6199ab5ddaa,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-084807447db7db4e0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0918c1a066df52aa7,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0873e345d9e090f4f,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00c86b006498497d3,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0fbcdde3c043c04c0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0e9ab020d44142698,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-01f341f864a3642ad,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ab0595c23443a468,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-058495e7d2c19a1cd,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0d2388a1eaf6a3a6a,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0406aec6dcb72b563,DevicePath:,},},Config:nil,},}
... skipping 152 lines ...
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (default fs)] volumes
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should store data [It]
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159

    Oct 13 16:58:55.370: Failed to create injector pod: timed out waiting for the condition

    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:186
------------------------------
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
... skipping 335 lines ...
    /tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:200
------------------------------


Summarizing 2 Failures:

[Fail] External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow] [It] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly] 
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:419

[Fail] External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] volumes [It] should store data 
/tmp/kops.SddEmXFEi/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:186

Ran 140 of 485 Specs in 861.138 seconds
FAIL! -- 138 Passed | 2 Failed | 0 Pending | 345 Skipped


Ginkgo ran 1 suite in 15m27.979336916s
Test Suite Failed

Ginkgo 2.0 is coming soon!
==========================
Ginkgo 2.0 is under active development and will introduce several new features, improvements, and a small handful of breaking changes.
A release candidate for 2.0 is now available and 2.0 should GA in Fall 2021.  Please give the RC a try and send us feedback!
  - To learn more, view the migration guide at https://github.com/onsi/ginkgo/blob/ver2/docs/MIGRATING_TO_V2.md
... skipping 1477 lines ...