This job view page is being replaced by Spyglass soon. Check out the new job view.
PRrifelpet: Upgrade EBS CSI Driver to v1.4.0
ResultFAILURE
Tests 0 failed / 0 succeeded
Started2021-10-13 06:38
Elapsed44m31s
Revision0b6c47d64719cf4e4cd2bd17a2e900f13eac807f
Refs 12529

No Test Failures!


Error lines from build-log.txt

... skipping 589 lines ...
I1013 06:43:09.842174   12538 app.go:90] ID for this run: "06ee6104-2bf0-11ec-b555-ca1361d09b8c"
I1013 06:43:09.866641   12538 up.go:43] Cleaning up any leaked resources from previous cluster
I1013 06:43:09.866701   12538 dumplogs.go:40] /home/prow/go/src/k8s.io/kops/.bazelbuild/dist/linux/amd64/kops toolbox dump --name e2e-b6f7c24027-45100.test-cncf-aws.k8s.io --dir /logs/artifacts --private-key /etc/aws-ssh/aws-ssh-private --ssh-user ubuntu
I1013 06:43:09.884439   12547 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
I1013 06:43:09.884525   12547 featureflag.go:166] FeatureFlag "AlphaAllowGCE"=true
I1013 06:43:09.884531   12547 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
Error: Cluster.kops.k8s.io "e2e-b6f7c24027-45100.test-cncf-aws.k8s.io" not found
W1013 06:43:10.353801   12538 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1
I1013 06:43:10.353853   12538 down.go:48] /home/prow/go/src/k8s.io/kops/.bazelbuild/dist/linux/amd64/kops delete cluster --name e2e-b6f7c24027-45100.test-cncf-aws.k8s.io --yes
I1013 06:43:10.371116   12556 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
I1013 06:43:10.371195   12556 featureflag.go:166] FeatureFlag "AlphaAllowGCE"=true
I1013 06:43:10.371199   12556 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
Error: error reading cluster configuration: Cluster.kops.k8s.io "e2e-b6f7c24027-45100.test-cncf-aws.k8s.io" not found
I1013 06:43:10.859275   12538 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip
2021/10/13 06:43:10 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404
I1013 06:43:10.867025   12538 http.go:37] curl https://ip.jsb.workers.dev
I1013 06:43:10.971291   12538 up.go:144] /home/prow/go/src/k8s.io/kops/.bazelbuild/dist/linux/amd64/kops create cluster --name e2e-b6f7c24027-45100.test-cncf-aws.k8s.io --cloud aws --kubernetes-version 1.22.1 --ssh-public-key /etc/aws-ssh/aws-ssh-public --override cluster.spec.nodePortAccess=0.0.0.0/0 --yes --networking calico --override=cluster.spec.cloudConfig.awsEBSCSIDriver.enabled=true --override=cluster.spec.snapshotController.enabled=true --override=cluster.spec.certManager.enabled=true --admin-access 35.193.210.107/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones ap-northeast-1a --master-size c5.large
I1013 06:43:10.988482   12569 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
I1013 06:43:10.988572   12569 featureflag.go:166] FeatureFlag "AlphaAllowGCE"=true
I1013 06:43:10.988576   12569 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
I1013 06:43:11.009173   12569 create_cluster.go:838] Using SSH public key: /etc/aws-ssh/aws-ssh-public
... skipping 33 lines ...
I1013 06:43:40.328204   12538 up.go:181] /home/prow/go/src/k8s.io/kops/.bazelbuild/dist/linux/amd64/kops validate cluster --name e2e-b6f7c24027-45100.test-cncf-aws.k8s.io --count 10 --wait 15m0s
I1013 06:43:40.345770   12590 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
I1013 06:43:40.345858   12590 featureflag.go:166] FeatureFlag "AlphaAllowGCE"=true
I1013 06:43:40.345864   12590 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
Validating cluster e2e-b6f7c24027-45100.test-cncf-aws.k8s.io

W1013 06:43:41.736525   12590 validate_cluster.go:184] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-b6f7c24027-45100.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:43:51.766788   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:44:01.801828   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:44:11.833809   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:44:21.880218   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:44:31.915785   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:44:41.959116   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:44:52.021883   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:45:02.053035   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:45:12.119532   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:45:22.166143   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:45:32.194847   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:45:42.231743   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:45:52.266808   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:46:02.301894   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:46:12.350217   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:46:22.383098   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:46:32.414860   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:46:42.453589   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:46:52.485463   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:47:02.530857   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:47:12.560190   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:47:22.596844   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 06:47:32.625585   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

... skipping 17 lines ...
Pod	kube-system/coredns-autoscaler-84d4cfd89c-hjbqx		system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-hjbqx" is pending
Pod	kube-system/ebs-csi-controller-54dc46fc7b-lgqq8		system-cluster-critical pod "ebs-csi-controller-54dc46fc7b-lgqq8" is pending
Pod	kube-system/ebs-csi-node-46w9k				system-node-critical pod "ebs-csi-node-46w9k" is pending
Pod	kube-system/ebs-csi-node-872wh				system-node-critical pod "ebs-csi-node-872wh" is pending
Pod	kube-system/ebs-csi-node-bxv69				system-node-critical pod "ebs-csi-node-bxv69" is pending

Validation Failed
W1013 06:47:46.123298   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

... skipping 19 lines ...
Pod	kube-system/ebs-csi-node-46w9k				system-node-critical pod "ebs-csi-node-46w9k" is pending
Pod	kube-system/ebs-csi-node-872wh				system-node-critical pod "ebs-csi-node-872wh" is pending
Pod	kube-system/ebs-csi-node-bxv69				system-node-critical pod "ebs-csi-node-bxv69" is pending
Pod	kube-system/ebs-csi-node-mtskt				system-node-critical pod "ebs-csi-node-mtskt" is pending
Pod	kube-system/ebs-csi-node-tpsbc				system-node-critical pod "ebs-csi-node-tpsbc" is pending

Validation Failed
W1013 06:47:58.495450   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

... skipping 14 lines ...
Pod	kube-system/coredns-autoscaler-84d4cfd89c-hjbqx	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-hjbqx" is pending
Pod	kube-system/ebs-csi-node-872wh			system-node-critical pod "ebs-csi-node-872wh" is pending
Pod	kube-system/ebs-csi-node-bxv69			system-node-critical pod "ebs-csi-node-bxv69" is pending
Pod	kube-system/ebs-csi-node-mtskt			system-node-critical pod "ebs-csi-node-mtskt" is pending
Pod	kube-system/ebs-csi-node-tpsbc			system-node-critical pod "ebs-csi-node-tpsbc" is pending

Validation Failed
W1013 06:48:11.048579   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

... skipping 7 lines ...

VALIDATION ERRORS
KIND	NAME				MESSAGE
Pod	kube-system/ebs-csi-node-mtskt	system-node-critical pod "ebs-csi-node-mtskt" is pending
Pod	kube-system/ebs-csi-node-tpsbc	system-node-critical pod "ebs-csi-node-tpsbc" is pending

Validation Failed
W1013 06:48:23.582574   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

... skipping 21 lines ...
ip-172-20-63-30.ap-northeast-1.compute.internal		master	True

VALIDATION ERRORS
KIND	NAME									MESSAGE
Pod	kube-system/kube-proxy-ip-172-20-32-238.ap-northeast-1.compute.internal	system-node-critical pod "kube-proxy-ip-172-20-32-238.ap-northeast-1.compute.internal" is pending

Validation Failed
W1013 06:48:48.310716   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

... skipping 6 lines ...
ip-172-20-63-30.ap-northeast-1.compute.internal		master	True

VALIDATION ERRORS
KIND	NAME									MESSAGE
Pod	kube-system/kube-proxy-ip-172-20-58-178.ap-northeast-1.compute.internal	system-node-critical pod "kube-proxy-ip-172-20-58-178.ap-northeast-1.compute.internal" is pending

Validation Failed
W1013 06:49:00.699253   12590 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

... skipping 478 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to use a volume in a pod with mismatched mode [Slow] [BeforeEach]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296

    Driver "ebs.csi.aws.com" does not support volume type "PreprovisionedPV" - skipping

    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 111 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath directory is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240

      Distro debian doesn't support ntfs -- skipping

      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:127
------------------------------
... skipping 8 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278

      Driver supports dynamic provisioning, skipping PreprovisionedPV pattern

      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:233
------------------------------
... skipping 196 lines ...
STEP: Creating a kubernetes client
Oct 13 06:52:19.518: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename topology
W1013 06:52:20.387389   25189 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
Oct 13 06:52:20.387: INFO: No PodSecurityPolicies found; assuming PodSecurityPolicy is disabled.
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to schedule a pod which has topologies that conflict with AllowedTopologies
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192
Oct 13 06:52:20.928: INFO: found topology map[topology.kubernetes.io/zone:ap-northeast-1a]
Oct 13 06:52:20.928: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
Oct 13 06:52:20.928: INFO: Not enough topologies in cluster -- skipping
STEP: Deleting pvc
STEP: Deleting sc
... skipping 7 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (immediate binding)] topology
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [It]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Not enough topologies in cluster -- skipping

      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:199
------------------------------
... skipping 259 lines ...
Oct 13 06:52:21.182: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(ebs.csi.aws.com) supported size:{ 1Gi} 
STEP: creating a StorageClass volume-expand-8187-e2e-sczdbr9
STEP: creating a claim
Oct 13 06:52:21.319: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Expanding non-expandable pvc
Oct 13 06:52:21.593: INFO: currentPvcSize {{1073741824 0} {<nil>} 1Gi BinarySI}, newSize {{2147483648 0} {<nil>}  BinarySI}
Oct 13 06:52:21.925: INFO: Error updating pvc ebs.csi.aws.com8n8b8: PersistentVolumeClaim "ebs.csi.aws.com8n8b8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8187-e2e-sczdbr9",
  	... // 3 identical fields
  }

Oct 13 06:52:24.198: INFO: Error updating pvc ebs.csi.aws.com8n8b8: PersistentVolumeClaim "ebs.csi.aws.com8n8b8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8187-e2e-sczdbr9",
  	... // 3 identical fields
  }

Oct 13 06:52:26.201: INFO: Error updating pvc ebs.csi.aws.com8n8b8: PersistentVolumeClaim "ebs.csi.aws.com8n8b8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8187-e2e-sczdbr9",
  	... // 3 identical fields
  }

Oct 13 06:52:28.196: INFO: Error updating pvc ebs.csi.aws.com8n8b8: PersistentVolumeClaim "ebs.csi.aws.com8n8b8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8187-e2e-sczdbr9",
  	... // 3 identical fields
  }

Oct 13 06:52:30.196: INFO: Error updating pvc ebs.csi.aws.com8n8b8: PersistentVolumeClaim "ebs.csi.aws.com8n8b8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8187-e2e-sczdbr9",
  	... // 3 identical fields
  }

Oct 13 06:52:32.196: INFO: Error updating pvc ebs.csi.aws.com8n8b8: PersistentVolumeClaim "ebs.csi.aws.com8n8b8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8187-e2e-sczdbr9",
  	... // 3 identical fields
  }

Oct 13 06:52:34.197: INFO: Error updating pvc ebs.csi.aws.com8n8b8: PersistentVolumeClaim "ebs.csi.aws.com8n8b8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8187-e2e-sczdbr9",
  	... // 3 identical fields
  }

Oct 13 06:52:36.196: INFO: Error updating pvc ebs.csi.aws.com8n8b8: PersistentVolumeClaim "ebs.csi.aws.com8n8b8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8187-e2e-sczdbr9",
  	... // 3 identical fields
  }

Oct 13 06:52:38.197: INFO: Error updating pvc ebs.csi.aws.com8n8b8: PersistentVolumeClaim "ebs.csi.aws.com8n8b8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8187-e2e-sczdbr9",
  	... // 3 identical fields
  }

Oct 13 06:52:40.196: INFO: Error updating pvc ebs.csi.aws.com8n8b8: PersistentVolumeClaim "ebs.csi.aws.com8n8b8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8187-e2e-sczdbr9",
  	... // 3 identical fields
  }

Oct 13 06:52:42.198: INFO: Error updating pvc ebs.csi.aws.com8n8b8: PersistentVolumeClaim "ebs.csi.aws.com8n8b8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8187-e2e-sczdbr9",
  	... // 3 identical fields
  }

Oct 13 06:52:44.197: INFO: Error updating pvc ebs.csi.aws.com8n8b8: PersistentVolumeClaim "ebs.csi.aws.com8n8b8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8187-e2e-sczdbr9",
  	... // 3 identical fields
  }

Oct 13 06:52:46.198: INFO: Error updating pvc ebs.csi.aws.com8n8b8: PersistentVolumeClaim "ebs.csi.aws.com8n8b8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8187-e2e-sczdbr9",
  	... // 3 identical fields
  }

Oct 13 06:52:48.199: INFO: Error updating pvc ebs.csi.aws.com8n8b8: PersistentVolumeClaim "ebs.csi.aws.com8n8b8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8187-e2e-sczdbr9",
  	... // 3 identical fields
  }

Oct 13 06:52:50.196: INFO: Error updating pvc ebs.csi.aws.com8n8b8: PersistentVolumeClaim "ebs.csi.aws.com8n8b8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8187-e2e-sczdbr9",
  	... // 3 identical fields
  }

Oct 13 06:52:52.199: INFO: Error updating pvc ebs.csi.aws.com8n8b8: PersistentVolumeClaim "ebs.csi.aws.com8n8b8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8187-e2e-sczdbr9",
  	... // 3 identical fields
  }

Oct 13 06:52:52.475: INFO: Error updating pvc ebs.csi.aws.com8n8b8: PersistentVolumeClaim "ebs.csi.aws.com8n8b8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 148 lines ...
STEP: Creating a kubernetes client
Oct 13 06:52:19.977: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
W1013 06:52:20.796032   25262 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
Oct 13 06:52:20.796: INFO: No PodSecurityPolicies found; assuming PodSecurityPolicy is disabled.
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267
Oct 13 06:52:21.062: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
Oct 13 06:52:21.062: INFO: Creating resource for dynamic PV
Oct 13 06:52:21.062: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-6551srdzc
STEP: creating a claim
Oct 13 06:52:21.195: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-f54n
STEP: Checking for subpath error in container status
Oct 13 06:52:45.911: INFO: Deleting pod "pod-subpath-test-dynamicpv-f54n" in namespace "provisioning-6551"
Oct 13 06:52:46.048: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-f54n" to be fully deleted
STEP: Deleting pod
Oct 13 06:52:50.316: INFO: Deleting pod "pod-subpath-test-dynamicpv-f54n" in namespace "provisioning-6551"
STEP: Deleting pvc
Oct 13 06:52:50.716: INFO: Deleting PersistentVolumeClaim "awsl8jsd"
... skipping 12 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (default fs)] subPath
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][Feature:Windows] volume-expand
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 06:53:01.796: INFO: Driver ebs.csi.aws.com doesn't support ntfs -- skipping
[AfterEach] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][Feature:Windows] volume-expand
... skipping 240 lines ...
Oct 13 06:52:24.004: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
STEP: creating a test aws volume
Oct 13 06:52:24.875: INFO: Successfully created a new PD: "aws://ap-northeast-1a/vol-0b7a993fb57942710".
Oct 13 06:52:24.875: INFO: Creating resource for inline volume
STEP: Creating pod exec-volume-test-inlinevolume-ndlp
STEP: Creating a pod to test exec-volume-test
Oct 13 06:52:25.013: INFO: Waiting up to 5m0s for pod "exec-volume-test-inlinevolume-ndlp" in namespace "volume-6482" to be "Succeeded or Failed"
Oct 13 06:52:25.149: INFO: Pod "exec-volume-test-inlinevolume-ndlp": Phase="Pending", Reason="", readiness=false. Elapsed: 135.88223ms
Oct 13 06:52:27.286: INFO: Pod "exec-volume-test-inlinevolume-ndlp": Phase="Pending", Reason="", readiness=false. Elapsed: 2.273284547s
Oct 13 06:52:29.423: INFO: Pod "exec-volume-test-inlinevolume-ndlp": Phase="Pending", Reason="", readiness=false. Elapsed: 4.410005863s
Oct 13 06:52:31.560: INFO: Pod "exec-volume-test-inlinevolume-ndlp": Phase="Pending", Reason="", readiness=false. Elapsed: 6.547208018s
Oct 13 06:52:33.698: INFO: Pod "exec-volume-test-inlinevolume-ndlp": Phase="Pending", Reason="", readiness=false. Elapsed: 8.684702224s
Oct 13 06:52:35.835: INFO: Pod "exec-volume-test-inlinevolume-ndlp": Phase="Pending", Reason="", readiness=false. Elapsed: 10.822175134s
... skipping 2 lines ...
Oct 13 06:52:42.245: INFO: Pod "exec-volume-test-inlinevolume-ndlp": Phase="Pending", Reason="", readiness=false. Elapsed: 17.23223595s
Oct 13 06:52:44.385: INFO: Pod "exec-volume-test-inlinevolume-ndlp": Phase="Pending", Reason="", readiness=false. Elapsed: 19.372503737s
Oct 13 06:52:46.523: INFO: Pod "exec-volume-test-inlinevolume-ndlp": Phase="Pending", Reason="", readiness=false. Elapsed: 21.509689793s
Oct 13 06:52:48.660: INFO: Pod "exec-volume-test-inlinevolume-ndlp": Phase="Pending", Reason="", readiness=false. Elapsed: 23.647580112s
Oct 13 06:52:50.797: INFO: Pod "exec-volume-test-inlinevolume-ndlp": Phase="Succeeded", Reason="", readiness=false. Elapsed: 25.784333668s
STEP: Saw pod success
Oct 13 06:52:50.797: INFO: Pod "exec-volume-test-inlinevolume-ndlp" satisfied condition "Succeeded or Failed"
Oct 13 06:52:50.934: INFO: Trying to get logs from node ip-172-20-58-88.ap-northeast-1.compute.internal pod exec-volume-test-inlinevolume-ndlp container exec-container-inlinevolume-ndlp: <nil>
STEP: delete the pod
Oct 13 06:52:51.368: INFO: Waiting for pod exec-volume-test-inlinevolume-ndlp to disappear
Oct 13 06:52:51.504: INFO: Pod exec-volume-test-inlinevolume-ndlp no longer exists
STEP: Deleting pod exec-volume-test-inlinevolume-ndlp
Oct 13 06:52:51.504: INFO: Deleting pod "exec-volume-test-inlinevolume-ndlp" in namespace "volume-6482"
Oct 13 06:52:51.922: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0b7a993fb57942710", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0b7a993fb57942710 is currently attached to i-0460ca87765676457
	status code: 400, request id: bb9dd88d-a23c-4df3-8138-686e618fcef3
Oct 13 06:52:57.698: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0b7a993fb57942710", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0b7a993fb57942710 is currently attached to i-0460ca87765676457
	status code: 400, request id: 9b30f0a4-49d3-4f75-827b-e315947ce222
Oct 13 06:53:03.366: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0b7a993fb57942710", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0b7a993fb57942710 is currently attached to i-0460ca87765676457
	status code: 400, request id: 37112f77-dd9d-499e-b0f9-68cd4405a30f
Oct 13 06:53:09.148: INFO: Successfully deleted PD "aws://ap-northeast-1a/vol-0b7a993fb57942710".
[AfterEach] [Testpattern: Inline-volume (default fs)] volumes
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 06:53:09.149: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-6482" for this suite.
... skipping 100 lines ...
Oct 13 06:52:34.955: INFO: PersistentVolumeClaim pvc-ccqzq found but phase is Pending instead of Bound.
Oct 13 06:52:37.090: INFO: PersistentVolumeClaim pvc-ccqzq found and phase=Bound (12.944100068s)
Oct 13 06:52:37.090: INFO: Waiting up to 3m0s for PersistentVolume aws-9pfg4 to have phase Bound
Oct 13 06:52:37.224: INFO: PersistentVolume aws-9pfg4 found and phase=Bound (134.148374ms)
STEP: Creating pod exec-volume-test-preprovisionedpv-qw9r
STEP: Creating a pod to test exec-volume-test
Oct 13 06:52:37.676: INFO: Waiting up to 5m0s for pod "exec-volume-test-preprovisionedpv-qw9r" in namespace "volume-5828" to be "Succeeded or Failed"
Oct 13 06:52:37.811: INFO: Pod "exec-volume-test-preprovisionedpv-qw9r": Phase="Pending", Reason="", readiness=false. Elapsed: 134.605548ms
Oct 13 06:52:39.946: INFO: Pod "exec-volume-test-preprovisionedpv-qw9r": Phase="Pending", Reason="", readiness=false. Elapsed: 2.269387278s
Oct 13 06:52:42.080: INFO: Pod "exec-volume-test-preprovisionedpv-qw9r": Phase="Pending", Reason="", readiness=false. Elapsed: 4.404006512s
Oct 13 06:52:44.218: INFO: Pod "exec-volume-test-preprovisionedpv-qw9r": Phase="Pending", Reason="", readiness=false. Elapsed: 6.541251984s
Oct 13 06:52:46.353: INFO: Pod "exec-volume-test-preprovisionedpv-qw9r": Phase="Pending", Reason="", readiness=false. Elapsed: 8.6763203s
Oct 13 06:52:48.488: INFO: Pod "exec-volume-test-preprovisionedpv-qw9r": Phase="Pending", Reason="", readiness=false. Elapsed: 10.811218115s
Oct 13 06:52:50.623: INFO: Pod "exec-volume-test-preprovisionedpv-qw9r": Phase="Pending", Reason="", readiness=false. Elapsed: 12.946340933s
Oct 13 06:52:52.762: INFO: Pod "exec-volume-test-preprovisionedpv-qw9r": Phase="Succeeded", Reason="", readiness=false. Elapsed: 15.085309579s
STEP: Saw pod success
Oct 13 06:52:52.762: INFO: Pod "exec-volume-test-preprovisionedpv-qw9r" satisfied condition "Succeeded or Failed"
Oct 13 06:52:52.896: INFO: Trying to get logs from node ip-172-20-58-88.ap-northeast-1.compute.internal pod exec-volume-test-preprovisionedpv-qw9r container exec-container-preprovisionedpv-qw9r: <nil>
STEP: delete the pod
Oct 13 06:52:53.170: INFO: Waiting for pod exec-volume-test-preprovisionedpv-qw9r to disappear
Oct 13 06:52:53.306: INFO: Pod exec-volume-test-preprovisionedpv-qw9r no longer exists
STEP: Deleting pod exec-volume-test-preprovisionedpv-qw9r
Oct 13 06:52:53.306: INFO: Deleting pod "exec-volume-test-preprovisionedpv-qw9r" in namespace "volume-5828"
STEP: Deleting pv and pvc
Oct 13 06:52:53.444: INFO: Deleting PersistentVolumeClaim "pvc-ccqzq"
Oct 13 06:52:53.580: INFO: Deleting PersistentVolume "aws-9pfg4"
Oct 13 06:52:53.963: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0745b311ffdd4125e", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0745b311ffdd4125e is currently attached to i-0460ca87765676457
	status code: 400, request id: 26055c0e-3349-4f21-aa2c-6f9cdd0b492e
Oct 13 06:52:59.744: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0745b311ffdd4125e", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0745b311ffdd4125e is currently attached to i-0460ca87765676457
	status code: 400, request id: 299d5a21-16db-4119-ac67-fea7fab973a5
Oct 13 06:53:05.406: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0745b311ffdd4125e", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0745b311ffdd4125e is currently attached to i-0460ca87765676457
	status code: 400, request id: 9e15d296-7907-474a-a966-2eeb3ade47b4
Oct 13 06:53:11.161: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0745b311ffdd4125e", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0745b311ffdd4125e is currently attached to i-0460ca87765676457
	status code: 400, request id: 1e3c70f0-c1cc-4602-b725-ef2672af3ede
Oct 13 06:53:16.942: INFO: Successfully deleted PD "aws://ap-northeast-1a/vol-0745b311ffdd4125e".
[AfterEach] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 06:53:16.942: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-5828" for this suite.
... skipping 377 lines ...
STEP: Creating a kubernetes client
Oct 13 06:52:20.039: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
W1013 06:52:21.266701   25397 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
Oct 13 06:52:21.266: INFO: No PodSecurityPolicies found; assuming PodSecurityPolicy is disabled.
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail if subpath directory is outside the volume [Slow][LinuxOnly]
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240
Oct 13 06:52:21.537: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
Oct 13 06:52:21.537: INFO: Creating resource for dynamic PV
Oct 13 06:52:21.537: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-8569tjb9
STEP: creating a claim
Oct 13 06:52:21.718: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-bwrn
STEP: Checking for subpath error in container status
Oct 13 06:52:44.419: INFO: Deleting pod "pod-subpath-test-dynamicpv-bwrn" in namespace "provisioning-856"
Oct 13 06:52:44.556: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-bwrn" to be fully deleted
STEP: Deleting pod
Oct 13 06:52:50.827: INFO: Deleting pod "pod-subpath-test-dynamicpv-bwrn" in namespace "provisioning-856"
STEP: Deleting pvc
Oct 13 06:52:51.332: INFO: Deleting PersistentVolumeClaim "awszkmbs"
... skipping 16 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (default fs)] subPath
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath directory is outside the volume [Slow][LinuxOnly]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volume-expand
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 06:53:22.987: INFO: Driver ebs.csi.aws.com doesn't support ntfs -- skipping
[AfterEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volume-expand
... skipping 21 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to use a volume in a pod with mismatched mode [Slow] [BeforeEach]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296

    Driver "ebs.csi.aws.com" does not support volume type "PreprovisionedPV" - skipping

    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 132 lines ...
STEP: Creating a kubernetes client
Oct 13 06:52:19.895: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
W1013 06:52:20.759341   25192 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
Oct 13 06:52:20.759: INFO: No PodSecurityPolicies found; assuming PodSecurityPolicy is disabled.
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail if subpath file is outside the volume [Slow][LinuxOnly]
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256
Oct 13 06:52:21.029: INFO: Creating resource for dynamic PV
Oct 13 06:52:21.030: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-2505-e2e-scvf9wv
STEP: creating a claim
Oct 13 06:52:21.167: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-wtlr
STEP: Checking for subpath error in container status
Oct 13 06:52:51.904: INFO: Deleting pod "pod-subpath-test-dynamicpv-wtlr" in namespace "provisioning-2505"
Oct 13 06:52:52.042: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-wtlr" to be fully deleted
STEP: Deleting pod
Oct 13 06:52:56.316: INFO: Deleting pod "pod-subpath-test-dynamicpv-wtlr" in namespace "provisioning-2505"
STEP: Deleting pvc
Oct 13 06:52:56.723: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.com6r8t6"
... skipping 15 lines ...

• [SLOW TEST:73.611 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath file is outside the volume [Slow][LinuxOnly]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
... skipping 231 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if non-existent subpath is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267

      Driver supports dynamic provisioning, skipping PreprovisionedPV pattern

      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:233
------------------------------
... skipping 37 lines ...
Oct 13 06:52:23.644: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-23247pg25
STEP: creating a claim
Oct 13 06:52:23.778: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-8c4c
STEP: Creating a pod to test atomic-volume-subpath
Oct 13 06:52:24.185: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-8c4c" in namespace "provisioning-2324" to be "Succeeded or Failed"
Oct 13 06:52:24.319: INFO: Pod "pod-subpath-test-dynamicpv-8c4c": Phase="Pending", Reason="", readiness=false. Elapsed: 134.246885ms
Oct 13 06:52:26.470: INFO: Pod "pod-subpath-test-dynamicpv-8c4c": Phase="Pending", Reason="", readiness=false. Elapsed: 2.285611418s
Oct 13 06:52:28.606: INFO: Pod "pod-subpath-test-dynamicpv-8c4c": Phase="Pending", Reason="", readiness=false. Elapsed: 4.421146749s
Oct 13 06:52:30.740: INFO: Pod "pod-subpath-test-dynamicpv-8c4c": Phase="Pending", Reason="", readiness=false. Elapsed: 6.555654368s
Oct 13 06:52:32.875: INFO: Pod "pod-subpath-test-dynamicpv-8c4c": Phase="Pending", Reason="", readiness=false. Elapsed: 8.690242569s
Oct 13 06:52:35.010: INFO: Pod "pod-subpath-test-dynamicpv-8c4c": Phase="Pending", Reason="", readiness=false. Elapsed: 10.824874931s
... skipping 12 lines ...
Oct 13 06:53:02.778: INFO: Pod "pod-subpath-test-dynamicpv-8c4c": Phase="Running", Reason="", readiness=true. Elapsed: 38.593269403s
Oct 13 06:53:04.912: INFO: Pod "pod-subpath-test-dynamicpv-8c4c": Phase="Running", Reason="", readiness=true. Elapsed: 40.727746545s
Oct 13 06:53:07.047: INFO: Pod "pod-subpath-test-dynamicpv-8c4c": Phase="Running", Reason="", readiness=true. Elapsed: 42.86243335s
Oct 13 06:53:09.183: INFO: Pod "pod-subpath-test-dynamicpv-8c4c": Phase="Running", Reason="", readiness=true. Elapsed: 44.997995657s
Oct 13 06:53:11.319: INFO: Pod "pod-subpath-test-dynamicpv-8c4c": Phase="Succeeded", Reason="", readiness=false. Elapsed: 47.13418777s
STEP: Saw pod success
Oct 13 06:53:11.319: INFO: Pod "pod-subpath-test-dynamicpv-8c4c" satisfied condition "Succeeded or Failed"
Oct 13 06:53:11.453: INFO: Trying to get logs from node ip-172-20-43-128.ap-northeast-1.compute.internal pod pod-subpath-test-dynamicpv-8c4c container test-container-subpath-dynamicpv-8c4c: <nil>
STEP: delete the pod
Oct 13 06:53:11.731: INFO: Waiting for pod pod-subpath-test-dynamicpv-8c4c to disappear
Oct 13 06:53:11.865: INFO: Pod pod-subpath-test-dynamicpv-8c4c no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-8c4c
Oct 13 06:53:11.865: INFO: Deleting pod "pod-subpath-test-dynamicpv-8c4c" in namespace "provisioning-2324"
... skipping 123 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Inline-volume (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath directory is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240

    Driver "ebs.csi.aws.com" does not support volume type "InlineVolume" - skipping

    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 89 lines ...
Oct 13 06:53:27.435: INFO: Waiting for pod aws-client to disappear
Oct 13 06:53:27.588: INFO: Pod aws-client no longer exists
STEP: cleaning the environment after aws
STEP: Deleting pv and pvc
Oct 13 06:53:27.588: INFO: Deleting PersistentVolumeClaim "pvc-t8jmh"
Oct 13 06:53:27.732: INFO: Deleting PersistentVolume "aws-k5pfj"
Oct 13 06:53:28.249: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-00c895b727eb7b735", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-00c895b727eb7b735 is currently attached to i-055639418da30da5f
	status code: 400, request id: 534ce411-49db-4041-a421-6849ff9842f6
Oct 13 06:53:33.927: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-00c895b727eb7b735", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-00c895b727eb7b735 is currently attached to i-055639418da30da5f
	status code: 400, request id: 22116976-432a-4555-beac-9e762fe67e87
Oct 13 06:53:39.637: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-00c895b727eb7b735", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-00c895b727eb7b735 is currently attached to i-055639418da30da5f
	status code: 400, request id: b5b99389-2abf-41c0-b852-4763e20a7ab2
Oct 13 06:53:45.354: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-00c895b727eb7b735", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-00c895b727eb7b735 is currently attached to i-055639418da30da5f
	status code: 400, request id: 30f3c677-27d3-4230-a327-836ab0cc7f5a
Oct 13 06:53:51.062: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-00c895b727eb7b735", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-00c895b727eb7b735 is currently attached to i-055639418da30da5f
	status code: 400, request id: 62dcae2d-2b37-4572-a887-f9745f47cccc
Oct 13 06:53:56.780: INFO: Successfully deleted PD "aws://ap-northeast-1a/vol-00c895b727eb7b735".
[AfterEach] [Testpattern: Pre-provisioned PV (block volmode)] volumes
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 06:53:56.780: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-4990" for this suite.
... skipping 442 lines ...
Oct 13 06:52:21.065: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-2949-e2e-sc7fx7j
STEP: creating a claim
Oct 13 06:52:21.201: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-v5fj
STEP: Creating a pod to test subpath
Oct 13 06:52:21.619: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-v5fj" in namespace "provisioning-2949" to be "Succeeded or Failed"
Oct 13 06:52:21.780: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Pending", Reason="", readiness=false. Elapsed: 160.693938ms
Oct 13 06:52:23.918: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.298371614s
Oct 13 06:52:26.053: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.433565345s
Oct 13 06:52:28.188: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.568817236s
Oct 13 06:52:30.323: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.704160863s
Oct 13 06:52:32.459: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Pending", Reason="", readiness=false. Elapsed: 10.840152525s
... skipping 2 lines ...
Oct 13 06:52:38.866: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Pending", Reason="", readiness=false. Elapsed: 17.246538816s
Oct 13 06:52:41.009: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Pending", Reason="", readiness=false. Elapsed: 19.389798129s
Oct 13 06:52:43.144: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Pending", Reason="", readiness=false. Elapsed: 21.525034078s
Oct 13 06:52:45.282: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Pending", Reason="", readiness=false. Elapsed: 23.66240179s
Oct 13 06:52:47.431: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 25.811884427s
STEP: Saw pod success
Oct 13 06:52:47.431: INFO: Pod "pod-subpath-test-dynamicpv-v5fj" satisfied condition "Succeeded or Failed"
Oct 13 06:52:47.567: INFO: Trying to get logs from node ip-172-20-58-88.ap-northeast-1.compute.internal pod pod-subpath-test-dynamicpv-v5fj container test-container-subpath-dynamicpv-v5fj: <nil>
STEP: delete the pod
Oct 13 06:52:48.432: INFO: Waiting for pod pod-subpath-test-dynamicpv-v5fj to disappear
Oct 13 06:52:48.566: INFO: Pod pod-subpath-test-dynamicpv-v5fj no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-v5fj
Oct 13 06:52:48.566: INFO: Deleting pod "pod-subpath-test-dynamicpv-v5fj" in namespace "provisioning-2949"
STEP: Creating pod pod-subpath-test-dynamicpv-v5fj
STEP: Creating a pod to test subpath
Oct 13 06:52:48.836: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-v5fj" in namespace "provisioning-2949" to be "Succeeded or Failed"
Oct 13 06:52:48.971: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Pending", Reason="", readiness=false. Elapsed: 134.340445ms
Oct 13 06:52:51.179: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.342696759s
Oct 13 06:52:53.320: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.483128943s
Oct 13 06:52:55.455: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.618420804s
Oct 13 06:52:57.592: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.755642637s
Oct 13 06:52:59.730: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Pending", Reason="", readiness=false. Elapsed: 10.89326821s
Oct 13 06:53:01.866: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Pending", Reason="", readiness=false. Elapsed: 13.029869016s
Oct 13 06:53:04.003: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Pending", Reason="", readiness=false. Elapsed: 15.166275692s
Oct 13 06:53:06.139: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Pending", Reason="", readiness=false. Elapsed: 17.302167823s
Oct 13 06:53:08.274: INFO: Pod "pod-subpath-test-dynamicpv-v5fj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 19.437382667s
STEP: Saw pod success
Oct 13 06:53:08.274: INFO: Pod "pod-subpath-test-dynamicpv-v5fj" satisfied condition "Succeeded or Failed"
Oct 13 06:53:08.409: INFO: Trying to get logs from node ip-172-20-58-88.ap-northeast-1.compute.internal pod pod-subpath-test-dynamicpv-v5fj container test-container-subpath-dynamicpv-v5fj: <nil>
STEP: delete the pod
Oct 13 06:53:08.696: INFO: Waiting for pod pod-subpath-test-dynamicpv-v5fj to disappear
Oct 13 06:53:08.831: INFO: Pod pod-subpath-test-dynamicpv-v5fj no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-v5fj
Oct 13 06:53:08.831: INFO: Deleting pod "pod-subpath-test-dynamicpv-v5fj" in namespace "provisioning-2949"
... skipping 526 lines ...
Oct 13 06:53:49.274: INFO: PersistentVolumeClaim pvc-c8zk8 found but phase is Pending instead of Bound.
Oct 13 06:53:51.410: INFO: PersistentVolumeClaim pvc-c8zk8 found and phase=Bound (15.090295421s)
Oct 13 06:53:51.410: INFO: Waiting up to 3m0s for PersistentVolume aws-57p9d to have phase Bound
Oct 13 06:53:51.545: INFO: PersistentVolume aws-57p9d found and phase=Bound (135.493717ms)
STEP: Creating pod exec-volume-test-preprovisionedpv-wt9w
STEP: Creating a pod to test exec-volume-test
Oct 13 06:53:51.956: INFO: Waiting up to 5m0s for pod "exec-volume-test-preprovisionedpv-wt9w" in namespace "volume-4908" to be "Succeeded or Failed"
Oct 13 06:53:52.092: INFO: Pod "exec-volume-test-preprovisionedpv-wt9w": Phase="Pending", Reason="", readiness=false. Elapsed: 135.63489ms
Oct 13 06:53:54.231: INFO: Pod "exec-volume-test-preprovisionedpv-wt9w": Phase="Pending", Reason="", readiness=false. Elapsed: 2.274157792s
Oct 13 06:53:56.368: INFO: Pod "exec-volume-test-preprovisionedpv-wt9w": Phase="Pending", Reason="", readiness=false. Elapsed: 4.411214503s
Oct 13 06:53:58.504: INFO: Pod "exec-volume-test-preprovisionedpv-wt9w": Phase="Pending", Reason="", readiness=false. Elapsed: 6.54798862s
Oct 13 06:54:00.641: INFO: Pod "exec-volume-test-preprovisionedpv-wt9w": Phase="Pending", Reason="", readiness=false. Elapsed: 8.68461999s
Oct 13 06:54:02.778: INFO: Pod "exec-volume-test-preprovisionedpv-wt9w": Phase="Pending", Reason="", readiness=false. Elapsed: 10.821842659s
... skipping 2 lines ...
Oct 13 06:54:09.187: INFO: Pod "exec-volume-test-preprovisionedpv-wt9w": Phase="Pending", Reason="", readiness=false. Elapsed: 17.230502925s
Oct 13 06:54:11.323: INFO: Pod "exec-volume-test-preprovisionedpv-wt9w": Phase="Pending", Reason="", readiness=false. Elapsed: 19.366399515s
Oct 13 06:54:13.459: INFO: Pod "exec-volume-test-preprovisionedpv-wt9w": Phase="Pending", Reason="", readiness=false. Elapsed: 21.502247569s
Oct 13 06:54:15.596: INFO: Pod "exec-volume-test-preprovisionedpv-wt9w": Phase="Pending", Reason="", readiness=false. Elapsed: 23.639075903s
Oct 13 06:54:17.731: INFO: Pod "exec-volume-test-preprovisionedpv-wt9w": Phase="Succeeded", Reason="", readiness=false. Elapsed: 25.774990674s
STEP: Saw pod success
Oct 13 06:54:17.731: INFO: Pod "exec-volume-test-preprovisionedpv-wt9w" satisfied condition "Succeeded or Failed"
Oct 13 06:54:17.869: INFO: Trying to get logs from node ip-172-20-58-88.ap-northeast-1.compute.internal pod exec-volume-test-preprovisionedpv-wt9w container exec-container-preprovisionedpv-wt9w: <nil>
STEP: delete the pod
Oct 13 06:54:18.151: INFO: Waiting for pod exec-volume-test-preprovisionedpv-wt9w to disappear
Oct 13 06:54:18.287: INFO: Pod exec-volume-test-preprovisionedpv-wt9w no longer exists
STEP: Deleting pod exec-volume-test-preprovisionedpv-wt9w
Oct 13 06:54:18.287: INFO: Deleting pod "exec-volume-test-preprovisionedpv-wt9w" in namespace "volume-4908"
STEP: Deleting pv and pvc
Oct 13 06:54:18.422: INFO: Deleting PersistentVolumeClaim "pvc-c8zk8"
Oct 13 06:54:18.558: INFO: Deleting PersistentVolume "aws-57p9d"
Oct 13 06:54:19.086: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-03782bc3b9de0bbaf", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-03782bc3b9de0bbaf is currently attached to i-0460ca87765676457
	status code: 400, request id: cc0cd31f-3544-4cbb-a036-a20efc687a07
Oct 13 06:54:24.769: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-03782bc3b9de0bbaf", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-03782bc3b9de0bbaf is currently attached to i-0460ca87765676457
	status code: 400, request id: 11cfb573-e73d-4d45-afd9-ae40c39b38e0
Oct 13 06:54:30.499: INFO: Successfully deleted PD "aws://ap-northeast-1a/vol-03782bc3b9de0bbaf".
[AfterEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 06:54:30.499: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-4908" for this suite.
... skipping 24 lines ...
Oct 13 06:54:06.189: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass volume-616ttd4d
STEP: creating a claim
Oct 13 06:54:06.325: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod exec-volume-test-dynamicpv-qfm4
STEP: Creating a pod to test exec-volume-test
Oct 13 06:54:06.736: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-qfm4" in namespace "volume-616" to be "Succeeded or Failed"
Oct 13 06:54:06.871: INFO: Pod "exec-volume-test-dynamicpv-qfm4": Phase="Pending", Reason="", readiness=false. Elapsed: 135.064496ms
Oct 13 06:54:09.009: INFO: Pod "exec-volume-test-dynamicpv-qfm4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.273340889s
Oct 13 06:54:11.146: INFO: Pod "exec-volume-test-dynamicpv-qfm4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.410628007s
Oct 13 06:54:13.282: INFO: Pod "exec-volume-test-dynamicpv-qfm4": Phase="Pending", Reason="", readiness=false. Elapsed: 6.546034683s
Oct 13 06:54:15.416: INFO: Pod "exec-volume-test-dynamicpv-qfm4": Phase="Pending", Reason="", readiness=false. Elapsed: 8.680820078s
Oct 13 06:54:17.551: INFO: Pod "exec-volume-test-dynamicpv-qfm4": Phase="Pending", Reason="", readiness=false. Elapsed: 10.81559728s
Oct 13 06:54:19.686: INFO: Pod "exec-volume-test-dynamicpv-qfm4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 12.950181947s
STEP: Saw pod success
Oct 13 06:54:19.686: INFO: Pod "exec-volume-test-dynamicpv-qfm4" satisfied condition "Succeeded or Failed"
Oct 13 06:54:19.820: INFO: Trying to get logs from node ip-172-20-43-128.ap-northeast-1.compute.internal pod exec-volume-test-dynamicpv-qfm4 container exec-container-dynamicpv-qfm4: <nil>
STEP: delete the pod
Oct 13 06:54:20.096: INFO: Waiting for pod exec-volume-test-dynamicpv-qfm4 to disappear
Oct 13 06:54:20.231: INFO: Pod exec-volume-test-dynamicpv-qfm4 no longer exists
STEP: Deleting pod exec-volume-test-dynamicpv-qfm4
Oct 13 06:54:20.231: INFO: Deleting pod "exec-volume-test-dynamicpv-qfm4" in namespace "volume-616"
... skipping 325 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Pre-provisioned PV (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath directory is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240

    Driver "ebs.csi.aws.com" does not support volume type "PreprovisionedPV" - skipping

    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 56 lines ...
Oct 13 06:53:40.208: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-5953xg26t
STEP: creating a claim
Oct 13 06:53:40.343: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-dqlc
STEP: Creating a pod to test subpath
Oct 13 06:53:40.750: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-dqlc" in namespace "provisioning-5953" to be "Succeeded or Failed"
Oct 13 06:53:40.884: INFO: Pod "pod-subpath-test-dynamicpv-dqlc": Phase="Pending", Reason="", readiness=false. Elapsed: 134.672206ms
Oct 13 06:53:43.019: INFO: Pod "pod-subpath-test-dynamicpv-dqlc": Phase="Pending", Reason="", readiness=false. Elapsed: 2.269588047s
Oct 13 06:53:45.154: INFO: Pod "pod-subpath-test-dynamicpv-dqlc": Phase="Pending", Reason="", readiness=false. Elapsed: 4.404710211s
Oct 13 06:53:47.291: INFO: Pod "pod-subpath-test-dynamicpv-dqlc": Phase="Pending", Reason="", readiness=false. Elapsed: 6.540840305s
Oct 13 06:53:49.426: INFO: Pod "pod-subpath-test-dynamicpv-dqlc": Phase="Pending", Reason="", readiness=false. Elapsed: 8.67645569s
Oct 13 06:53:51.561: INFO: Pod "pod-subpath-test-dynamicpv-dqlc": Phase="Pending", Reason="", readiness=false. Elapsed: 10.811315907s
... skipping 9 lines ...
Oct 13 06:54:12.928: INFO: Pod "pod-subpath-test-dynamicpv-dqlc": Phase="Pending", Reason="", readiness=false. Elapsed: 32.178088864s
Oct 13 06:54:15.063: INFO: Pod "pod-subpath-test-dynamicpv-dqlc": Phase="Pending", Reason="", readiness=false. Elapsed: 34.313356282s
Oct 13 06:54:17.199: INFO: Pod "pod-subpath-test-dynamicpv-dqlc": Phase="Pending", Reason="", readiness=false. Elapsed: 36.449177522s
Oct 13 06:54:19.335: INFO: Pod "pod-subpath-test-dynamicpv-dqlc": Phase="Pending", Reason="", readiness=false. Elapsed: 38.584845275s
Oct 13 06:54:21.470: INFO: Pod "pod-subpath-test-dynamicpv-dqlc": Phase="Succeeded", Reason="", readiness=false. Elapsed: 40.719841894s
STEP: Saw pod success
Oct 13 06:54:21.470: INFO: Pod "pod-subpath-test-dynamicpv-dqlc" satisfied condition "Succeeded or Failed"
Oct 13 06:54:21.607: INFO: Trying to get logs from node ip-172-20-58-178.ap-northeast-1.compute.internal pod pod-subpath-test-dynamicpv-dqlc container test-container-subpath-dynamicpv-dqlc: <nil>
STEP: delete the pod
Oct 13 06:54:21.884: INFO: Waiting for pod pod-subpath-test-dynamicpv-dqlc to disappear
Oct 13 06:54:22.024: INFO: Pod pod-subpath-test-dynamicpv-dqlc no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-dqlc
Oct 13 06:54:22.024: INFO: Deleting pod "pod-subpath-test-dynamicpv-dqlc" in namespace "provisioning-5953"
... skipping 27 lines ...
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 06:53:22.314: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail if subpath directory is outside the volume [Slow][LinuxOnly]
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240
Oct 13 06:53:22.981: INFO: Creating resource for dynamic PV
Oct 13 06:53:22.981: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-6222-e2e-scpcgvm
STEP: creating a claim
Oct 13 06:53:23.116: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-v9fb
STEP: Checking for subpath error in container status
Oct 13 06:54:01.792: INFO: Deleting pod "pod-subpath-test-dynamicpv-v9fb" in namespace "provisioning-6222"
Oct 13 06:54:01.926: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-v9fb" to be fully deleted
STEP: Deleting pod
Oct 13 06:54:04.194: INFO: Deleting pod "pod-subpath-test-dynamicpv-v9fb" in namespace "provisioning-6222"
STEP: Deleting pvc
Oct 13 06:54:04.593: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comd4sll"
... skipping 15 lines ...

• [SLOW TEST:78.899 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath directory is outside the volume [Slow][LinuxOnly]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 06:54:41.215: INFO: Driver ebs.csi.aws.com doesn't support ntfs -- skipping
[AfterEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
... skipping 44 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath file is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256

      Distro debian doesn't support ntfs -- skipping

      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:127
------------------------------
... skipping 96 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Pre-provisioned PV (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if non-existent subpath is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267

    Driver "ebs.csi.aws.com" does not support volume type "PreprovisionedPV" - skipping

    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 219 lines ...
Oct 13 06:53:53.969: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
STEP: creating a test aws volume
Oct 13 06:53:54.850: INFO: Successfully created a new PD: "aws://ap-northeast-1a/vol-09734bcdd3b84d83b".
Oct 13 06:53:54.850: INFO: Creating resource for inline volume
STEP: Creating pod exec-volume-test-inlinevolume-t94c
STEP: Creating a pod to test exec-volume-test
Oct 13 06:53:54.987: INFO: Waiting up to 5m0s for pod "exec-volume-test-inlinevolume-t94c" in namespace "volume-8910" to be "Succeeded or Failed"
Oct 13 06:53:55.122: INFO: Pod "exec-volume-test-inlinevolume-t94c": Phase="Pending", Reason="", readiness=false. Elapsed: 134.900699ms
Oct 13 06:53:57.256: INFO: Pod "exec-volume-test-inlinevolume-t94c": Phase="Pending", Reason="", readiness=false. Elapsed: 2.269488059s
Oct 13 06:53:59.391: INFO: Pod "exec-volume-test-inlinevolume-t94c": Phase="Pending", Reason="", readiness=false. Elapsed: 4.403743191s
Oct 13 06:54:01.526: INFO: Pod "exec-volume-test-inlinevolume-t94c": Phase="Pending", Reason="", readiness=false. Elapsed: 6.539262442s
Oct 13 06:54:03.660: INFO: Pod "exec-volume-test-inlinevolume-t94c": Phase="Pending", Reason="", readiness=false. Elapsed: 8.673401576s
Oct 13 06:54:05.794: INFO: Pod "exec-volume-test-inlinevolume-t94c": Phase="Pending", Reason="", readiness=false. Elapsed: 10.807564644s
... skipping 8 lines ...
Oct 13 06:54:25.015: INFO: Pod "exec-volume-test-inlinevolume-t94c": Phase="Pending", Reason="", readiness=false. Elapsed: 30.028260564s
Oct 13 06:54:27.151: INFO: Pod "exec-volume-test-inlinevolume-t94c": Phase="Pending", Reason="", readiness=false. Elapsed: 32.163879273s
Oct 13 06:54:29.293: INFO: Pod "exec-volume-test-inlinevolume-t94c": Phase="Pending", Reason="", readiness=false. Elapsed: 34.306295119s
Oct 13 06:54:31.427: INFO: Pod "exec-volume-test-inlinevolume-t94c": Phase="Pending", Reason="", readiness=false. Elapsed: 36.44055063s
Oct 13 06:54:33.562: INFO: Pod "exec-volume-test-inlinevolume-t94c": Phase="Succeeded", Reason="", readiness=false. Elapsed: 38.574708985s
STEP: Saw pod success
Oct 13 06:54:33.562: INFO: Pod "exec-volume-test-inlinevolume-t94c" satisfied condition "Succeeded or Failed"
Oct 13 06:54:33.697: INFO: Trying to get logs from node ip-172-20-58-88.ap-northeast-1.compute.internal pod exec-volume-test-inlinevolume-t94c container exec-container-inlinevolume-t94c: <nil>
STEP: delete the pod
Oct 13 06:54:33.974: INFO: Waiting for pod exec-volume-test-inlinevolume-t94c to disappear
Oct 13 06:54:34.107: INFO: Pod exec-volume-test-inlinevolume-t94c no longer exists
STEP: Deleting pod exec-volume-test-inlinevolume-t94c
Oct 13 06:54:34.107: INFO: Deleting pod "exec-volume-test-inlinevolume-t94c" in namespace "volume-8910"
Oct 13 06:54:34.505: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-09734bcdd3b84d83b", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-09734bcdd3b84d83b is currently attached to i-0460ca87765676457
	status code: 400, request id: fb18073c-2d72-4d35-9824-3ca2cf06da36
Oct 13 06:54:40.238: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-09734bcdd3b84d83b", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-09734bcdd3b84d83b is currently attached to i-0460ca87765676457
	status code: 400, request id: 15f4ccf9-b6e9-4dd0-be95-ca33f257d08a
Oct 13 06:54:46.012: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-09734bcdd3b84d83b", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-09734bcdd3b84d83b is currently attached to i-0460ca87765676457
	status code: 400, request id: 85da3b28-a7b0-4aa4-9725-5ff9d456a0b1
Oct 13 06:54:51.728: INFO: Successfully deleted PD "aws://ap-northeast-1a/vol-09734bcdd3b84d83b".
[AfterEach] [Testpattern: Inline-volume (ext4)] volumes
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 06:54:51.729: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-8910" for this suite.
... skipping 14 lines ...
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 06:54:26.511: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename volumemode
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to use a volume in a pod with mismatched mode [Slow]
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
Oct 13 06:54:27.192: INFO: Creating resource for dynamic PV
Oct 13 06:54:27.192: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass volumemode-1844-e2e-scq4jhz
STEP: creating a claim
STEP: Creating pod
STEP: Waiting for the pod to fail
Oct 13 06:54:34.150: INFO: Deleting pod "pod-407fae7c-d9ed-44df-9b63-f93cc11daa26" in namespace "volumemode-1844"
Oct 13 06:54:34.287: INFO: Wait up to 5m0s for pod "pod-407fae7c-d9ed-44df-9b63-f93cc11daa26" to be fully deleted
STEP: Deleting pvc
Oct 13 06:54:36.836: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comxdt2s"
Oct 13 06:54:36.972: INFO: Waiting up to 5m0s for PersistentVolume pvc-ea193d82-9647-4356-9ce1-51c5bc68c323 to get deleted
Oct 13 06:54:37.108: INFO: PersistentVolume pvc-ea193d82-9647-4356-9ce1-51c5bc68c323 found and phase=Released (136.222143ms)
... skipping 9 lines ...

• [SLOW TEST:26.440 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to use a volume in a pod with mismatched mode [Slow]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 06:54:21.855: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename volumemode
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to use a volume in a pod with mismatched mode [Slow]
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
Oct 13 06:54:22.563: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
STEP: creating a test aws volume
Oct 13 06:54:23.483: INFO: Successfully created a new PD: "aws://ap-northeast-1a/vol-025e1bf2aab6a1084".
Oct 13 06:54:23.483: INFO: Creating resource for pre-provisioned PV
Oct 13 06:54:23.483: INFO: Creating PVC and PV
... skipping 7 lines ...
Oct 13 06:54:32.442: INFO: PersistentVolumeClaim pvc-9npzs found but phase is Pending instead of Bound.
Oct 13 06:54:34.579: INFO: PersistentVolumeClaim pvc-9npzs found but phase is Pending instead of Bound.
Oct 13 06:54:36.715: INFO: PersistentVolumeClaim pvc-9npzs found and phase=Bound (12.957722234s)
Oct 13 06:54:36.715: INFO: Waiting up to 3m0s for PersistentVolume aws-hxfhb to have phase Bound
Oct 13 06:54:36.854: INFO: PersistentVolume aws-hxfhb found and phase=Bound (138.49657ms)
STEP: Creating pod
STEP: Waiting for the pod to fail
Oct 13 06:54:39.685: INFO: Deleting pod "pod-0595cfe2-c128-4f4b-8d87-732d31f003b8" in namespace "volumemode-2631"
Oct 13 06:54:39.822: INFO: Wait up to 5m0s for pod "pod-0595cfe2-c128-4f4b-8d87-732d31f003b8" to be fully deleted
STEP: Deleting pv and pvc
Oct 13 06:54:42.095: INFO: Deleting PersistentVolumeClaim "pvc-9npzs"
Oct 13 06:54:42.232: INFO: Deleting PersistentVolume "aws-hxfhb"
Oct 13 06:54:42.700: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-025e1bf2aab6a1084", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-025e1bf2aab6a1084 is currently attached to i-02fdeb7a9f14cee48
	status code: 400, request id: bec148cc-3b2c-4fc0-99e3-487182ec351d
Oct 13 06:54:48.400: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-025e1bf2aab6a1084", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-025e1bf2aab6a1084 is currently attached to i-02fdeb7a9f14cee48
	status code: 400, request id: 2f1e8bbe-d92d-4722-84f6-2ee57fd022c2
Oct 13 06:54:54.232: INFO: Successfully deleted PD "aws://ap-northeast-1a/vol-025e1bf2aab6a1084".
[AfterEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 06:54:54.232: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volumemode-2631" for this suite.
... skipping 3 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to use a volume in a pod with mismatched mode [Slow]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][Feature:Windows] volume-expand
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 06:54:54.508: INFO: Distro debian doesn't support ntfs -- skipping
[AfterEach] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][Feature:Windows] volume-expand
... skipping 100 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278

    Driver ebs.csi.aws.com doesn't support ntfs -- skipping

    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:121
------------------------------
... skipping 118 lines ...
Oct 13 06:53:59.783: INFO: In creating storage class object and pvc objects for driver - sc: &StorageClass{ObjectMeta:{provisioning-7367-e2e-scz7ltq      0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] []  []},Provisioner:ebs.csi.aws.com,Parameters:map[string]string{},ReclaimPolicy:nil,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*WaitForFirstConsumer,AllowedTopologies:[]TopologySelectorTerm{},}, pvc: &PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-7367    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] []  []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1073741824 0} {<nil>} 1Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-7367-e2e-scz7ltq,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},}, src-pvc: &PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-7367    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] []  []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1073741824 0} {<nil>} 1Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-7367-e2e-scz7ltq,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},}
STEP: Creating a StorageClass
STEP: creating claim=&PersistentVolumeClaim{ObjectMeta:{ pvc- provisioning-7367    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] []  []},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1073741824 0} {<nil>} 1Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-7367-e2e-scz7ltq,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},}
STEP: creating a pod referring to the class=&StorageClass{ObjectMeta:{provisioning-7367-e2e-scz7ltq    db9dd521-e530-4a38-90cf-08e6c809be56 5528 0 2021-10-13 06:53:59 +0000 UTC <nil> <nil> map[] map[] [] []  [{e2e-kubernetes.test Update storage.k8s.io/v1 2021-10-13 06:53:59 +0000 UTC FieldsV1 {"f:mountOptions":{},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:ebs.csi.aws.com,Parameters:map[string]string{},ReclaimPolicy:*Delete,MountOptions:[dirsync],AllowVolumeExpansion:nil,VolumeBindingMode:*WaitForFirstConsumer,AllowedTopologies:[]TopologySelectorTerm{},} claim=&PersistentVolumeClaim{ObjectMeta:{pvc-vmtls pvc- provisioning-7367  c7042354-e084-49c5-b06d-23a717e05f1f 5534 0 2021-10-13 06:54:00 +0000 UTC <nil> <nil> map[] map[] [] [kubernetes.io/pvc-protection]  [{e2e-kubernetes.test Update v1 2021-10-13 06:54:00 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:storageClassName":{},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1073741824 0} {<nil>} 1Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*provisioning-7367-e2e-scz7ltq,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},}
STEP: Deleting pod pod-76cdd32a-4880-47aa-ac6b-00ec63169848 in namespace provisioning-7367
STEP: checking the created volume is writable on node {Name: Selector:map[] Affinity:nil}
Oct 13 06:54:15.277: INFO: Waiting up to 15m0s for pod "pvc-volume-tester-writer-6fth7" in namespace "provisioning-7367" to be "Succeeded or Failed"
Oct 13 06:54:15.412: INFO: Pod "pvc-volume-tester-writer-6fth7": Phase="Pending", Reason="", readiness=false. Elapsed: 134.902204ms
Oct 13 06:54:17.547: INFO: Pod "pvc-volume-tester-writer-6fth7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.27037974s
Oct 13 06:54:19.682: INFO: Pod "pvc-volume-tester-writer-6fth7": Phase="Pending", Reason="", readiness=false. Elapsed: 4.405758986s
Oct 13 06:54:21.818: INFO: Pod "pvc-volume-tester-writer-6fth7": Phase="Pending", Reason="", readiness=false. Elapsed: 6.541727076s
Oct 13 06:54:23.955: INFO: Pod "pvc-volume-tester-writer-6fth7": Phase="Pending", Reason="", readiness=false. Elapsed: 8.678428798s
Oct 13 06:54:26.091: INFO: Pod "pvc-volume-tester-writer-6fth7": Phase="Pending", Reason="", readiness=false. Elapsed: 10.813913441s
... skipping 6 lines ...
Oct 13 06:54:41.044: INFO: Pod "pvc-volume-tester-writer-6fth7": Phase="Pending", Reason="", readiness=false. Elapsed: 25.767041409s
Oct 13 06:54:43.180: INFO: Pod "pvc-volume-tester-writer-6fth7": Phase="Pending", Reason="", readiness=false. Elapsed: 27.903489114s
Oct 13 06:54:45.316: INFO: Pod "pvc-volume-tester-writer-6fth7": Phase="Pending", Reason="", readiness=false. Elapsed: 30.039431678s
Oct 13 06:54:47.452: INFO: Pod "pvc-volume-tester-writer-6fth7": Phase="Pending", Reason="", readiness=false. Elapsed: 32.174942765s
Oct 13 06:54:49.587: INFO: Pod "pvc-volume-tester-writer-6fth7": Phase="Succeeded", Reason="", readiness=false. Elapsed: 34.310679504s
STEP: Saw pod success
Oct 13 06:54:49.587: INFO: Pod "pvc-volume-tester-writer-6fth7" satisfied condition "Succeeded or Failed"
Oct 13 06:54:49.872: INFO: Pod pvc-volume-tester-writer-6fth7 has the following logs: 
Oct 13 06:54:49.872: INFO: Deleting pod "pvc-volume-tester-writer-6fth7" in namespace "provisioning-7367"
Oct 13 06:54:50.012: INFO: Wait up to 5m0s for pod "pvc-volume-tester-writer-6fth7" to be fully deleted
STEP: checking the created volume has the correct mount options, is readable and retains data on the same node "ip-172-20-32-238.ap-northeast-1.compute.internal"
Oct 13 06:54:50.555: INFO: Waiting up to 15m0s for pod "pvc-volume-tester-reader-lfk9b" in namespace "provisioning-7367" to be "Succeeded or Failed"
Oct 13 06:54:50.690: INFO: Pod "pvc-volume-tester-reader-lfk9b": Phase="Pending", Reason="", readiness=false. Elapsed: 135.099928ms
Oct 13 06:54:52.831: INFO: Pod "pvc-volume-tester-reader-lfk9b": Phase="Pending", Reason="", readiness=false. Elapsed: 2.276098719s
Oct 13 06:54:54.966: INFO: Pod "pvc-volume-tester-reader-lfk9b": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.411770772s
STEP: Saw pod success
Oct 13 06:54:54.966: INFO: Pod "pvc-volume-tester-reader-lfk9b" satisfied condition "Succeeded or Failed"
Oct 13 06:54:55.239: INFO: Pod pvc-volume-tester-reader-lfk9b has the following logs: hello world

Oct 13 06:54:55.239: INFO: Deleting pod "pvc-volume-tester-reader-lfk9b" in namespace "provisioning-7367"
Oct 13 06:54:55.382: INFO: Wait up to 5m0s for pod "pvc-volume-tester-reader-lfk9b" to be fully deleted
Oct 13 06:54:55.517: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-vmtls] to have phase Bound
Oct 13 06:54:55.652: INFO: PersistentVolumeClaim pvc-vmtls found and phase=Bound (134.923457ms)
... skipping 196 lines ...
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 06:54:43.399: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267
Oct 13 06:54:44.082: INFO: Creating resource for dynamic PV
Oct 13 06:54:44.082: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-6667-e2e-scgpczz
STEP: creating a claim
Oct 13 06:54:44.220: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-md9x
STEP: Checking for subpath error in container status
Oct 13 06:54:56.909: INFO: Deleting pod "pod-subpath-test-dynamicpv-md9x" in namespace "provisioning-6667"
Oct 13 06:54:57.046: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-md9x" to be fully deleted
STEP: Deleting pod
Oct 13 06:54:59.320: INFO: Deleting pod "pod-subpath-test-dynamicpv-md9x" in namespace "provisioning-6667"
STEP: Deleting pvc
Oct 13 06:54:59.730: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comlcb87"
... skipping 11 lines ...

• [SLOW TEST:32.424 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if non-existent subpath is outside the volume [Slow][LinuxOnly]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267
------------------------------
SS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 06:54:54.511: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename volumemode
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to use a volume in a pod with mismatched mode [Slow]
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
Oct 13 06:54:55.191: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
STEP: creating a test aws volume
Oct 13 06:54:55.631: INFO: Successfully created a new PD: "aws://ap-northeast-1a/vol-0c1aff4b67b5186ec".
Oct 13 06:54:55.631: INFO: Creating resource for pre-provisioned PV
Oct 13 06:54:55.631: INFO: Creating PVC and PV
... skipping 6 lines ...
Oct 13 06:55:02.451: INFO: PersistentVolumeClaim pvc-f2w9p found but phase is Pending instead of Bound.
Oct 13 06:55:04.588: INFO: PersistentVolumeClaim pvc-f2w9p found but phase is Pending instead of Bound.
Oct 13 06:55:06.725: INFO: PersistentVolumeClaim pvc-f2w9p found and phase=Bound (10.819357938s)
Oct 13 06:55:06.725: INFO: Waiting up to 3m0s for PersistentVolume aws-5fckd to have phase Bound
Oct 13 06:55:06.861: INFO: PersistentVolume aws-5fckd found and phase=Bound (135.920372ms)
STEP: Creating pod
STEP: Waiting for the pod to fail
Oct 13 06:55:09.680: INFO: Deleting pod "pod-56dea155-bf59-4874-be6e-55b7de6fa1e2" in namespace "volumemode-1393"
Oct 13 06:55:09.817: INFO: Wait up to 5m0s for pod "pod-56dea155-bf59-4874-be6e-55b7de6fa1e2" to be fully deleted
STEP: Deleting pv and pvc
Oct 13 06:55:12.089: INFO: Deleting PersistentVolumeClaim "pvc-f2w9p"
Oct 13 06:55:12.227: INFO: Deleting PersistentVolume "aws-5fckd"
Oct 13 06:55:12.797: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0c1aff4b67b5186ec", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0c1aff4b67b5186ec is currently attached to i-02fdeb7a9f14cee48
	status code: 400, request id: fa1de893-1b36-4585-9022-9d190ac3725e
Oct 13 06:55:18.562: INFO: Successfully deleted PD "aws://ap-northeast-1a/vol-0c1aff4b67b5186ec".
[AfterEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 06:55:18.562: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volumemode-1393" for this suite.
... skipping 3 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to use a volume in a pod with mismatched mode [Slow]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
... skipping 7 lines ...
Oct 13 06:54:18.391: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-6267-e2e-scc2t2h
STEP: creating a claim
Oct 13 06:54:18.525: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-lsbt
STEP: Creating a pod to test multi_subpath
Oct 13 06:54:18.930: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-lsbt" in namespace "provisioning-6267" to be "Succeeded or Failed"
Oct 13 06:54:19.063: INFO: Pod "pod-subpath-test-dynamicpv-lsbt": Phase="Pending", Reason="", readiness=false. Elapsed: 133.107266ms
Oct 13 06:54:21.198: INFO: Pod "pod-subpath-test-dynamicpv-lsbt": Phase="Pending", Reason="", readiness=false. Elapsed: 2.267528926s
Oct 13 06:54:23.332: INFO: Pod "pod-subpath-test-dynamicpv-lsbt": Phase="Pending", Reason="", readiness=false. Elapsed: 4.401477826s
Oct 13 06:54:25.466: INFO: Pod "pod-subpath-test-dynamicpv-lsbt": Phase="Pending", Reason="", readiness=false. Elapsed: 6.536195702s
Oct 13 06:54:27.601: INFO: Pod "pod-subpath-test-dynamicpv-lsbt": Phase="Pending", Reason="", readiness=false. Elapsed: 8.670486223s
Oct 13 06:54:29.734: INFO: Pod "pod-subpath-test-dynamicpv-lsbt": Phase="Pending", Reason="", readiness=false. Elapsed: 10.804051393s
... skipping 2 lines ...
Oct 13 06:54:36.137: INFO: Pod "pod-subpath-test-dynamicpv-lsbt": Phase="Pending", Reason="", readiness=false. Elapsed: 17.207219366s
Oct 13 06:54:38.271: INFO: Pod "pod-subpath-test-dynamicpv-lsbt": Phase="Pending", Reason="", readiness=false. Elapsed: 19.341019553s
Oct 13 06:54:40.405: INFO: Pod "pod-subpath-test-dynamicpv-lsbt": Phase="Pending", Reason="", readiness=false. Elapsed: 21.474623188s
Oct 13 06:54:42.539: INFO: Pod "pod-subpath-test-dynamicpv-lsbt": Phase="Pending", Reason="", readiness=false. Elapsed: 23.609239127s
Oct 13 06:54:44.673: INFO: Pod "pod-subpath-test-dynamicpv-lsbt": Phase="Succeeded", Reason="", readiness=false. Elapsed: 25.742801733s
STEP: Saw pod success
Oct 13 06:54:44.673: INFO: Pod "pod-subpath-test-dynamicpv-lsbt" satisfied condition "Succeeded or Failed"
Oct 13 06:54:44.806: INFO: Trying to get logs from node ip-172-20-43-128.ap-northeast-1.compute.internal pod pod-subpath-test-dynamicpv-lsbt container test-container-subpath-dynamicpv-lsbt: <nil>
STEP: delete the pod
Oct 13 06:54:45.081: INFO: Waiting for pod pod-subpath-test-dynamicpv-lsbt to disappear
Oct 13 06:54:45.214: INFO: Pod pod-subpath-test-dynamicpv-lsbt no longer exists
STEP: Deleting pod
Oct 13 06:54:45.214: INFO: Deleting pod "pod-subpath-test-dynamicpv-lsbt" in namespace "provisioning-6267"
... skipping 256 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Inline-volume (default fs)] subPath
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if non-existent subpath is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267

      Driver supports dynamic provisioning, skipping InlineVolume pattern

      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:233
------------------------------
... skipping 68 lines ...
Oct 13 06:54:34.205: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-1106-e2e-schxzg2
STEP: creating a claim
Oct 13 06:54:34.341: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-8qrm
STEP: Creating a pod to test atomic-volume-subpath
Oct 13 06:54:34.749: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-8qrm" in namespace "provisioning-1106" to be "Succeeded or Failed"
Oct 13 06:54:34.885: INFO: Pod "pod-subpath-test-dynamicpv-8qrm": Phase="Pending", Reason="", readiness=false. Elapsed: 135.811339ms
Oct 13 06:54:37.034: INFO: Pod "pod-subpath-test-dynamicpv-8qrm": Phase="Pending", Reason="", readiness=false. Elapsed: 2.28464712s
Oct 13 06:54:39.169: INFO: Pod "pod-subpath-test-dynamicpv-8qrm": Phase="Pending", Reason="", readiness=false. Elapsed: 4.419432171s
Oct 13 06:54:41.304: INFO: Pod "pod-subpath-test-dynamicpv-8qrm": Phase="Pending", Reason="", readiness=false. Elapsed: 6.55440154s
Oct 13 06:54:43.439: INFO: Pod "pod-subpath-test-dynamicpv-8qrm": Phase="Pending", Reason="", readiness=false. Elapsed: 8.689162392s
Oct 13 06:54:45.573: INFO: Pod "pod-subpath-test-dynamicpv-8qrm": Phase="Pending", Reason="", readiness=false. Elapsed: 10.823924518s
... skipping 6 lines ...
Oct 13 06:55:00.520: INFO: Pod "pod-subpath-test-dynamicpv-8qrm": Phase="Running", Reason="", readiness=true. Elapsed: 25.77068745s
Oct 13 06:55:02.656: INFO: Pod "pod-subpath-test-dynamicpv-8qrm": Phase="Running", Reason="", readiness=true. Elapsed: 27.906122967s
Oct 13 06:55:04.790: INFO: Pod "pod-subpath-test-dynamicpv-8qrm": Phase="Running", Reason="", readiness=true. Elapsed: 30.040960262s
Oct 13 06:55:06.925: INFO: Pod "pod-subpath-test-dynamicpv-8qrm": Phase="Running", Reason="", readiness=true. Elapsed: 32.175539035s
Oct 13 06:55:09.060: INFO: Pod "pod-subpath-test-dynamicpv-8qrm": Phase="Succeeded", Reason="", readiness=false. Elapsed: 34.310175714s
STEP: Saw pod success
Oct 13 06:55:09.060: INFO: Pod "pod-subpath-test-dynamicpv-8qrm" satisfied condition "Succeeded or Failed"
Oct 13 06:55:09.194: INFO: Trying to get logs from node ip-172-20-43-128.ap-northeast-1.compute.internal pod pod-subpath-test-dynamicpv-8qrm container test-container-subpath-dynamicpv-8qrm: <nil>
STEP: delete the pod
Oct 13 06:55:09.477: INFO: Waiting for pod pod-subpath-test-dynamicpv-8qrm to disappear
Oct 13 06:55:09.611: INFO: Pod pod-subpath-test-dynamicpv-8qrm no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-8qrm
Oct 13 06:55:09.611: INFO: Deleting pod "pod-subpath-test-dynamicpv-8qrm" in namespace "provisioning-1106"
... skipping 108 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Inline-volume (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278

    Driver "ebs.csi.aws.com" does not support volume type "InlineVolume" - skipping

    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 12 lines ...
Oct 13 06:54:17.644: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-4251qkj92
STEP: creating a claim
Oct 13 06:54:17.780: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-6mlq
STEP: Creating a pod to test subpath
Oct 13 06:54:18.204: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-6mlq" in namespace "provisioning-4251" to be "Succeeded or Failed"
Oct 13 06:54:18.340: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 135.065715ms
Oct 13 06:54:20.475: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 2.270192314s
Oct 13 06:54:22.616: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 4.411488208s
Oct 13 06:54:24.753: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 6.548022353s
Oct 13 06:54:26.890: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 8.685380118s
Oct 13 06:54:29.026: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 10.82180157s
... skipping 2 lines ...
Oct 13 06:54:35.442: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 17.237191969s
Oct 13 06:54:37.578: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 19.373663628s
Oct 13 06:54:39.714: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 21.50976575s
Oct 13 06:54:41.851: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 23.645986579s
Oct 13 06:54:43.986: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Succeeded", Reason="", readiness=false. Elapsed: 25.781355779s
STEP: Saw pod success
Oct 13 06:54:43.986: INFO: Pod "pod-subpath-test-dynamicpv-6mlq" satisfied condition "Succeeded or Failed"
Oct 13 06:54:44.122: INFO: Trying to get logs from node ip-172-20-43-128.ap-northeast-1.compute.internal pod pod-subpath-test-dynamicpv-6mlq container test-container-subpath-dynamicpv-6mlq: <nil>
STEP: delete the pod
Oct 13 06:54:44.410: INFO: Waiting for pod pod-subpath-test-dynamicpv-6mlq to disappear
Oct 13 06:54:44.544: INFO: Pod pod-subpath-test-dynamicpv-6mlq no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-6mlq
Oct 13 06:54:44.544: INFO: Deleting pod "pod-subpath-test-dynamicpv-6mlq" in namespace "provisioning-4251"
STEP: Creating pod pod-subpath-test-dynamicpv-6mlq
STEP: Creating a pod to test subpath
Oct 13 06:54:44.816: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-6mlq" in namespace "provisioning-4251" to be "Succeeded or Failed"
Oct 13 06:54:44.950: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 134.483318ms
Oct 13 06:54:47.085: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 2.269607187s
Oct 13 06:54:49.221: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 4.405178795s
Oct 13 06:54:51.357: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 6.541406375s
Oct 13 06:54:53.492: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 8.676600505s
Oct 13 06:54:55.628: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 10.812340718s
... skipping 6 lines ...
Oct 13 06:55:10.577: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 25.761681482s
Oct 13 06:55:12.712: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 27.896859122s
Oct 13 06:55:14.847: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 30.031819785s
Oct 13 06:55:16.983: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Pending", Reason="", readiness=false. Elapsed: 32.166954029s
Oct 13 06:55:19.118: INFO: Pod "pod-subpath-test-dynamicpv-6mlq": Phase="Succeeded", Reason="", readiness=false. Elapsed: 34.30219552s
STEP: Saw pod success
Oct 13 06:55:19.118: INFO: Pod "pod-subpath-test-dynamicpv-6mlq" satisfied condition "Succeeded or Failed"
Oct 13 06:55:19.253: INFO: Trying to get logs from node ip-172-20-58-178.ap-northeast-1.compute.internal pod pod-subpath-test-dynamicpv-6mlq container test-container-subpath-dynamicpv-6mlq: <nil>
STEP: delete the pod
Oct 13 06:55:19.534: INFO: Waiting for pod pod-subpath-test-dynamicpv-6mlq to disappear
Oct 13 06:55:19.669: INFO: Pod pod-subpath-test-dynamicpv-6mlq no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-6mlq
Oct 13 06:55:19.669: INFO: Deleting pod "pod-subpath-test-dynamicpv-6mlq" in namespace "provisioning-4251"
... skipping 77 lines ...
Oct 13 06:54:53.636: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-5867-e2e-scngkk8
STEP: creating a claim
Oct 13 06:54:53.772: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-96gh
STEP: Creating a pod to test subpath
Oct 13 06:54:54.188: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-96gh" in namespace "provisioning-5867" to be "Succeeded or Failed"
Oct 13 06:54:54.325: INFO: Pod "pod-subpath-test-dynamicpv-96gh": Phase="Pending", Reason="", readiness=false. Elapsed: 136.945277ms
Oct 13 06:54:56.463: INFO: Pod "pod-subpath-test-dynamicpv-96gh": Phase="Pending", Reason="", readiness=false. Elapsed: 2.274488068s
Oct 13 06:54:58.605: INFO: Pod "pod-subpath-test-dynamicpv-96gh": Phase="Pending", Reason="", readiness=false. Elapsed: 4.416001939s
Oct 13 06:55:00.741: INFO: Pod "pod-subpath-test-dynamicpv-96gh": Phase="Pending", Reason="", readiness=false. Elapsed: 6.55221964s
Oct 13 06:55:02.877: INFO: Pod "pod-subpath-test-dynamicpv-96gh": Phase="Pending", Reason="", readiness=false. Elapsed: 8.688784922s
Oct 13 06:55:05.013: INFO: Pod "pod-subpath-test-dynamicpv-96gh": Phase="Pending", Reason="", readiness=false. Elapsed: 10.824966936s
... skipping 2 lines ...
Oct 13 06:55:11.425: INFO: Pod "pod-subpath-test-dynamicpv-96gh": Phase="Pending", Reason="", readiness=false. Elapsed: 17.236655923s
Oct 13 06:55:13.561: INFO: Pod "pod-subpath-test-dynamicpv-96gh": Phase="Pending", Reason="", readiness=false. Elapsed: 19.372787901s
Oct 13 06:55:15.697: INFO: Pod "pod-subpath-test-dynamicpv-96gh": Phase="Pending", Reason="", readiness=false. Elapsed: 21.508961656s
Oct 13 06:55:17.834: INFO: Pod "pod-subpath-test-dynamicpv-96gh": Phase="Pending", Reason="", readiness=false. Elapsed: 23.645038814s
Oct 13 06:55:19.971: INFO: Pod "pod-subpath-test-dynamicpv-96gh": Phase="Succeeded", Reason="", readiness=false. Elapsed: 25.782370439s
STEP: Saw pod success
Oct 13 06:55:19.971: INFO: Pod "pod-subpath-test-dynamicpv-96gh" satisfied condition "Succeeded or Failed"
Oct 13 06:55:20.109: INFO: Trying to get logs from node ip-172-20-43-128.ap-northeast-1.compute.internal pod pod-subpath-test-dynamicpv-96gh container test-container-volume-dynamicpv-96gh: <nil>
STEP: delete the pod
Oct 13 06:55:20.387: INFO: Waiting for pod pod-subpath-test-dynamicpv-96gh to disappear
Oct 13 06:55:20.523: INFO: Pod pod-subpath-test-dynamicpv-96gh no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-96gh
Oct 13 06:55:20.523: INFO: Deleting pod "pod-subpath-test-dynamicpv-96gh" in namespace "provisioning-5867"
... skipping 124 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath directory is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240

      Driver supports dynamic provisioning, skipping PreprovisionedPV pattern

      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:233
------------------------------
... skipping 12 lines ...
Oct 13 06:55:16.110: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-42712f49w
STEP: creating a claim
Oct 13 06:55:16.245: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-cfr8
STEP: Creating a pod to test subpath
Oct 13 06:55:16.652: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-cfr8" in namespace "provisioning-4271" to be "Succeeded or Failed"
Oct 13 06:55:16.787: INFO: Pod "pod-subpath-test-dynamicpv-cfr8": Phase="Pending", Reason="", readiness=false. Elapsed: 135.01044ms
Oct 13 06:55:18.922: INFO: Pod "pod-subpath-test-dynamicpv-cfr8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.269798314s
Oct 13 06:55:21.057: INFO: Pod "pod-subpath-test-dynamicpv-cfr8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.405245059s
Oct 13 06:55:23.194: INFO: Pod "pod-subpath-test-dynamicpv-cfr8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.541430541s
Oct 13 06:55:25.329: INFO: Pod "pod-subpath-test-dynamicpv-cfr8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.677012054s
Oct 13 06:55:27.464: INFO: Pod "pod-subpath-test-dynamicpv-cfr8": Phase="Pending", Reason="", readiness=false. Elapsed: 10.812227833s
Oct 13 06:55:29.600: INFO: Pod "pod-subpath-test-dynamicpv-cfr8": Phase="Pending", Reason="", readiness=false. Elapsed: 12.947433326s
Oct 13 06:55:31.734: INFO: Pod "pod-subpath-test-dynamicpv-cfr8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 15.08221487s
STEP: Saw pod success
Oct 13 06:55:31.735: INFO: Pod "pod-subpath-test-dynamicpv-cfr8" satisfied condition "Succeeded or Failed"
Oct 13 06:55:31.869: INFO: Trying to get logs from node ip-172-20-43-128.ap-northeast-1.compute.internal pod pod-subpath-test-dynamicpv-cfr8 container test-container-subpath-dynamicpv-cfr8: <nil>
STEP: delete the pod
Oct 13 06:55:32.163: INFO: Waiting for pod pod-subpath-test-dynamicpv-cfr8 to disappear
Oct 13 06:55:32.298: INFO: Pod pod-subpath-test-dynamicpv-cfr8 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-cfr8
Oct 13 06:55:32.298: INFO: Deleting pod "pod-subpath-test-dynamicpv-cfr8" in namespace "provisioning-4271"
... skipping 244 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath file is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256

    Driver ebs.csi.aws.com doesn't support ntfs -- skipping

    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:121
------------------------------
... skipping 40 lines ...
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 06:56:03.080: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename topology
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to schedule a pod which has topologies that conflict with AllowedTopologies
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192
Oct 13 06:56:03.888: INFO: found topology map[topology.ebs.csi.aws.com/zone:ap-northeast-1a]
Oct 13 06:56:03.888: INFO: Not enough topologies in cluster -- skipping
STEP: Deleting pvc
STEP: Deleting sc
[AfterEach] [Testpattern: Dynamic PV (delayed binding)] topology
... skipping 4 lines ...

S [SKIPPING] [1.215 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (delayed binding)] topology
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to schedule a pod which has topologies that conflict with AllowedTopologies [It]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

    Not enough topologies in cluster -- skipping

    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:199
------------------------------
... skipping 95 lines ...
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 06:55:37.218: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename volumemode
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to use a volume in a pod with mismatched mode [Slow]
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
Oct 13 06:55:37.899: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
Oct 13 06:55:37.899: INFO: Creating resource for dynamic PV
Oct 13 06:55:37.899: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass volumemode-7186s69lz
STEP: creating a claim
STEP: Creating pod
STEP: Waiting for the pod to fail
Oct 13 06:55:42.888: INFO: Deleting pod "pod-ff6aa764-a26d-490e-a235-19655fd2fea3" in namespace "volumemode-7186"
Oct 13 06:55:43.030: INFO: Wait up to 5m0s for pod "pod-ff6aa764-a26d-490e-a235-19655fd2fea3" to be fully deleted
STEP: Deleting pvc
Oct 13 06:55:47.574: INFO: Deleting PersistentVolumeClaim "aws6q8nw"
Oct 13 06:55:47.710: INFO: Waiting up to 5m0s for PersistentVolume pvc-946f31b4-c4f3-41dd-ae97-29bf215b2e51 to get deleted
Oct 13 06:55:47.846: INFO: PersistentVolume pvc-946f31b4-c4f3-41dd-ae97-29bf215b2e51 found and phase=Released (135.573407ms)
... skipping 12 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (block volmode)] volumeMode
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to use a volume in a pod with mismatched mode [Slow]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
------------------------------
[BeforeEach] [sig-storage] Volume FStype [Feature:vsphere]
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 06:56:08.810: INFO: >>> kubeConfig: /root/.kube/config
... skipping 33 lines ...
Oct 13 06:55:32.049: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass volume-5098swlc5
STEP: creating a claim
Oct 13 06:55:32.184: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod exec-volume-test-dynamicpv-cslv
STEP: Creating a pod to test exec-volume-test
Oct 13 06:55:32.593: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-cslv" in namespace "volume-5098" to be "Succeeded or Failed"
Oct 13 06:55:32.729: INFO: Pod "exec-volume-test-dynamicpv-cslv": Phase="Pending", Reason="", readiness=false. Elapsed: 136.263904ms
Oct 13 06:55:34.864: INFO: Pod "exec-volume-test-dynamicpv-cslv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.271599694s
Oct 13 06:55:37.010: INFO: Pod "exec-volume-test-dynamicpv-cslv": Phase="Pending", Reason="", readiness=false. Elapsed: 4.416829529s
Oct 13 06:55:39.149: INFO: Pod "exec-volume-test-dynamicpv-cslv": Phase="Pending", Reason="", readiness=false. Elapsed: 6.555883777s
Oct 13 06:55:41.284: INFO: Pod "exec-volume-test-dynamicpv-cslv": Phase="Pending", Reason="", readiness=false. Elapsed: 8.69090164s
Oct 13 06:55:43.419: INFO: Pod "exec-volume-test-dynamicpv-cslv": Phase="Pending", Reason="", readiness=false. Elapsed: 10.825764471s
Oct 13 06:55:45.554: INFO: Pod "exec-volume-test-dynamicpv-cslv": Phase="Pending", Reason="", readiness=false. Elapsed: 12.961728231s
Oct 13 06:55:47.689: INFO: Pod "exec-volume-test-dynamicpv-cslv": Phase="Pending", Reason="", readiness=false. Elapsed: 15.096258147s
Oct 13 06:55:49.824: INFO: Pod "exec-volume-test-dynamicpv-cslv": Phase="Succeeded", Reason="", readiness=false. Elapsed: 17.231059825s
STEP: Saw pod success
Oct 13 06:55:49.824: INFO: Pod "exec-volume-test-dynamicpv-cslv" satisfied condition "Succeeded or Failed"
Oct 13 06:55:49.959: INFO: Trying to get logs from node ip-172-20-58-178.ap-northeast-1.compute.internal pod exec-volume-test-dynamicpv-cslv container exec-container-dynamicpv-cslv: <nil>
STEP: delete the pod
Oct 13 06:55:50.235: INFO: Waiting for pod exec-volume-test-dynamicpv-cslv to disappear
Oct 13 06:55:50.369: INFO: Pod exec-volume-test-dynamicpv-cslv no longer exists
STEP: Deleting pod exec-volume-test-dynamicpv-cslv
Oct 13 06:55:50.369: INFO: Deleting pod "exec-volume-test-dynamicpv-cslv" in namespace "volume-5098"
... skipping 125 lines ...
Oct 13 06:55:19.961: INFO: PersistentVolumeClaim pvc-tpvnt found but phase is Pending instead of Bound.
Oct 13 06:55:22.098: INFO: PersistentVolumeClaim pvc-tpvnt found and phase=Bound (4.40964973s)
Oct 13 06:55:22.098: INFO: Waiting up to 3m0s for PersistentVolume aws-4j7hw to have phase Bound
Oct 13 06:55:22.234: INFO: PersistentVolume aws-4j7hw found and phase=Bound (136.014241ms)
STEP: Creating pod exec-volume-test-preprovisionedpv-lmlj
STEP: Creating a pod to test exec-volume-test
Oct 13 06:55:22.645: INFO: Waiting up to 5m0s for pod "exec-volume-test-preprovisionedpv-lmlj" in namespace "volume-5151" to be "Succeeded or Failed"
Oct 13 06:55:22.781: INFO: Pod "exec-volume-test-preprovisionedpv-lmlj": Phase="Pending", Reason="", readiness=false. Elapsed: 135.962348ms
Oct 13 06:55:24.917: INFO: Pod "exec-volume-test-preprovisionedpv-lmlj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.272240697s
Oct 13 06:55:27.053: INFO: Pod "exec-volume-test-preprovisionedpv-lmlj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.408495589s
Oct 13 06:55:29.190: INFO: Pod "exec-volume-test-preprovisionedpv-lmlj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.545605523s
Oct 13 06:55:31.327: INFO: Pod "exec-volume-test-preprovisionedpv-lmlj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.68188655s
Oct 13 06:55:33.463: INFO: Pod "exec-volume-test-preprovisionedpv-lmlj": Phase="Pending", Reason="", readiness=false. Elapsed: 10.818345817s
Oct 13 06:55:35.599: INFO: Pod "exec-volume-test-preprovisionedpv-lmlj": Phase="Pending", Reason="", readiness=false. Elapsed: 12.954547042s
Oct 13 06:55:37.736: INFO: Pod "exec-volume-test-preprovisionedpv-lmlj": Phase="Pending", Reason="", readiness=false. Elapsed: 15.091022258s
Oct 13 06:55:39.873: INFO: Pod "exec-volume-test-preprovisionedpv-lmlj": Phase="Pending", Reason="", readiness=false. Elapsed: 17.228246179s
Oct 13 06:55:42.013: INFO: Pod "exec-volume-test-preprovisionedpv-lmlj": Phase="Running", Reason="", readiness=true. Elapsed: 19.367928597s
Oct 13 06:55:44.150: INFO: Pod "exec-volume-test-preprovisionedpv-lmlj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 21.505186656s
STEP: Saw pod success
Oct 13 06:55:44.150: INFO: Pod "exec-volume-test-preprovisionedpv-lmlj" satisfied condition "Succeeded or Failed"
Oct 13 06:55:44.286: INFO: Trying to get logs from node ip-172-20-43-128.ap-northeast-1.compute.internal pod exec-volume-test-preprovisionedpv-lmlj container exec-container-preprovisionedpv-lmlj: <nil>
STEP: delete the pod
Oct 13 06:55:44.564: INFO: Waiting for pod exec-volume-test-preprovisionedpv-lmlj to disappear
Oct 13 06:55:44.700: INFO: Pod exec-volume-test-preprovisionedpv-lmlj no longer exists
STEP: Deleting pod exec-volume-test-preprovisionedpv-lmlj
Oct 13 06:55:44.700: INFO: Deleting pod "exec-volume-test-preprovisionedpv-lmlj" in namespace "volume-5151"
STEP: Deleting pv and pvc
Oct 13 06:55:44.836: INFO: Deleting PersistentVolumeClaim "pvc-tpvnt"
Oct 13 06:55:44.973: INFO: Deleting PersistentVolume "aws-4j7hw"
Oct 13 06:55:45.397: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-03ce4b5a3c036aacc", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-03ce4b5a3c036aacc is currently attached to i-05d630fe1f6d134f8
	status code: 400, request id: e5a3ac75-fe8b-494c-8411-fa926f422559
Oct 13 06:55:51.091: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-03ce4b5a3c036aacc", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-03ce4b5a3c036aacc is currently attached to i-05d630fe1f6d134f8
	status code: 400, request id: e00cba9b-a418-4924-999d-253a2863628c
Oct 13 06:55:56.812: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-03ce4b5a3c036aacc", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-03ce4b5a3c036aacc is currently attached to i-05d630fe1f6d134f8
	status code: 400, request id: 591f81c0-9ca9-4498-96db-bc5de5e6cb53
Oct 13 06:56:02.529: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-03ce4b5a3c036aacc", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-03ce4b5a3c036aacc is currently attached to i-05d630fe1f6d134f8
	status code: 400, request id: 659935a8-3e54-4956-8cdb-1d7abebd8990
Oct 13 06:56:08.303: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-03ce4b5a3c036aacc", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-03ce4b5a3c036aacc is currently attached to i-05d630fe1f6d134f8
	status code: 400, request id: 03a905cc-0fbe-4547-aea9-23e992cdb75a
Oct 13 06:56:14.060: INFO: Successfully deleted PD "aws://ap-northeast-1a/vol-03ce4b5a3c036aacc".
[AfterEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 06:56:14.061: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-5151" for this suite.
... skipping 142 lines ...
Oct 13 06:55:48.795: INFO: Pod aws-client still exists
Oct 13 06:55:50.795: INFO: Waiting for pod aws-client to disappear
Oct 13 06:55:50.930: INFO: Pod aws-client still exists
Oct 13 06:55:52.795: INFO: Waiting for pod aws-client to disappear
Oct 13 06:55:52.928: INFO: Pod aws-client no longer exists
STEP: cleaning the environment after aws
Oct 13 06:55:53.617: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0f89dc5de51b3f622", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0f89dc5de51b3f622 is currently attached to i-02fdeb7a9f14cee48
	status code: 400, request id: 5a3b47e1-c573-439d-9730-990a714d782f
Oct 13 06:55:59.300: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0f89dc5de51b3f622", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0f89dc5de51b3f622 is currently attached to i-02fdeb7a9f14cee48
	status code: 400, request id: 1b7a9d0c-7c3f-4ba9-adaf-e1614f006be5
Oct 13 06:56:05.020: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0f89dc5de51b3f622", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0f89dc5de51b3f622 is currently attached to i-02fdeb7a9f14cee48
	status code: 400, request id: e3b61730-bffc-439c-84a5-e746e423854e
Oct 13 06:56:10.718: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0f89dc5de51b3f622", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0f89dc5de51b3f622 is currently attached to i-02fdeb7a9f14cee48
	status code: 400, request id: 8f9e7a1b-6d19-421a-bc59-d3336ab1dfa0
Oct 13 06:56:16.450: INFO: Successfully deleted PD "aws://ap-northeast-1a/vol-0f89dc5de51b3f622".
[AfterEach] [Testpattern: Inline-volume (xfs)][Slow] volumes
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 06:56:16.450: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-6703" for this suite.
... skipping 218 lines ...
Oct 13 06:55:34.818: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-6779-e2e-scvvbh7
STEP: creating a claim
Oct 13 06:55:34.954: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-68g2
STEP: Creating a pod to test subpath
Oct 13 06:55:35.362: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-68g2" in namespace "provisioning-6779" to be "Succeeded or Failed"
Oct 13 06:55:35.500: INFO: Pod "pod-subpath-test-dynamicpv-68g2": Phase="Pending", Reason="", readiness=false. Elapsed: 138.088047ms
Oct 13 06:55:37.634: INFO: Pod "pod-subpath-test-dynamicpv-68g2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.272648058s
Oct 13 06:55:39.769: INFO: Pod "pod-subpath-test-dynamicpv-68g2": Phase="Pending", Reason="", readiness=false. Elapsed: 4.407032704s
Oct 13 06:55:41.903: INFO: Pod "pod-subpath-test-dynamicpv-68g2": Phase="Pending", Reason="", readiness=false. Elapsed: 6.541503573s
Oct 13 06:55:44.038: INFO: Pod "pod-subpath-test-dynamicpv-68g2": Phase="Pending", Reason="", readiness=false. Elapsed: 8.676106575s
Oct 13 06:55:46.173: INFO: Pod "pod-subpath-test-dynamicpv-68g2": Phase="Pending", Reason="", readiness=false. Elapsed: 10.810921141s
Oct 13 06:55:48.309: INFO: Pod "pod-subpath-test-dynamicpv-68g2": Phase="Succeeded", Reason="", readiness=false. Elapsed: 12.946691852s
STEP: Saw pod success
Oct 13 06:55:48.309: INFO: Pod "pod-subpath-test-dynamicpv-68g2" satisfied condition "Succeeded or Failed"
Oct 13 06:55:48.444: INFO: Trying to get logs from node ip-172-20-58-178.ap-northeast-1.compute.internal pod pod-subpath-test-dynamicpv-68g2 container test-container-subpath-dynamicpv-68g2: <nil>
STEP: delete the pod
Oct 13 06:55:48.720: INFO: Waiting for pod pod-subpath-test-dynamicpv-68g2 to disappear
Oct 13 06:55:48.854: INFO: Pod pod-subpath-test-dynamicpv-68g2 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-68g2
Oct 13 06:55:48.854: INFO: Deleting pod "pod-subpath-test-dynamicpv-68g2" in namespace "provisioning-6779"
... skipping 39 lines ...
Oct 13 06:55:30.992: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass volume-9532-e2e-scd2fnb
STEP: creating a claim
Oct 13 06:55:31.131: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod exec-volume-test-dynamicpv-t7d8
STEP: Creating a pod to test exec-volume-test
Oct 13 06:55:31.547: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-t7d8" in namespace "volume-9532" to be "Succeeded or Failed"
Oct 13 06:55:31.684: INFO: Pod "exec-volume-test-dynamicpv-t7d8": Phase="Pending", Reason="", readiness=false. Elapsed: 137.084674ms
Oct 13 06:55:33.822: INFO: Pod "exec-volume-test-dynamicpv-t7d8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.274913819s
Oct 13 06:55:35.961: INFO: Pod "exec-volume-test-dynamicpv-t7d8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.41377288s
Oct 13 06:55:38.098: INFO: Pod "exec-volume-test-dynamicpv-t7d8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.55126349s
Oct 13 06:55:40.236: INFO: Pod "exec-volume-test-dynamicpv-t7d8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.688635287s
Oct 13 06:55:42.374: INFO: Pod "exec-volume-test-dynamicpv-t7d8": Phase="Pending", Reason="", readiness=false. Elapsed: 10.827259821s
Oct 13 06:55:44.513: INFO: Pod "exec-volume-test-dynamicpv-t7d8": Phase="Pending", Reason="", readiness=false. Elapsed: 12.966220195s
Oct 13 06:55:46.652: INFO: Pod "exec-volume-test-dynamicpv-t7d8": Phase="Pending", Reason="", readiness=false. Elapsed: 15.104722692s
Oct 13 06:55:48.793: INFO: Pod "exec-volume-test-dynamicpv-t7d8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 17.246049231s
STEP: Saw pod success
Oct 13 06:55:48.793: INFO: Pod "exec-volume-test-dynamicpv-t7d8" satisfied condition "Succeeded or Failed"
Oct 13 06:55:48.931: INFO: Trying to get logs from node ip-172-20-58-178.ap-northeast-1.compute.internal pod exec-volume-test-dynamicpv-t7d8 container exec-container-dynamicpv-t7d8: <nil>
STEP: delete the pod
Oct 13 06:55:49.238: INFO: Waiting for pod exec-volume-test-dynamicpv-t7d8 to disappear
Oct 13 06:55:49.380: INFO: Pod exec-volume-test-dynamicpv-t7d8 no longer exists
STEP: Deleting pod exec-volume-test-dynamicpv-t7d8
Oct 13 06:55:49.380: INFO: Deleting pod "exec-volume-test-dynamicpv-t7d8" in namespace "volume-9532"
... skipping 185 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath file is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256

      Driver supports dynamic provisioning, skipping PreprovisionedPV pattern

      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:233
------------------------------
... skipping 312 lines ...
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 06:56:15.798: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail if subpath file is outside the volume [Slow][LinuxOnly]
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256
Oct 13 06:56:16.471: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
Oct 13 06:56:16.471: INFO: Creating resource for dynamic PV
Oct 13 06:56:16.471: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-8377h8l2v
STEP: creating a claim
Oct 13 06:56:16.606: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-pgvf
STEP: Checking for subpath error in container status
Oct 13 06:56:29.284: INFO: Deleting pod "pod-subpath-test-dynamicpv-pgvf" in namespace "provisioning-8377"
Oct 13 06:56:29.420: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-pgvf" to be fully deleted
STEP: Deleting pod
Oct 13 06:56:31.696: INFO: Deleting pod "pod-subpath-test-dynamicpv-pgvf" in namespace "provisioning-8377"
STEP: Deleting pvc
Oct 13 06:56:32.101: INFO: Deleting PersistentVolumeClaim "awszz4zs"
... skipping 13 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (default fs)] subPath
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath file is outside the volume [Slow][LinuxOnly]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 06:56:48.193: INFO: Distro debian doesn't support ntfs -- skipping
[AfterEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
... skipping 497 lines ...
[BeforeEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 06:57:01.350: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename topology
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to schedule a pod which has topologies that conflict with AllowedTopologies
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192
Oct 13 06:57:02.168: INFO: found topology map[topology.ebs.csi.aws.com/zone:ap-northeast-1a]
Oct 13 06:57:02.168: INFO: Not enough topologies in cluster -- skipping
STEP: Deleting pvc
STEP: Deleting sc
[AfterEach] [Testpattern: Dynamic PV (immediate binding)] topology
... skipping 4 lines ...

S [SKIPPING] [1.230 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (immediate binding)] topology
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to schedule a pod which has topologies that conflict with AllowedTopologies [It]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

    Not enough topologies in cluster -- skipping

    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:199
------------------------------
... skipping 29 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Pre-provisioned PV (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278

    Driver "ebs.csi.aws.com" does not support volume type "PreprovisionedPV" - skipping

    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 11 lines ...
Oct 13 06:55:52.304: INFO: Creating resource for dynamic PV
Oct 13 06:55:52.304: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-1977znlpt
STEP: creating a claim
Oct 13 06:55:52.438: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod to format volume volume-prep-provisioning-1977
Oct 13 06:55:52.849: INFO: Waiting up to 5m0s for pod "volume-prep-provisioning-1977" in namespace "provisioning-1977" to be "Succeeded or Failed"
Oct 13 06:55:52.982: INFO: Pod "volume-prep-provisioning-1977": Phase="Pending", Reason="", readiness=false. Elapsed: 132.79001ms
Oct 13 06:55:55.119: INFO: Pod "volume-prep-provisioning-1977": Phase="Pending", Reason="", readiness=false. Elapsed: 2.269279074s
Oct 13 06:55:57.254: INFO: Pod "volume-prep-provisioning-1977": Phase="Pending", Reason="", readiness=false. Elapsed: 4.404055314s
Oct 13 06:55:59.388: INFO: Pod "volume-prep-provisioning-1977": Phase="Pending", Reason="", readiness=false. Elapsed: 6.538603547s
Oct 13 06:56:01.523: INFO: Pod "volume-prep-provisioning-1977": Phase="Pending", Reason="", readiness=false. Elapsed: 8.673795346s
Oct 13 06:56:03.657: INFO: Pod "volume-prep-provisioning-1977": Phase="Pending", Reason="", readiness=false. Elapsed: 10.807556763s
... skipping 9 lines ...
Oct 13 06:56:25.005: INFO: Pod "volume-prep-provisioning-1977": Phase="Pending", Reason="", readiness=false. Elapsed: 32.155253026s
Oct 13 06:56:27.138: INFO: Pod "volume-prep-provisioning-1977": Phase="Pending", Reason="", readiness=false. Elapsed: 34.288947981s
Oct 13 06:56:29.272: INFO: Pod "volume-prep-provisioning-1977": Phase="Pending", Reason="", readiness=false. Elapsed: 36.422926641s
Oct 13 06:56:31.407: INFO: Pod "volume-prep-provisioning-1977": Phase="Pending", Reason="", readiness=false. Elapsed: 38.557768604s
Oct 13 06:56:33.542: INFO: Pod "volume-prep-provisioning-1977": Phase="Succeeded", Reason="", readiness=false. Elapsed: 40.692412087s
STEP: Saw pod success
Oct 13 06:56:33.542: INFO: Pod "volume-prep-provisioning-1977" satisfied condition "Succeeded or Failed"
Oct 13 06:56:33.542: INFO: Deleting pod "volume-prep-provisioning-1977" in namespace "provisioning-1977"
Oct 13 06:56:33.681: INFO: Wait up to 5m0s for pod "volume-prep-provisioning-1977" to be fully deleted
STEP: Creating pod pod-subpath-test-dynamicpv-m8sv
STEP: Checking for subpath error in container status
Oct 13 06:56:46.219: INFO: Deleting pod "pod-subpath-test-dynamicpv-m8sv" in namespace "provisioning-1977"
Oct 13 06:56:46.357: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-m8sv" to be fully deleted
STEP: Deleting pod
Oct 13 06:56:46.490: INFO: Deleting pod "pod-subpath-test-dynamicpv-m8sv" in namespace "provisioning-1977"
STEP: Deleting pvc
Oct 13 06:56:46.889: INFO: Deleting PersistentVolumeClaim "awsn6gnw"
... skipping 115 lines ...
Oct 13 06:56:21.415: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
STEP: creating a test aws volume
Oct 13 06:56:22.396: INFO: Successfully created a new PD: "aws://ap-northeast-1a/vol-0ac45093a937e1162".
Oct 13 06:56:22.396: INFO: Creating resource for inline volume
STEP: Creating pod exec-volume-test-inlinevolume-dhqp
STEP: Creating a pod to test exec-volume-test
Oct 13 06:56:22.534: INFO: Waiting up to 5m0s for pod "exec-volume-test-inlinevolume-dhqp" in namespace "volume-370" to be "Succeeded or Failed"
Oct 13 06:56:22.680: INFO: Pod "exec-volume-test-inlinevolume-dhqp": Phase="Pending", Reason="", readiness=false. Elapsed: 145.956349ms
Oct 13 06:56:24.816: INFO: Pod "exec-volume-test-inlinevolume-dhqp": Phase="Pending", Reason="", readiness=false. Elapsed: 2.28278267s
Oct 13 06:56:26.952: INFO: Pod "exec-volume-test-inlinevolume-dhqp": Phase="Pending", Reason="", readiness=false. Elapsed: 4.418191835s
Oct 13 06:56:29.089: INFO: Pod "exec-volume-test-inlinevolume-dhqp": Phase="Pending", Reason="", readiness=false. Elapsed: 6.555350534s
Oct 13 06:56:31.228: INFO: Pod "exec-volume-test-inlinevolume-dhqp": Phase="Pending", Reason="", readiness=false. Elapsed: 8.693993242s
Oct 13 06:56:33.364: INFO: Pod "exec-volume-test-inlinevolume-dhqp": Phase="Pending", Reason="", readiness=false. Elapsed: 10.830770182s
Oct 13 06:56:35.503: INFO: Pod "exec-volume-test-inlinevolume-dhqp": Phase="Pending", Reason="", readiness=false. Elapsed: 12.968977118s
Oct 13 06:56:37.638: INFO: Pod "exec-volume-test-inlinevolume-dhqp": Phase="Pending", Reason="", readiness=false. Elapsed: 15.104327196s
Oct 13 06:56:39.774: INFO: Pod "exec-volume-test-inlinevolume-dhqp": Phase="Pending", Reason="", readiness=false. Elapsed: 17.240274933s
Oct 13 06:56:41.910: INFO: Pod "exec-volume-test-inlinevolume-dhqp": Phase="Pending", Reason="", readiness=false. Elapsed: 19.376737353s
Oct 13 06:56:44.046: INFO: Pod "exec-volume-test-inlinevolume-dhqp": Phase="Succeeded", Reason="", readiness=false. Elapsed: 21.512505276s
STEP: Saw pod success
Oct 13 06:56:44.046: INFO: Pod "exec-volume-test-inlinevolume-dhqp" satisfied condition "Succeeded or Failed"
Oct 13 06:56:44.184: INFO: Trying to get logs from node ip-172-20-43-128.ap-northeast-1.compute.internal pod exec-volume-test-inlinevolume-dhqp container exec-container-inlinevolume-dhqp: <nil>
STEP: delete the pod
Oct 13 06:56:44.474: INFO: Waiting for pod exec-volume-test-inlinevolume-dhqp to disappear
Oct 13 06:56:44.609: INFO: Pod exec-volume-test-inlinevolume-dhqp no longer exists
STEP: Deleting pod exec-volume-test-inlinevolume-dhqp
Oct 13 06:56:44.610: INFO: Deleting pod "exec-volume-test-inlinevolume-dhqp" in namespace "volume-370"
Oct 13 06:56:45.012: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0ac45093a937e1162", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0ac45093a937e1162 is currently attached to i-05d630fe1f6d134f8
	status code: 400, request id: 255e17c3-c6f6-42ac-bdf9-6bb1c3a656c6
Oct 13 06:56:50.710: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0ac45093a937e1162", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0ac45093a937e1162 is currently attached to i-05d630fe1f6d134f8
	status code: 400, request id: 999c3b47-0158-49b9-8226-2a37fbc5c4b4
Oct 13 06:56:56.463: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0ac45093a937e1162", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0ac45093a937e1162 is currently attached to i-05d630fe1f6d134f8
	status code: 400, request id: 5113c6c9-5ba9-4a22-908a-1ea30f77395a
Oct 13 06:57:02.292: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0ac45093a937e1162", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0ac45093a937e1162 is currently attached to i-05d630fe1f6d134f8
	status code: 400, request id: dafe2ce5-53f0-44e9-85bc-152b591d99ab
Oct 13 06:57:08.020: INFO: Successfully deleted PD "aws://ap-northeast-1a/vol-0ac45093a937e1162".
[AfterEach] [Testpattern: Inline-volume (xfs)][Slow] volumes
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 06:57:08.020: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-370" for this suite.
... skipping 20 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Inline-volume (default fs)] subPath
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath directory is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240

      Driver supports dynamic provisioning, skipping InlineVolume pattern

      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:233
------------------------------
... skipping 293 lines ...
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 06:56:48.195: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename volumemode
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to use a volume in a pod with mismatched mode [Slow]
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
Oct 13 06:56:48.873: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
Oct 13 06:56:48.873: INFO: Creating resource for dynamic PV
Oct 13 06:56:48.874: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass volumemode-5434grx6z
STEP: creating a claim
STEP: Creating pod
STEP: Waiting for the pod to fail
Oct 13 06:56:55.823: INFO: Deleting pod "pod-bd4f02b2-0cdc-494b-813f-65bd4347e1a5" in namespace "volumemode-5434"
Oct 13 06:56:55.961: INFO: Wait up to 5m0s for pod "pod-bd4f02b2-0cdc-494b-813f-65bd4347e1a5" to be fully deleted
STEP: Deleting pvc
Oct 13 06:56:58.503: INFO: Deleting PersistentVolumeClaim "awsh6zff"
Oct 13 06:56:58.638: INFO: Waiting up to 5m0s for PersistentVolume pvc-90506a58-283c-4263-9959-c33c7dfafae7 to get deleted
Oct 13 06:56:58.773: INFO: PersistentVolume pvc-90506a58-283c-4263-9959-c33c7dfafae7 found and phase=Released (134.494692ms)
... skipping 11 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to use a volume in a pod with mismatched mode [Slow]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
------------------------------
[BeforeEach] [sig-storage] Volume Placement [Feature:vsphere]
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 06:57:14.587: INFO: >>> kubeConfig: /root/.kube/config
... skipping 123 lines ...
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 06:56:42.312: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278
Oct 13 06:56:42.988: INFO: Creating resource for dynamic PV
Oct 13 06:56:42.988: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-4813-e2e-scxnfqz
STEP: creating a claim
Oct 13 06:56:43.124: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-zvsk
STEP: Checking for subpath error in container status
Oct 13 06:56:59.803: INFO: Deleting pod "pod-subpath-test-dynamicpv-zvsk" in namespace "provisioning-4813"
Oct 13 06:56:59.940: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-zvsk" to be fully deleted
STEP: Deleting pod
Oct 13 06:57:02.215: INFO: Deleting pod "pod-subpath-test-dynamicpv-zvsk" in namespace "provisioning-4813"
STEP: Deleting pvc
Oct 13 06:57:02.623: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comncqgf"
... skipping 11 lines ...

• [SLOW TEST:36.415 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext3)] volumes
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 06:57:18.729: INFO: Driver "ebs.csi.aws.com" does not support volume type "InlineVolume" - skipping
[AfterEach] [Testpattern: Inline-volume (ext3)] volumes
... skipping 25 lines ...
Oct 13 06:56:19.277: INFO: Creating resource for dynamic PV
Oct 13 06:56:19.277: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-2502-e2e-scnsbw2
STEP: creating a claim
Oct 13 06:56:19.411: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod to format volume volume-prep-provisioning-2502
Oct 13 06:56:19.813: INFO: Waiting up to 5m0s for pod "volume-prep-provisioning-2502" in namespace "provisioning-2502" to be "Succeeded or Failed"
Oct 13 06:56:19.946: INFO: Pod "volume-prep-provisioning-2502": Phase="Pending", Reason="", readiness=false. Elapsed: 133.559866ms
Oct 13 06:56:22.081: INFO: Pod "volume-prep-provisioning-2502": Phase="Pending", Reason="", readiness=false. Elapsed: 2.268221563s
Oct 13 06:56:24.215: INFO: Pod "volume-prep-provisioning-2502": Phase="Pending", Reason="", readiness=false. Elapsed: 4.402408431s
Oct 13 06:56:26.351: INFO: Pod "volume-prep-provisioning-2502": Phase="Pending", Reason="", readiness=false. Elapsed: 6.538573062s
Oct 13 06:56:28.485: INFO: Pod "volume-prep-provisioning-2502": Phase="Pending", Reason="", readiness=false. Elapsed: 8.671913626s
Oct 13 06:56:30.619: INFO: Pod "volume-prep-provisioning-2502": Phase="Pending", Reason="", readiness=false. Elapsed: 10.806235797s
Oct 13 06:56:32.755: INFO: Pod "volume-prep-provisioning-2502": Phase="Pending", Reason="", readiness=false. Elapsed: 12.942024263s
Oct 13 06:56:34.888: INFO: Pod "volume-prep-provisioning-2502": Phase="Pending", Reason="", readiness=false. Elapsed: 15.07529739s
Oct 13 06:56:37.022: INFO: Pod "volume-prep-provisioning-2502": Phase="Pending", Reason="", readiness=false. Elapsed: 17.20895732s
Oct 13 06:56:39.156: INFO: Pod "volume-prep-provisioning-2502": Phase="Pending", Reason="", readiness=false. Elapsed: 19.342830345s
Oct 13 06:56:41.290: INFO: Pod "volume-prep-provisioning-2502": Phase="Succeeded", Reason="", readiness=false. Elapsed: 21.477152687s
STEP: Saw pod success
Oct 13 06:56:41.290: INFO: Pod "volume-prep-provisioning-2502" satisfied condition "Succeeded or Failed"
Oct 13 06:56:41.290: INFO: Deleting pod "volume-prep-provisioning-2502" in namespace "provisioning-2502"
Oct 13 06:56:41.431: INFO: Wait up to 5m0s for pod "volume-prep-provisioning-2502" to be fully deleted
STEP: Creating pod pod-subpath-test-dynamicpv-2sz4
STEP: Checking for subpath error in container status
Oct 13 06:56:43.966: INFO: Deleting pod "pod-subpath-test-dynamicpv-2sz4" in namespace "provisioning-2502"
Oct 13 06:56:44.104: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-2sz4" to be fully deleted
STEP: Deleting pod
Oct 13 06:56:44.237: INFO: Deleting pod "pod-subpath-test-dynamicpv-2sz4" in namespace "provisioning-2502"
STEP: Deleting pvc
Oct 13 06:56:44.638: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comxjtv4"
... skipping 142 lines ...
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 06:56:54.188: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278
Oct 13 06:56:54.858: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
Oct 13 06:56:54.858: INFO: Creating resource for dynamic PV
Oct 13 06:56:54.858: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-5821659d7
STEP: creating a claim
Oct 13 06:56:54.992: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-x46n
STEP: Checking for subpath error in container status
Oct 13 06:57:07.668: INFO: Deleting pod "pod-subpath-test-dynamicpv-x46n" in namespace "provisioning-5821"
Oct 13 06:57:07.803: INFO: Wait up to 5m0s for pod "pod-subpath-test-dynamicpv-x46n" to be fully deleted
STEP: Deleting pod
Oct 13 06:57:10.071: INFO: Deleting pod "pod-subpath-test-dynamicpv-x46n" in namespace "provisioning-5821"
STEP: Deleting pvc
Oct 13 06:57:10.473: INFO: Deleting PersistentVolumeClaim "awszhbms"
... skipping 13 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (default fs)] subPath
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 06:57:26.555: INFO: Distro debian doesn't support ntfs -- skipping
[AfterEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning
... skipping 51 lines ...
Oct 13 06:56:26.691: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-2754-e2e-sctt2mz
STEP: creating a claim
Oct 13 06:56:26.829: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-882d
STEP: Creating a pod to test subpath
Oct 13 06:56:27.237: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-882d" in namespace "provisioning-2754" to be "Succeeded or Failed"
Oct 13 06:56:27.372: INFO: Pod "pod-subpath-test-dynamicpv-882d": Phase="Pending", Reason="", readiness=false. Elapsed: 134.97165ms
Oct 13 06:56:29.508: INFO: Pod "pod-subpath-test-dynamicpv-882d": Phase="Pending", Reason="", readiness=false. Elapsed: 2.27063406s
Oct 13 06:56:31.642: INFO: Pod "pod-subpath-test-dynamicpv-882d": Phase="Pending", Reason="", readiness=false. Elapsed: 4.405238371s
Oct 13 06:56:33.778: INFO: Pod "pod-subpath-test-dynamicpv-882d": Phase="Pending", Reason="", readiness=false. Elapsed: 6.541333673s
Oct 13 06:56:35.913: INFO: Pod "pod-subpath-test-dynamicpv-882d": Phase="Pending", Reason="", readiness=false. Elapsed: 8.6759956s
Oct 13 06:56:38.048: INFO: Pod "pod-subpath-test-dynamicpv-882d": Phase="Pending", Reason="", readiness=false. Elapsed: 10.810746386s
Oct 13 06:56:40.183: INFO: Pod "pod-subpath-test-dynamicpv-882d": Phase="Pending", Reason="", readiness=false. Elapsed: 12.945655137s
Oct 13 06:56:42.317: INFO: Pod "pod-subpath-test-dynamicpv-882d": Phase="Pending", Reason="", readiness=false. Elapsed: 15.080048339s
Oct 13 06:56:44.453: INFO: Pod "pod-subpath-test-dynamicpv-882d": Phase="Pending", Reason="", readiness=false. Elapsed: 17.215426168s
Oct 13 06:56:46.588: INFO: Pod "pod-subpath-test-dynamicpv-882d": Phase="Pending", Reason="", readiness=false. Elapsed: 19.351082953s
Oct 13 06:56:48.724: INFO: Pod "pod-subpath-test-dynamicpv-882d": Phase="Pending", Reason="", readiness=false. Elapsed: 21.486698073s
Oct 13 06:56:50.859: INFO: Pod "pod-subpath-test-dynamicpv-882d": Phase="Succeeded", Reason="", readiness=false. Elapsed: 23.622263979s
STEP: Saw pod success
Oct 13 06:56:50.859: INFO: Pod "pod-subpath-test-dynamicpv-882d" satisfied condition "Succeeded or Failed"
Oct 13 06:56:50.996: INFO: Trying to get logs from node ip-172-20-32-238.ap-northeast-1.compute.internal pod pod-subpath-test-dynamicpv-882d container test-container-subpath-dynamicpv-882d: <nil>
STEP: delete the pod
Oct 13 06:56:51.279: INFO: Waiting for pod pod-subpath-test-dynamicpv-882d to disappear
Oct 13 06:56:51.413: INFO: Pod pod-subpath-test-dynamicpv-882d no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-882d
Oct 13 06:56:51.413: INFO: Deleting pod "pod-subpath-test-dynamicpv-882d" in namespace "provisioning-2754"
... skipping 180 lines ...
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 06:57:08.312: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename volumemode
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to use a volume in a pod with mismatched mode [Slow]
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
Oct 13 06:57:08.990: INFO: Creating resource for dynamic PV
Oct 13 06:57:08.990: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass volumemode-4156-e2e-sclfxjz
STEP: creating a claim
STEP: Creating pod
STEP: Waiting for the pod to fail
Oct 13 06:57:15.947: INFO: Deleting pod "pod-57e60b01-02dd-4c1d-ad21-0f41eb0feb39" in namespace "volumemode-4156"
Oct 13 06:57:16.083: INFO: Wait up to 5m0s for pod "pod-57e60b01-02dd-4c1d-ad21-0f41eb0feb39" to be fully deleted
STEP: Deleting pvc
Oct 13 06:57:18.625: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.com7jjps"
Oct 13 06:57:18.763: INFO: Waiting up to 5m0s for PersistentVolume pvc-b812dd94-d6f3-4e6a-9cd7-3b205d7cf190 to get deleted
Oct 13 06:57:18.898: INFO: PersistentVolume pvc-b812dd94-d6f3-4e6a-9cd7-3b205d7cf190 found and phase=Released (135.154065ms)
... skipping 9 lines ...

• [SLOW TEST:26.429 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (block volmode)] volumeMode
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to use a volume in a pod with mismatched mode [Slow]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:296
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
... skipping 32 lines ...
STEP: Deleting pod hostexec-ip-172-20-43-128.ap-northeast-1.compute.internal-7dtb4 in namespace volumemode-8433
Oct 13 06:57:29.042: INFO: Deleting pod "pod-ea346ffc-3e16-4c65-9131-3fda0d31ee63" in namespace "volumemode-8433"
Oct 13 06:57:29.197: INFO: Wait up to 5m0s for pod "pod-ea346ffc-3e16-4c65-9131-3fda0d31ee63" to be fully deleted
STEP: Deleting pv and pvc
Oct 13 06:57:31.467: INFO: Deleting PersistentVolumeClaim "pvc-x2d5c"
Oct 13 06:57:31.603: INFO: Deleting PersistentVolume "aws-s5rv6"
Oct 13 06:57:31.958: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-08af07c046e411503", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-08af07c046e411503 is currently attached to i-05d630fe1f6d134f8
	status code: 400, request id: e42a85cd-21e1-479e-91a1-0086d5c4e325
Oct 13 06:57:37.722: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-08af07c046e411503", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-08af07c046e411503 is currently attached to i-05d630fe1f6d134f8
	status code: 400, request id: 9de2aa72-ce6e-4eac-9f68-a341aeb8f0f2
Oct 13 06:57:43.420: INFO: Successfully deleted PD "aws://ap-northeast-1a/vol-08af07c046e411503".
[AfterEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 06:57:43.420: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volumemode-8433" for this suite.
... skipping 391 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Inline-volume (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath file is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256

    Driver "ebs.csi.aws.com" does not support volume type "InlineVolume" - skipping

    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 157 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if non-existent subpath is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267

      Distro debian doesn't support ntfs -- skipping

      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:127
------------------------------
... skipping 316 lines ...
Oct 13 06:58:06.640: INFO: AfterEach: Cleaning up test resources


S [SKIPPING] in Spec Setup (BeforeEach) [0.951 seconds]
[sig-storage] PersistentVolumes:vsphere [Feature:vsphere]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  should test that deleting the PV before the pod does not cause pod deletion to fail on vsphere volume detach [BeforeEach]
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/vsphere/persistent_volumes-vsphere.go:164

  Only supported for providers [vsphere] (not aws)

  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/vsphere/persistent_volumes-vsphere.go:64
------------------------------
... skipping 65 lines ...
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 06:58:07.165: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename topology
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail to schedule a pod which has topologies that conflict with AllowedTopologies
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192
Oct 13 06:58:07.984: INFO: found topology map[topology.kubernetes.io/zone:ap-northeast-1a]
Oct 13 06:58:07.984: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
Oct 13 06:58:07.984: INFO: Not enough topologies in cluster -- skipping
STEP: Deleting pvc
STEP: Deleting sc
... skipping 7 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (delayed binding)] topology
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [It]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Not enough topologies in cluster -- skipping

      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:199
------------------------------
... skipping 60 lines ...
Oct 13 06:57:18.111: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass volume-6044-e2e-sc746bz
STEP: creating a claim
Oct 13 06:57:18.246: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod exec-volume-test-dynamicpv-pq9t
STEP: Creating a pod to test exec-volume-test
Oct 13 06:57:18.654: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-pq9t" in namespace "volume-6044" to be "Succeeded or Failed"
Oct 13 06:57:18.789: INFO: Pod "exec-volume-test-dynamicpv-pq9t": Phase="Pending", Reason="", readiness=false. Elapsed: 134.976187ms
Oct 13 06:57:20.940: INFO: Pod "exec-volume-test-dynamicpv-pq9t": Phase="Pending", Reason="", readiness=false. Elapsed: 2.28615629s
Oct 13 06:57:23.076: INFO: Pod "exec-volume-test-dynamicpv-pq9t": Phase="Pending", Reason="", readiness=false. Elapsed: 4.421819116s
Oct 13 06:57:25.211: INFO: Pod "exec-volume-test-dynamicpv-pq9t": Phase="Pending", Reason="", readiness=false. Elapsed: 6.557092467s
Oct 13 06:57:27.347: INFO: Pod "exec-volume-test-dynamicpv-pq9t": Phase="Pending", Reason="", readiness=false. Elapsed: 8.693107531s
Oct 13 06:57:29.482: INFO: Pod "exec-volume-test-dynamicpv-pq9t": Phase="Pending", Reason="", readiness=false. Elapsed: 10.827696547s
Oct 13 06:57:31.623: INFO: Pod "exec-volume-test-dynamicpv-pq9t": Phase="Pending", Reason="", readiness=false. Elapsed: 12.968868344s
Oct 13 06:57:33.760: INFO: Pod "exec-volume-test-dynamicpv-pq9t": Phase="Pending", Reason="", readiness=false. Elapsed: 15.105330642s
Oct 13 06:57:35.899: INFO: Pod "exec-volume-test-dynamicpv-pq9t": Phase="Pending", Reason="", readiness=false. Elapsed: 17.245294656s
Oct 13 06:57:38.035: INFO: Pod "exec-volume-test-dynamicpv-pq9t": Phase="Pending", Reason="", readiness=false. Elapsed: 19.381052456s
Oct 13 06:57:40.170: INFO: Pod "exec-volume-test-dynamicpv-pq9t": Phase="Pending", Reason="", readiness=false. Elapsed: 21.5156525s
Oct 13 06:57:42.305: INFO: Pod "exec-volume-test-dynamicpv-pq9t": Phase="Succeeded", Reason="", readiness=false. Elapsed: 23.651296155s
STEP: Saw pod success
Oct 13 06:57:42.306: INFO: Pod "exec-volume-test-dynamicpv-pq9t" satisfied condition "Succeeded or Failed"
Oct 13 06:57:42.440: INFO: Trying to get logs from node ip-172-20-32-238.ap-northeast-1.compute.internal pod exec-volume-test-dynamicpv-pq9t container exec-container-dynamicpv-pq9t: <nil>
STEP: delete the pod
Oct 13 06:57:42.716: INFO: Waiting for pod exec-volume-test-dynamicpv-pq9t to disappear
Oct 13 06:57:42.851: INFO: Pod exec-volume-test-dynamicpv-pq9t no longer exists
STEP: Deleting pod exec-volume-test-dynamicpv-pq9t
Oct 13 06:57:42.851: INFO: Deleting pod "exec-volume-test-dynamicpv-pq9t" in namespace "volume-6044"
... skipping 59 lines ...
Oct 13 06:57:29.263: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-6181tvwjc
STEP: creating a claim
Oct 13 06:57:29.398: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-bcwb
STEP: Creating a pod to test subpath
Oct 13 06:57:29.805: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-bcwb" in namespace "provisioning-6181" to be "Succeeded or Failed"
Oct 13 06:57:29.939: INFO: Pod "pod-subpath-test-dynamicpv-bcwb": Phase="Pending", Reason="", readiness=false. Elapsed: 133.892992ms
Oct 13 06:57:32.074: INFO: Pod "pod-subpath-test-dynamicpv-bcwb": Phase="Pending", Reason="", readiness=false. Elapsed: 2.269276058s
Oct 13 06:57:34.210: INFO: Pod "pod-subpath-test-dynamicpv-bcwb": Phase="Pending", Reason="", readiness=false. Elapsed: 4.40456598s
Oct 13 06:57:36.344: INFO: Pod "pod-subpath-test-dynamicpv-bcwb": Phase="Pending", Reason="", readiness=false. Elapsed: 6.53903384s
Oct 13 06:57:38.479: INFO: Pod "pod-subpath-test-dynamicpv-bcwb": Phase="Pending", Reason="", readiness=false. Elapsed: 8.674375551s
Oct 13 06:57:40.614: INFO: Pod "pod-subpath-test-dynamicpv-bcwb": Phase="Pending", Reason="", readiness=false. Elapsed: 10.80880657s
... skipping 9 lines ...
Oct 13 06:58:01.967: INFO: Pod "pod-subpath-test-dynamicpv-bcwb": Phase="Pending", Reason="", readiness=false. Elapsed: 32.161936411s
Oct 13 06:58:04.102: INFO: Pod "pod-subpath-test-dynamicpv-bcwb": Phase="Pending", Reason="", readiness=false. Elapsed: 34.296806206s
Oct 13 06:58:06.237: INFO: Pod "pod-subpath-test-dynamicpv-bcwb": Phase="Pending", Reason="", readiness=false. Elapsed: 36.431469835s
Oct 13 06:58:08.372: INFO: Pod "pod-subpath-test-dynamicpv-bcwb": Phase="Pending", Reason="", readiness=false. Elapsed: 38.566802143s
Oct 13 06:58:10.507: INFO: Pod "pod-subpath-test-dynamicpv-bcwb": Phase="Succeeded", Reason="", readiness=false. Elapsed: 40.70236696s
STEP: Saw pod success
Oct 13 06:58:10.508: INFO: Pod "pod-subpath-test-dynamicpv-bcwb" satisfied condition "Succeeded or Failed"
Oct 13 06:58:10.642: INFO: Trying to get logs from node ip-172-20-43-128.ap-northeast-1.compute.internal pod pod-subpath-test-dynamicpv-bcwb container test-container-subpath-dynamicpv-bcwb: <nil>
STEP: delete the pod
Oct 13 06:58:11.161: INFO: Waiting for pod pod-subpath-test-dynamicpv-bcwb to disappear
Oct 13 06:58:11.296: INFO: Pod pod-subpath-test-dynamicpv-bcwb no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-bcwb
Oct 13 06:58:11.296: INFO: Deleting pod "pod-subpath-test-dynamicpv-bcwb" in namespace "provisioning-6181"
... skipping 31 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if non-existent subpath is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267

    Driver ebs.csi.aws.com doesn't support ntfs -- skipping

    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:121
------------------------------
... skipping 44 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.000 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Pre-provisioned PV (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath file is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256

    Driver "ebs.csi.aws.com" does not support volume type "PreprovisionedPV" - skipping

    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 38 lines ...
STEP: Deleting pod hostexec-ip-172-20-58-88.ap-northeast-1.compute.internal-hr4td in namespace volumemode-2303
Oct 13 06:57:45.464: INFO: Deleting pod "pod-3b182efe-e5a7-4243-b6d7-a2e0e9520ab9" in namespace "volumemode-2303"
Oct 13 06:57:45.599: INFO: Wait up to 5m0s for pod "pod-3b182efe-e5a7-4243-b6d7-a2e0e9520ab9" to be fully deleted
STEP: Deleting pv and pvc
Oct 13 06:57:47.868: INFO: Deleting PersistentVolumeClaim "pvc-p9sv7"
Oct 13 06:57:48.005: INFO: Deleting PersistentVolume "aws-jdjp5"
Oct 13 06:57:48.398: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0d37de72fdef80aec", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0d37de72fdef80aec is currently attached to i-0460ca87765676457
	status code: 400, request id: 7495f3a1-5464-4314-a9df-09b4cd072dc7
Oct 13 06:57:54.092: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0d37de72fdef80aec", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0d37de72fdef80aec is currently attached to i-0460ca87765676457
	status code: 400, request id: 9b230c76-c88d-40b9-b37b-cbad21bbcffa
Oct 13 06:57:59.791: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0d37de72fdef80aec", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0d37de72fdef80aec is currently attached to i-0460ca87765676457
	status code: 400, request id: 041fc189-5377-43a4-be02-24b1d722c74a
Oct 13 06:58:05.493: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0d37de72fdef80aec", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0d37de72fdef80aec is currently attached to i-0460ca87765676457
	status code: 400, request id: 6b7b29e7-873f-4c96-a13f-4e878ea746c3
Oct 13 06:58:11.246: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0d37de72fdef80aec", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0d37de72fdef80aec is currently attached to i-0460ca87765676457
	status code: 400, request id: 7ae26ee3-e52c-4b67-9073-15f3812ff1ed
Oct 13 06:58:16.987: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0d37de72fdef80aec", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0d37de72fdef80aec is currently attached to i-0460ca87765676457
	status code: 400, request id: 7852b371-ce2a-4634-ba33-bf10c0dccbbe
Oct 13 06:58:22.730: INFO: Successfully deleted PD "aws://ap-northeast-1a/vol-0d37de72fdef80aec".
[AfterEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 06:58:22.730: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volumemode-2303" for this suite.
... skipping 69 lines ...
Oct 13 06:58:05.406: INFO: Creating resource for dynamic PV
Oct 13 06:58:05.406: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(ebs.csi.aws.com) supported size:{ 1Gi} 
STEP: creating a StorageClass volume-expand-8981-e2e-sc7dvvc
STEP: creating a claim
STEP: Expanding non-expandable pvc
Oct 13 06:58:05.815: INFO: currentPvcSize {{1073741824 0} {<nil>} 1Gi BinarySI}, newSize {{2147483648 0} {<nil>}  BinarySI}
Oct 13 06:58:06.085: INFO: Error updating pvc ebs.csi.aws.comfqg98: PersistentVolumeClaim "ebs.csi.aws.comfqg98" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8981-e2e-sc7dvvc",
  	... // 3 identical fields
  }

Oct 13 06:58:08.364: INFO: Error updating pvc ebs.csi.aws.comfqg98: PersistentVolumeClaim "ebs.csi.aws.comfqg98" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8981-e2e-sc7dvvc",
  	... // 3 identical fields
  }

Oct 13 06:58:10.356: INFO: Error updating pvc ebs.csi.aws.comfqg98: PersistentVolumeClaim "ebs.csi.aws.comfqg98" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8981-e2e-sc7dvvc",
  	... // 3 identical fields
  }

Oct 13 06:58:12.359: INFO: Error updating pvc ebs.csi.aws.comfqg98: PersistentVolumeClaim "ebs.csi.aws.comfqg98" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8981-e2e-sc7dvvc",
  	... // 3 identical fields
  }

Oct 13 06:58:14.357: INFO: Error updating pvc ebs.csi.aws.comfqg98: PersistentVolumeClaim "ebs.csi.aws.comfqg98" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8981-e2e-sc7dvvc",
  	... // 3 identical fields
  }

Oct 13 06:58:16.356: INFO: Error updating pvc ebs.csi.aws.comfqg98: PersistentVolumeClaim "ebs.csi.aws.comfqg98" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8981-e2e-sc7dvvc",
  	... // 3 identical fields
  }

Oct 13 06:58:18.362: INFO: Error updating pvc ebs.csi.aws.comfqg98: PersistentVolumeClaim "ebs.csi.aws.comfqg98" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8981-e2e-sc7dvvc",
  	... // 3 identical fields
  }

Oct 13 06:58:20.359: INFO: Error updating pvc ebs.csi.aws.comfqg98: PersistentVolumeClaim "ebs.csi.aws.comfqg98" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8981-e2e-sc7dvvc",
  	... // 3 identical fields
  }

Oct 13 06:58:22.359: INFO: Error updating pvc ebs.csi.aws.comfqg98: PersistentVolumeClaim "ebs.csi.aws.comfqg98" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8981-e2e-sc7dvvc",
  	... // 3 identical fields
  }

Oct 13 06:58:24.360: INFO: Error updating pvc ebs.csi.aws.comfqg98: PersistentVolumeClaim "ebs.csi.aws.comfqg98" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8981-e2e-sc7dvvc",
  	... // 3 identical fields
  }

Oct 13 06:58:26.356: INFO: Error updating pvc ebs.csi.aws.comfqg98: PersistentVolumeClaim "ebs.csi.aws.comfqg98" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8981-e2e-sc7dvvc",
  	... // 3 identical fields
  }

Oct 13 06:58:28.358: INFO: Error updating pvc ebs.csi.aws.comfqg98: PersistentVolumeClaim "ebs.csi.aws.comfqg98" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8981-e2e-sc7dvvc",
  	... // 3 identical fields
  }

Oct 13 06:58:30.366: INFO: Error updating pvc ebs.csi.aws.comfqg98: PersistentVolumeClaim "ebs.csi.aws.comfqg98" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8981-e2e-sc7dvvc",
  	... // 3 identical fields
  }

Oct 13 06:58:32.360: INFO: Error updating pvc ebs.csi.aws.comfqg98: PersistentVolumeClaim "ebs.csi.aws.comfqg98" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8981-e2e-sc7dvvc",
  	... // 3 identical fields
  }

Oct 13 06:58:34.357: INFO: Error updating pvc ebs.csi.aws.comfqg98: PersistentVolumeClaim "ebs.csi.aws.comfqg98" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8981-e2e-sc7dvvc",
  	... // 3 identical fields
  }

Oct 13 06:58:36.357: INFO: Error updating pvc ebs.csi.aws.comfqg98: PersistentVolumeClaim "ebs.csi.aws.comfqg98" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-8981-e2e-sc7dvvc",
  	... // 3 identical fields
  }

Oct 13 06:58:36.627: INFO: Error updating pvc ebs.csi.aws.comfqg98: PersistentVolumeClaim "ebs.csi.aws.comfqg98" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 204 lines ...
Oct 13 06:58:03.195: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-8472-e2e-sc4hsgt
STEP: creating a claim
Oct 13 06:58:03.331: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-qd2b
STEP: Creating a pod to test subpath
Oct 13 06:58:03.756: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-qd2b" in namespace "provisioning-8472" to be "Succeeded or Failed"
Oct 13 06:58:03.890: INFO: Pod "pod-subpath-test-dynamicpv-qd2b": Phase="Pending", Reason="", readiness=false. Elapsed: 134.700532ms
Oct 13 06:58:06.025: INFO: Pod "pod-subpath-test-dynamicpv-qd2b": Phase="Pending", Reason="", readiness=false. Elapsed: 2.269339129s
Oct 13 06:58:08.160: INFO: Pod "pod-subpath-test-dynamicpv-qd2b": Phase="Pending", Reason="", readiness=false. Elapsed: 4.404797256s
Oct 13 06:58:10.297: INFO: Pod "pod-subpath-test-dynamicpv-qd2b": Phase="Pending", Reason="", readiness=false. Elapsed: 6.541020313s
Oct 13 06:58:12.432: INFO: Pod "pod-subpath-test-dynamicpv-qd2b": Phase="Pending", Reason="", readiness=false. Elapsed: 8.676314814s
Oct 13 06:58:14.567: INFO: Pod "pod-subpath-test-dynamicpv-qd2b": Phase="Pending", Reason="", readiness=false. Elapsed: 10.811239503s
Oct 13 06:58:16.703: INFO: Pod "pod-subpath-test-dynamicpv-qd2b": Phase="Pending", Reason="", readiness=false. Elapsed: 12.947070812s
Oct 13 06:58:18.838: INFO: Pod "pod-subpath-test-dynamicpv-qd2b": Phase="Pending", Reason="", readiness=false. Elapsed: 15.082451613s
Oct 13 06:58:20.979: INFO: Pod "pod-subpath-test-dynamicpv-qd2b": Phase="Pending", Reason="", readiness=false. Elapsed: 17.222932821s
Oct 13 06:58:23.115: INFO: Pod "pod-subpath-test-dynamicpv-qd2b": Phase="Pending", Reason="", readiness=false. Elapsed: 19.359596829s
Oct 13 06:58:25.250: INFO: Pod "pod-subpath-test-dynamicpv-qd2b": Phase="Pending", Reason="", readiness=false. Elapsed: 21.494668414s
Oct 13 06:58:27.388: INFO: Pod "pod-subpath-test-dynamicpv-qd2b": Phase="Succeeded", Reason="", readiness=false. Elapsed: 23.632307108s
STEP: Saw pod success
Oct 13 06:58:27.388: INFO: Pod "pod-subpath-test-dynamicpv-qd2b" satisfied condition "Succeeded or Failed"
Oct 13 06:58:27.523: INFO: Trying to get logs from node ip-172-20-32-238.ap-northeast-1.compute.internal pod pod-subpath-test-dynamicpv-qd2b container test-container-volume-dynamicpv-qd2b: <nil>
STEP: delete the pod
Oct 13 06:58:27.810: INFO: Waiting for pod pod-subpath-test-dynamicpv-qd2b to disappear
Oct 13 06:58:27.945: INFO: Pod pod-subpath-test-dynamicpv-qd2b no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-qd2b
Oct 13 06:58:27.945: INFO: Deleting pod "pod-subpath-test-dynamicpv-qd2b" in namespace "provisioning-8472"
... skipping 70 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if subpath directory is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:240

    Driver ebs.csi.aws.com doesn't support ntfs -- skipping

    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:121
------------------------------
... skipping 62 lines ...
STEP: Deleting pod aws-client in namespace volume-9356
Oct 13 06:58:37.148: INFO: Waiting for pod aws-client to disappear
Oct 13 06:58:37.283: INFO: Pod aws-client still exists
Oct 13 06:58:39.283: INFO: Waiting for pod aws-client to disappear
Oct 13 06:58:39.416: INFO: Pod aws-client no longer exists
STEP: cleaning the environment after aws
Oct 13 06:58:40.093: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0d9b3448f1a3d1ae3", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0d9b3448f1a3d1ae3 is currently attached to i-02fdeb7a9f14cee48
	status code: 400, request id: 719a426d-82dd-4b93-960e-66c85ffcb57b
Oct 13 06:58:45.762: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0d9b3448f1a3d1ae3", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0d9b3448f1a3d1ae3 is currently attached to i-02fdeb7a9f14cee48
	status code: 400, request id: 93bbd348-8a5d-49cb-9c97-2e0507a50e9b
Oct 13 06:58:51.512: INFO: Successfully deleted PD "aws://ap-northeast-1a/vol-0d9b3448f1a3d1ae3".
[AfterEach] [Testpattern: Inline-volume (default fs)] volumes
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 06:58:51.512: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-9356" for this suite.
... skipping 20 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278

      Distro debian doesn't support ntfs -- skipping

      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:127
------------------------------
... skipping 505 lines ...
Oct 13 06:58:32.905: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-2194tlkgt
STEP: creating a claim
Oct 13 06:58:33.038: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-7tbl
STEP: Creating a pod to test subpath
Oct 13 06:58:33.441: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-7tbl" in namespace "provisioning-2194" to be "Succeeded or Failed"
Oct 13 06:58:33.574: INFO: Pod "pod-subpath-test-dynamicpv-7tbl": Phase="Pending", Reason="", readiness=false. Elapsed: 132.81737ms
Oct 13 06:58:35.708: INFO: Pod "pod-subpath-test-dynamicpv-7tbl": Phase="Pending", Reason="", readiness=false. Elapsed: 2.267264921s
Oct 13 06:58:37.848: INFO: Pod "pod-subpath-test-dynamicpv-7tbl": Phase="Pending", Reason="", readiness=false. Elapsed: 4.406912274s
Oct 13 06:58:39.981: INFO: Pod "pod-subpath-test-dynamicpv-7tbl": Phase="Pending", Reason="", readiness=false. Elapsed: 6.540254775s
Oct 13 06:58:42.114: INFO: Pod "pod-subpath-test-dynamicpv-7tbl": Phase="Pending", Reason="", readiness=false. Elapsed: 8.673669324s
Oct 13 06:58:44.249: INFO: Pod "pod-subpath-test-dynamicpv-7tbl": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.807996464s
STEP: Saw pod success
Oct 13 06:58:44.249: INFO: Pod "pod-subpath-test-dynamicpv-7tbl" satisfied condition "Succeeded or Failed"
Oct 13 06:58:44.382: INFO: Trying to get logs from node ip-172-20-58-88.ap-northeast-1.compute.internal pod pod-subpath-test-dynamicpv-7tbl container test-container-volume-dynamicpv-7tbl: <nil>
STEP: delete the pod
Oct 13 06:58:44.665: INFO: Waiting for pod pod-subpath-test-dynamicpv-7tbl to disappear
Oct 13 06:58:44.798: INFO: Pod pod-subpath-test-dynamicpv-7tbl no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-7tbl
Oct 13 06:58:44.798: INFO: Deleting pod "pod-subpath-test-dynamicpv-7tbl" in namespace "provisioning-2194"
... skipping 331 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: ebs.csi.aws.com]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:175
  [Testpattern: Inline-volume (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail if non-existent subpath is outside the volume [Slow][LinuxOnly] [BeforeEach]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:267

    Driver "ebs.csi.aws.com" does not support volume type "InlineVolume" - skipping

    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/external/external.go:255
------------------------------
... skipping 170 lines ...
Oct 13 06:58:23.676: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass volume-2110-e2e-scmn2vj
STEP: creating a claim
Oct 13 06:58:23.811: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod exec-volume-test-dynamicpv-vv65
STEP: Creating a pod to test exec-volume-test
Oct 13 06:58:24.220: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-vv65" in namespace "volume-2110" to be "Succeeded or Failed"
Oct 13 06:58:24.354: INFO: Pod "exec-volume-test-dynamicpv-vv65": Phase="Pending", Reason="", readiness=false. Elapsed: 134.31284ms
Oct 13 06:58:26.490: INFO: Pod "exec-volume-test-dynamicpv-vv65": Phase="Pending", Reason="", readiness=false. Elapsed: 2.27012974s
Oct 13 06:58:28.627: INFO: Pod "exec-volume-test-dynamicpv-vv65": Phase="Pending", Reason="", readiness=false. Elapsed: 4.40750609s
Oct 13 06:58:30.761: INFO: Pod "exec-volume-test-dynamicpv-vv65": Phase="Pending", Reason="", readiness=false. Elapsed: 6.541581471s
Oct 13 06:58:32.906: INFO: Pod "exec-volume-test-dynamicpv-vv65": Phase="Pending", Reason="", readiness=false. Elapsed: 8.686199441s
Oct 13 06:58:35.040: INFO: Pod "exec-volume-test-dynamicpv-vv65": Phase="Running", Reason="", readiness=true. Elapsed: 10.820522705s
Oct 13 06:58:37.175: INFO: Pod "exec-volume-test-dynamicpv-vv65": Phase="Succeeded", Reason="", readiness=false. Elapsed: 12.95493096s
STEP: Saw pod success
Oct 13 06:58:37.175: INFO: Pod "exec-volume-test-dynamicpv-vv65" satisfied condition "Succeeded or Failed"
Oct 13 06:58:37.315: INFO: Trying to get logs from node ip-172-20-58-178.ap-northeast-1.compute.internal pod exec-volume-test-dynamicpv-vv65 container exec-container-dynamicpv-vv65: <nil>
STEP: delete the pod
Oct 13 06:58:37.611: INFO: Waiting for pod exec-volume-test-dynamicpv-vv65 to disappear
Oct 13 06:58:37.746: INFO: Pod exec-volume-test-dynamicpv-vv65 no longer exists
STEP: Deleting pod exec-volume-test-dynamicpv-vv65
Oct 13 06:58:37.746: INFO: Deleting pod "exec-volume-test-dynamicpv-vv65" in namespace "volume-2110"
... skipping 104 lines ...
STEP: Deleting pod aws-client in namespace volume-7641
Oct 13 06:59:09.162: INFO: Waiting for pod aws-client to disappear
Oct 13 06:59:09.304: INFO: Pod aws-client still exists
Oct 13 06:59:11.305: INFO: Waiting for pod aws-client to disappear
Oct 13 06:59:11.438: INFO: Pod aws-client no longer exists
STEP: cleaning the environment after aws
Oct 13 06:59:12.133: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-029ce794c7062c008", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-029ce794c7062c008 is currently attached to i-055639418da30da5f
	status code: 400, request id: 9468d83f-7051-449b-88d6-f1fe4427932a
Oct 13 06:59:17.853: INFO: Successfully deleted PD "aws://ap-northeast-1a/vol-029ce794c7062c008".
[AfterEach] [Testpattern: Inline-volume (ext4)] volumes
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 06:59:17.853: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-7641" for this suite.
... skipping 41 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Inline-volume (default fs)] subPath
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath file is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:256

      Driver supports dynamic provisioning, skipping InlineVolume pattern

      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:233
------------------------------
... skipping 329 lines ...
Oct 13 06:58:45.256: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-9258-e2e-scgtptk
STEP: creating a claim
Oct 13 06:58:45.391: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-6gtt
STEP: Creating a pod to test subpath
Oct 13 06:58:45.797: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-6gtt" in namespace "provisioning-9258" to be "Succeeded or Failed"
Oct 13 06:58:45.931: INFO: Pod "pod-subpath-test-dynamicpv-6gtt": Phase="Pending", Reason="", readiness=false. Elapsed: 134.519312ms
Oct 13 06:58:48.067: INFO: Pod "pod-subpath-test-dynamicpv-6gtt": Phase="Pending", Reason="", readiness=false. Elapsed: 2.269800302s
Oct 13 06:58:50.202: INFO: Pod "pod-subpath-test-dynamicpv-6gtt": Phase="Pending", Reason="", readiness=false. Elapsed: 4.405176134s
Oct 13 06:58:52.337: INFO: Pod "pod-subpath-test-dynamicpv-6gtt": Phase="Pending", Reason="", readiness=false. Elapsed: 6.539829158s
Oct 13 06:58:54.472: INFO: Pod "pod-subpath-test-dynamicpv-6gtt": Phase="Pending", Reason="", readiness=false. Elapsed: 8.675473662s
Oct 13 06:58:56.608: INFO: Pod "pod-subpath-test-dynamicpv-6gtt": Phase="Pending", Reason="", readiness=false. Elapsed: 10.811395232s
... skipping 2 lines ...
Oct 13 06:59:03.016: INFO: Pod "pod-subpath-test-dynamicpv-6gtt": Phase="Pending", Reason="", readiness=false. Elapsed: 17.219336985s
Oct 13 06:59:05.151: INFO: Pod "pod-subpath-test-dynamicpv-6gtt": Phase="Pending", Reason="", readiness=false. Elapsed: 19.354382499s
Oct 13 06:59:07.288: INFO: Pod "pod-subpath-test-dynamicpv-6gtt": Phase="Pending", Reason="", readiness=false. Elapsed: 21.490987895s
Oct 13 06:59:09.423: INFO: Pod "pod-subpath-test-dynamicpv-6gtt": Phase="Pending", Reason="", readiness=false. Elapsed: 23.626224429s
Oct 13 06:59:11.560: INFO: Pod "pod-subpath-test-dynamicpv-6gtt": Phase="Succeeded", Reason="", readiness=false. Elapsed: 25.76329804s
STEP: Saw pod success
Oct 13 06:59:11.560: INFO: Pod "pod-subpath-test-dynamicpv-6gtt" satisfied condition "Succeeded or Failed"
Oct 13 06:59:11.700: INFO: Trying to get logs from node ip-172-20-43-128.ap-northeast-1.compute.internal pod pod-subpath-test-dynamicpv-6gtt container test-container-subpath-dynamicpv-6gtt: <nil>
STEP: delete the pod
Oct 13 06:59:11.977: INFO: Waiting for pod pod-subpath-test-dynamicpv-6gtt to disappear
Oct 13 06:59:12.113: INFO: Pod pod-subpath-test-dynamicpv-6gtt no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-6gtt
Oct 13 06:59:12.113: INFO: Deleting pod "pod-subpath-test-dynamicpv-6gtt" in namespace "provisioning-9258"
... skipping 172 lines ...
Oct 13 06:59:26.364: INFO: AfterEach: Cleaning up test resources


S [SKIPPING] in Spec Setup (BeforeEach) [0.963 seconds]
[sig-storage] PersistentVolumes:vsphere [Feature:vsphere]
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  should test that deleting a PVC before the pod does not cause pod deletion to fail on vsphere volume detach [BeforeEach]
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/vsphere/persistent_volumes-vsphere.go:148

  Only supported for providers [vsphere] (not aws)

  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/vsphere/persistent_volumes-vsphere.go:64
------------------------------
... skipping 220 lines ...
Oct 13 06:59:04.897: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(aws) supported size:{ 1Gi} 
STEP: creating a StorageClass volume-expand-60762hrgn
STEP: creating a claim
Oct 13 06:59:05.034: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Expanding non-expandable pvc
Oct 13 06:59:05.307: INFO: currentPvcSize {{1073741824 0} {<nil>} 1Gi BinarySI}, newSize {{2147483648 0} {<nil>}  BinarySI}
Oct 13 06:59:05.580: INFO: Error updating pvc awstsxc9: PersistentVolumeClaim "awstsxc9" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-60762hrgn",
  	... // 3 identical fields
  }

Oct 13 06:59:07.853: INFO: Error updating pvc awstsxc9: PersistentVolumeClaim "awstsxc9" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-60762hrgn",
  	... // 3 identical fields
  }

Oct 13 06:59:09.853: INFO: Error updating pvc awstsxc9: PersistentVolumeClaim "awstsxc9" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-60762hrgn",
  	... // 3 identical fields
  }

Oct 13 06:59:11.855: INFO: Error updating pvc awstsxc9: PersistentVolumeClaim "awstsxc9" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-60762hrgn",
  	... // 3 identical fields
  }

Oct 13 06:59:13.853: INFO: Error updating pvc awstsxc9: PersistentVolumeClaim "awstsxc9" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-60762hrgn",
  	... // 3 identical fields
  }

Oct 13 06:59:15.853: INFO: Error updating pvc awstsxc9: PersistentVolumeClaim "awstsxc9" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-60762hrgn",
  	... // 3 identical fields
  }

Oct 13 06:59:17.854: INFO: Error updating pvc awstsxc9: PersistentVolumeClaim "awstsxc9" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-60762hrgn",
  	... // 3 identical fields
  }

Oct 13 06:59:19.854: INFO: Error updating pvc awstsxc9: PersistentVolumeClaim "awstsxc9" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-60762hrgn",
  	... // 3 identical fields
  }

Oct 13 06:59:21.853: INFO: Error updating pvc awstsxc9: PersistentVolumeClaim "awstsxc9" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-60762hrgn",
  	... // 3 identical fields
  }

Oct 13 06:59:23.853: INFO: Error updating pvc awstsxc9: PersistentVolumeClaim "awstsxc9" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-60762hrgn",
  	... // 3 identical fields
  }

Oct 13 06:59:25.854: INFO: Error updating pvc awstsxc9: PersistentVolumeClaim "awstsxc9" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-60762hrgn",
  	... // 3 identical fields
  }

Oct 13 06:59:27.853: INFO: Error updating pvc awstsxc9: PersistentVolumeClaim "awstsxc9" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-60762hrgn",
  	... // 3 identical fields
  }

Oct 13 06:59:29.855: INFO: Error updating pvc awstsxc9: PersistentVolumeClaim "awstsxc9" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-60762hrgn",
  	... // 3 identical fields
  }

Oct 13 06:59:31.858: INFO: Error updating pvc awstsxc9: PersistentVolumeClaim "awstsxc9" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-60762hrgn",
  	... // 3 identical fields
  }

Oct 13 06:59:33.854: INFO: Error updating pvc awstsxc9: PersistentVolumeClaim "awstsxc9" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-60762hrgn",
  	... // 3 identical fields
  }

Oct 13 06:59:35.856: INFO: Error updating pvc awstsxc9: PersistentVolumeClaim "awstsxc9" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-60762hrgn",
  	... // 3 identical fields
  }

Oct 13 06:59:36.129: INFO: Error updating pvc awstsxc9: PersistentVolumeClaim "awstsxc9" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 65 lines ...
[ebs-csi-migration] EBS CSI Migration
/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:85
  [Driver: aws]
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Inline-volume (default fs)] subPath
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail if subpath with backstepping is outside the volume [Slow][LinuxOnly] [BeforeEach]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:278

      Driver supports dynamic provisioning, skipping InlineVolume pattern

      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/base.go:233
------------------------------
... skipping 135 lines ...
Oct 13 06:59:27.541: INFO: Waiting for pod aws-client to disappear
Oct 13 06:59:27.676: INFO: Pod aws-client no longer exists
STEP: cleaning the environment after aws
STEP: Deleting pv and pvc
Oct 13 06:59:27.676: INFO: Deleting PersistentVolumeClaim "pvc-pndrs"
Oct 13 06:59:27.811: INFO: Deleting PersistentVolume "aws-4nxz7"
Oct 13 06:59:28.206: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-062d664346677bf44", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-062d664346677bf44 is currently attached to i-02fdeb7a9f14cee48
	status code: 400, request id: e05da612-b46b-4729-afc5-5d90b07c4190
Oct 13 06:59:33.941: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-062d664346677bf44", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-062d664346677bf44 is currently attached to i-02fdeb7a9f14cee48
	status code: 400, request id: 5adec760-a25b-4e78-ac63-ae4b979a40b8
Oct 13 06:59:39.643: INFO: Successfully deleted PD "aws://ap-northeast-1a/vol-062d664346677bf44".
[AfterEach] [Testpattern: Pre-provisioned PV (xfs)][Slow] volumes
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 06:59:39.643: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-5464" for this suite.
... skipping 34 lines ...
STEP: Found 8 events.
Oct 13 06:59:35.045: INFO: At 2021-10-13 06:54:34 +0000 UTC - event for pvc-fjhtc: {ebs.csi.aws.com_ebs-csi-controller-54dc46fc7b-lgqq8_6cf83f7a-ad51-4f6d-a7a4-598cc8ccca69 } Provisioning: External provisioner is provisioning volume for claim "provisioning-3705/pvc-fjhtc"
Oct 13 06:59:35.045: INFO: At 2021-10-13 06:54:34 +0000 UTC - event for pvc-fjhtc: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Oct 13 06:59:35.045: INFO: At 2021-10-13 06:54:34 +0000 UTC - event for pvc-fjhtc: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Oct 13 06:59:35.045: INFO: At 2021-10-13 06:54:37 +0000 UTC - event for pvc-fjhtc: {ebs.csi.aws.com_ebs-csi-controller-54dc46fc7b-lgqq8_6cf83f7a-ad51-4f6d-a7a4-598cc8ccca69 } ProvisioningSucceeded: Successfully provisioned volume pvc-0dc95b12-8911-45e4-81d6-57275dec83c2
Oct 13 06:59:35.045: INFO: At 2021-10-13 06:54:38 +0000 UTC - event for pod-50c80169-76f7-4d20-b4d8-2c94bcfe826e: {default-scheduler } Scheduled: Successfully assigned provisioning-3705/pod-50c80169-76f7-4d20-b4d8-2c94bcfe826e to ip-172-20-58-88.ap-northeast-1.compute.internal
Oct 13 06:59:35.045: INFO: At 2021-10-13 06:54:53 +0000 UTC - event for pod-50c80169-76f7-4d20-b4d8-2c94bcfe826e: {attachdetach-controller } FailedAttachVolume: AttachVolume.Attach failed for volume "pvc-0dc95b12-8911-45e4-81d6-57275dec83c2" : rpc error: code = Internal desc = Could not attach volume "vol-0dbcf5709f398a266" to node "i-0460ca87765676457": attachment of disk "vol-0dbcf5709f398a266" failed, expected device to be attached but was attaching
Oct 13 06:59:35.045: INFO: At 2021-10-13 06:56:41 +0000 UTC - event for pod-50c80169-76f7-4d20-b4d8-2c94bcfe826e: {kubelet ip-172-20-58-88.ap-northeast-1.compute.internal} FailedMount: Unable to attach or mount volumes: unmounted volumes=[volume1], unattached volumes=[volume1 kube-api-access-ld5mq]: timed out waiting for the condition
Oct 13 06:59:35.045: INFO: At 2021-10-13 06:58:57 +0000 UTC - event for pod-50c80169-76f7-4d20-b4d8-2c94bcfe826e: {kubelet ip-172-20-58-88.ap-northeast-1.compute.internal} FailedMount: Unable to attach or mount volumes: unmounted volumes=[volume1], unattached volumes=[kube-api-access-ld5mq volume1]: timed out waiting for the condition
Oct 13 06:59:35.182: INFO: POD                                       NODE                                             PHASE    GRACE  CONDITIONS
Oct 13 06:59:35.182: INFO: pod-50c80169-76f7-4d20-b4d8-2c94bcfe826e  ip-172-20-58-88.ap-northeast-1.compute.internal  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2021-10-13 06:54:38 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2021-10-13 06:54:38 +0000 UTC ContainersNotReady containers with unready status: [write-pod]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2021-10-13 06:54:38 +0000 UTC ContainersNotReady containers with unready status: [write-pod]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2021-10-13 06:54:38 +0000 UTC  }]
Oct 13 06:59:35.182: INFO: 
Oct 13 06:59:35.320: INFO: 
... skipping 195 lines ...
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (default fs)] provisioning
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should provision storage with mount options [It]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:179

      Unexpected error:
          <*errors.errorString | 0xc000672630>: {
              s: "pod \"pod-50c80169-76f7-4d20-b4d8-2c94bcfe826e\" is not Running: timed out waiting for the condition",
          }
          pod "pod-50c80169-76f7-4d20-b4d8-2c94bcfe826e" is not Running: timed out waiting for the condition
      occurred

... skipping 551 lines ...
Oct 13 06:59:21.837: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-6452sln8f
STEP: creating a claim
Oct 13 06:59:21.971: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-8hsg
STEP: Creating a pod to test multi_subpath
Oct 13 06:59:22.376: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-8hsg" in namespace "provisioning-6452" to be "Succeeded or Failed"
Oct 13 06:59:22.509: INFO: Pod "pod-subpath-test-dynamicpv-8hsg": Phase="Pending", Reason="", readiness=false. Elapsed: 132.981053ms
Oct 13 06:59:24.642: INFO: Pod "pod-subpath-test-dynamicpv-8hsg": Phase="Pending", Reason="", readiness=false. Elapsed: 2.266348213s
Oct 13 06:59:26.776: INFO: Pod "pod-subpath-test-dynamicpv-8hsg": Phase="Pending", Reason="", readiness=false. Elapsed: 4.400375642s
Oct 13 06:59:28.913: INFO: Pod "pod-subpath-test-dynamicpv-8hsg": Phase="Pending", Reason="", readiness=false. Elapsed: 6.536978026s
Oct 13 06:59:31.051: INFO: Pod "pod-subpath-test-dynamicpv-8hsg": Phase="Pending", Reason="", readiness=false. Elapsed: 8.675154413s
Oct 13 06:59:33.185: INFO: Pod "pod-subpath-test-dynamicpv-8hsg": Phase="Pending", Reason="", readiness=false. Elapsed: 10.808852792s
Oct 13 06:59:35.319: INFO: Pod "pod-subpath-test-dynamicpv-8hsg": Phase="Pending", Reason="", readiness=false. Elapsed: 12.943334528s
Oct 13 06:59:37.453: INFO: Pod "pod-subpath-test-dynamicpv-8hsg": Phase="Succeeded", Reason="", readiness=false. Elapsed: 15.077394792s
STEP: Saw pod success
Oct 13 06:59:37.453: INFO: Pod "pod-subpath-test-dynamicpv-8hsg" satisfied condition "Succeeded or Failed"
Oct 13 06:59:37.587: INFO: Trying to get logs from node ip-172-20-32-238.ap-northeast-1.compute.internal pod pod-subpath-test-dynamicpv-8hsg container test-container-subpath-dynamicpv-8hsg: <nil>
STEP: delete the pod
Oct 13 06:59:37.860: INFO: Waiting for pod pod-subpath-test-dynamicpv-8hsg to disappear
Oct 13 06:59:37.993: INFO: Pod pod-subpath-test-dynamicpv-8hsg no longer exists
STEP: Deleting pod
Oct 13 06:59:37.993: INFO: Deleting pod "pod-subpath-test-dynamicpv-8hsg" in namespace "provisioning-6452"
... skipping 278 lines ...
Oct 13 06:59:56.724: INFO: Waiting for pod aws-client to disappear
Oct 13 06:59:56.859: INFO: Pod aws-client no longer exists
STEP: cleaning the environment after aws
STEP: Deleting pv and pvc
Oct 13 06:59:56.859: INFO: Deleting PersistentVolumeClaim "pvc-w5mlv"
Oct 13 06:59:56.993: INFO: Deleting PersistentVolume "aws-b455d"
Oct 13 06:59:58.027: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0b57827d5ff43e0f2", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0b57827d5ff43e0f2 is currently attached to i-05d630fe1f6d134f8
	status code: 400, request id: ab43c7cb-9414-48e0-ac6e-c8367e279412
Oct 13 07:00:03.743: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0b57827d5ff43e0f2", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0b57827d5ff43e0f2 is currently attached to i-05d630fe1f6d134f8
	status code: 400, request id: 49f57f2f-fbe8-4ffa-9636-99ebe7d3fb3b
Oct 13 07:00:09.449: INFO: Successfully deleted PD "aws://ap-northeast-1a/vol-0b57827d5ff43e0f2".
[AfterEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 07:00:09.449: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-7518" for this suite.
... skipping 23 lines ...
Oct 13 06:59:40.594: INFO: Creating resource for dynamic PV
Oct 13 06:59:40.594: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(aws) supported size:{ 1Gi} 
STEP: creating a StorageClass volume-expand-7822sqc7t
STEP: creating a claim
STEP: Expanding non-expandable pvc
Oct 13 06:59:41.010: INFO: currentPvcSize {{1073741824 0} {<nil>} 1Gi BinarySI}, newSize {{2147483648 0} {<nil>}  BinarySI}
Oct 13 06:59:41.279: INFO: Error updating pvc awsvvhll: PersistentVolumeClaim "awsvvhll" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7822sqc7t",
  	... // 3 identical fields
  }

Oct 13 06:59:43.548: INFO: Error updating pvc awsvvhll: PersistentVolumeClaim "awsvvhll" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7822sqc7t",
  	... // 3 identical fields
  }

Oct 13 06:59:45.550: INFO: Error updating pvc awsvvhll: PersistentVolumeClaim "awsvvhll" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7822sqc7t",
  	... // 3 identical fields
  }

Oct 13 06:59:47.552: INFO: Error updating pvc awsvvhll: PersistentVolumeClaim "awsvvhll" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7822sqc7t",
  	... // 3 identical fields
  }

Oct 13 06:59:49.552: INFO: Error updating pvc awsvvhll: PersistentVolumeClaim "awsvvhll" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7822sqc7t",
  	... // 3 identical fields
  }

Oct 13 06:59:51.549: INFO: Error updating pvc awsvvhll: PersistentVolumeClaim "awsvvhll" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7822sqc7t",
  	... // 3 identical fields
  }

Oct 13 06:59:53.551: INFO: Error updating pvc awsvvhll: PersistentVolumeClaim "awsvvhll" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7822sqc7t",
  	... // 3 identical fields
  }

Oct 13 06:59:55.548: INFO: Error updating pvc awsvvhll: PersistentVolumeClaim "awsvvhll" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7822sqc7t",
  	... // 3 identical fields
  }

Oct 13 06:59:57.550: INFO: Error updating pvc awsvvhll: PersistentVolumeClaim "awsvvhll" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7822sqc7t",
  	... // 3 identical fields
  }

Oct 13 06:59:59.548: INFO: Error updating pvc awsvvhll: PersistentVolumeClaim "awsvvhll" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7822sqc7t",
  	... // 3 identical fields
  }

Oct 13 07:00:01.554: INFO: Error updating pvc awsvvhll: PersistentVolumeClaim "awsvvhll" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7822sqc7t",
  	... // 3 identical fields
  }

Oct 13 07:00:03.548: INFO: Error updating pvc awsvvhll: PersistentVolumeClaim "awsvvhll" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7822sqc7t",
  	... // 3 identical fields
  }

Oct 13 07:00:05.550: INFO: Error updating pvc awsvvhll: PersistentVolumeClaim "awsvvhll" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7822sqc7t",
  	... // 3 identical fields
  }

Oct 13 07:00:07.549: INFO: Error updating pvc awsvvhll: PersistentVolumeClaim "awsvvhll" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7822sqc7t",
  	... // 3 identical fields
  }

Oct 13 07:00:09.550: INFO: Error updating pvc awsvvhll: PersistentVolumeClaim "awsvvhll" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7822sqc7t",
  	... // 3 identical fields
  }

Oct 13 07:00:11.551: INFO: Error updating pvc awsvvhll: PersistentVolumeClaim "awsvvhll" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7822sqc7t",
  	... // 3 identical fields
  }

Oct 13 07:00:11.820: INFO: Error updating pvc awsvvhll: PersistentVolumeClaim "awsvvhll" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 237 lines ...
Oct 13 06:59:55.121: INFO: Waiting for pod aws-injector to disappear
Oct 13 06:59:55.260: INFO: Pod aws-injector still exists
Oct 13 06:59:57.121: INFO: Waiting for pod aws-injector to disappear
Oct 13 06:59:57.258: INFO: Pod aws-injector still exists
Oct 13 06:59:59.122: INFO: Waiting for pod aws-injector to disappear
Oct 13 06:59:59.259: INFO: Pod aws-injector no longer exists
Oct 13 06:59:59.259: FAIL: Failed to create injector pod: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func3()
	/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:186 +0x438
github.com/kubernetes-sigs/aws-ebs-csi-driver/tests/e2e-kubernetes.TestEBSCSI(0x407c59)
	/tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:82 +0x319
... skipping 2 lines ...
created by testing.(*T).Run
	/usr/local/go/src/testing/testing.go:1306 +0x35a
STEP: cleaning the environment after aws
STEP: Deleting pv and pvc
Oct 13 06:59:59.259: INFO: Deleting PersistentVolumeClaim "pvc-hdczk"
Oct 13 06:59:59.397: INFO: Deleting PersistentVolume "aws-jnm8v"
Oct 13 07:00:00.253: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0a70547e22bc8dc99", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0a70547e22bc8dc99 is currently attached to i-0460ca87765676457
	status code: 400, request id: 477e2ed0-3e01-45f8-ad83-19442d5beb4c
Oct 13 07:00:05.965: INFO: Couldn't delete PD "aws://ap-northeast-1a/vol-0a70547e22bc8dc99", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0a70547e22bc8dc99 is currently attached to i-0460ca87765676457
	status code: 400, request id: 5a4c7dcc-ee0b-4230-975f-8106a5715801
Oct 13 07:00:11.795: INFO: Successfully deleted PD "aws://ap-northeast-1a/vol-0a70547e22bc8dc99".
[AfterEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:186
STEP: Collecting events from namespace "volume-255".
STEP: Found 7 events.
Oct 13 07:00:11.933: INFO: At 2021-10-13 06:53:08 +0000 UTC - event for pvc-hdczk: {persistentvolume-controller } ProvisioningFailed: storageclass.storage.k8s.io "volume-255" not found
Oct 13 07:00:11.933: INFO: At 2021-10-13 06:53:22 +0000 UTC - event for aws-injector: {default-scheduler } Scheduled: Successfully assigned volume-255/aws-injector to ip-172-20-58-88.ap-northeast-1.compute.internal
Oct 13 07:00:11.933: INFO: At 2021-10-13 06:53:59 +0000 UTC - event for aws-injector: {attachdetach-controller } FailedAttachVolume: AttachVolume.Attach failed for volume "aws-jnm8v" : rpc error: code = DeadlineExceeded desc = context deadline exceeded
Oct 13 07:00:11.933: INFO: At 2021-10-13 06:54:09 +0000 UTC - event for aws-injector: {attachdetach-controller } FailedAttachVolume: AttachVolume.Attach failed for volume "aws-jnm8v" : rpc error: code = Internal desc = Could not attach volume "vol-0a70547e22bc8dc99" to node "i-0460ca87765676457": attachment of disk "vol-0a70547e22bc8dc99" failed, expected device to be attached but was attaching
Oct 13 07:00:11.933: INFO: At 2021-10-13 06:55:25 +0000 UTC - event for aws-injector: {kubelet ip-172-20-58-88.ap-northeast-1.compute.internal} FailedMount: Unable to attach or mount volumes: unmounted volumes=[aws-volume-0], unattached volumes=[aws-volume-0 kube-api-access-5vttc]: timed out waiting for the condition
Oct 13 07:00:11.933: INFO: At 2021-10-13 06:58:14 +0000 UTC - event for aws-injector: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "aws-jnm8v" 
Oct 13 07:00:11.933: INFO: At 2021-10-13 06:59:57 +0000 UTC - event for aws-injector: {kubelet ip-172-20-58-88.ap-northeast-1.compute.internal} FailedMount: Unable to attach or mount volumes: unmounted volumes=[aws-volume-0], unattached volumes=[kube-api-access-5vttc aws-volume-0]: timed out waiting for the condition
Oct 13 07:00:12.073: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Oct 13 07:00:12.073: INFO: 
Oct 13 07:00:12.211: INFO: 
... skipping 179 lines ...
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Pre-provisioned PV (default fs)] volumes
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should store data [It]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159

      Oct 13 06:59:59.259: Failed to create injector pod: timed out waiting for the condition

      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:186
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow]
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] multiVolume [Slow]
... skipping 148 lines ...
Oct 13 06:59:39.437: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass volume-5152g2bbq
STEP: creating a claim
Oct 13 06:59:39.573: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod exec-volume-test-dynamicpv-q9n2
STEP: Creating a pod to test exec-volume-test
Oct 13 06:59:39.988: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-q9n2" in namespace "volume-5152" to be "Succeeded or Failed"
Oct 13 06:59:40.124: INFO: Pod "exec-volume-test-dynamicpv-q9n2": Phase="Pending", Reason="", readiness=false. Elapsed: 135.978064ms
Oct 13 06:59:42.260: INFO: Pod "exec-volume-test-dynamicpv-q9n2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.272055691s
Oct 13 06:59:44.398: INFO: Pod "exec-volume-test-dynamicpv-q9n2": Phase="Pending", Reason="", readiness=false. Elapsed: 4.410534973s
Oct 13 06:59:46.535: INFO: Pod "exec-volume-test-dynamicpv-q9n2": Phase="Pending", Reason="", readiness=false. Elapsed: 6.547141175s
Oct 13 06:59:48.674: INFO: Pod "exec-volume-test-dynamicpv-q9n2": Phase="Pending", Reason="", readiness=false. Elapsed: 8.686560606s
Oct 13 06:59:50.811: INFO: Pod "exec-volume-test-dynamicpv-q9n2": Phase="Pending", Reason="", readiness=false. Elapsed: 10.822832501s
Oct 13 06:59:52.947: INFO: Pod "exec-volume-test-dynamicpv-q9n2": Phase="Pending", Reason="", readiness=false. Elapsed: 12.958957772s
Oct 13 06:59:55.083: INFO: Pod "exec-volume-test-dynamicpv-q9n2": Phase="Pending", Reason="", readiness=false. Elapsed: 15.095224251s
Oct 13 06:59:57.219: INFO: Pod "exec-volume-test-dynamicpv-q9n2": Phase="Pending", Reason="", readiness=false. Elapsed: 17.231625193s
Oct 13 06:59:59.357: INFO: Pod "exec-volume-test-dynamicpv-q9n2": Phase="Pending", Reason="", readiness=false. Elapsed: 19.36926047s
Oct 13 07:00:01.496: INFO: Pod "exec-volume-test-dynamicpv-q9n2": Phase="Running", Reason="", readiness=true. Elapsed: 21.508100365s
Oct 13 07:00:03.633: INFO: Pod "exec-volume-test-dynamicpv-q9n2": Phase="Succeeded", Reason="", readiness=false. Elapsed: 23.644787599s
STEP: Saw pod success
Oct 13 07:00:03.633: INFO: Pod "exec-volume-test-dynamicpv-q9n2" satisfied condition "Succeeded or Failed"
Oct 13 07:00:03.769: INFO: Trying to get logs from node ip-172-20-43-128.ap-northeast-1.compute.internal pod exec-volume-test-dynamicpv-q9n2 container exec-container-dynamicpv-q9n2: <nil>
STEP: delete the pod
Oct 13 07:00:04.053: INFO: Waiting for pod exec-volume-test-dynamicpv-q9n2 to disappear
Oct 13 07:00:04.189: INFO: Pod exec-volume-test-dynamicpv-q9n2 no longer exists
STEP: Deleting pod exec-volume-test-dynamicpv-q9n2
Oct 13 07:00:04.189: INFO: Deleting pod "exec-volume-test-dynamicpv-q9n2" in namespace "volume-5152"
... skipping 730 lines ...
Oct 13 07:01:04.875: INFO: At 2021-10-13 06:53:55 +0000 UTC - event for awscrbj6: {ebs.csi.aws.com_ebs-csi-controller-54dc46fc7b-lgqq8_6cf83f7a-ad51-4f6d-a7a4-598cc8ccca69 } ProvisioningSucceeded: Successfully provisioned volume pvc-6496272c-a230-438e-adc4-248c3b23a0eb
Oct 13 07:01:04.875: INFO: At 2021-10-13 06:53:55 +0000 UTC - event for awspxsv6: {ebs.csi.aws.com_ebs-csi-controller-54dc46fc7b-lgqq8_6cf83f7a-ad51-4f6d-a7a4-598cc8ccca69 } ProvisioningSucceeded: Successfully provisioned volume pvc-9735797c-ba0b-4202-a514-d1ab6673db81
Oct 13 07:01:04.875: INFO: At 2021-10-13 06:53:55 +0000 UTC - event for pod-33e41382-08c0-493f-a316-66225aa225b6: {default-scheduler } Scheduled: Successfully assigned multivolume-136/pod-33e41382-08c0-493f-a316-66225aa225b6 to ip-172-20-58-88.ap-northeast-1.compute.internal
Oct 13 07:01:04.875: INFO: At 2021-10-13 06:54:16 +0000 UTC - event for pod-33e41382-08c0-493f-a316-66225aa225b6: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-9735797c-ba0b-4202-a514-d1ab6673db81" 
Oct 13 07:01:04.875: INFO: At 2021-10-13 06:54:17 +0000 UTC - event for pod-33e41382-08c0-493f-a316-66225aa225b6: {kubelet ip-172-20-58-88.ap-northeast-1.compute.internal} SuccessfulMountVolume: MapVolume.MapPodDevice succeeded for volume "pvc-9735797c-ba0b-4202-a514-d1ab6673db81" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-9735797c-ba0b-4202-a514-d1ab6673db81/dev"
Oct 13 07:01:04.875: INFO: At 2021-10-13 06:54:17 +0000 UTC - event for pod-33e41382-08c0-493f-a316-66225aa225b6: {kubelet ip-172-20-58-88.ap-northeast-1.compute.internal} SuccessfulMountVolume: MapVolume.MapPodDevice succeeded for volume "pvc-9735797c-ba0b-4202-a514-d1ab6673db81" volumeMapPath "/var/lib/kubelet/pods/df469601-768f-4242-ad6c-2e2997dc6d14/volumeDevices/kubernetes.io~csi"
Oct 13 07:01:04.875: INFO: At 2021-10-13 06:54:20 +0000 UTC - event for pod-33e41382-08c0-493f-a316-66225aa225b6: {attachdetach-controller } FailedAttachVolume: AttachVolume.Attach failed for volume "pvc-6496272c-a230-438e-adc4-248c3b23a0eb" : rpc error: code = Internal desc = Could not attach volume "vol-0a140fbf05144fd4b" to node "i-0460ca87765676457": attachment of disk "vol-0a140fbf05144fd4b" failed, expected device to be attached but was attaching
Oct 13 07:01:04.875: INFO: At 2021-10-13 06:55:58 +0000 UTC - event for pod-33e41382-08c0-493f-a316-66225aa225b6: {kubelet ip-172-20-58-88.ap-northeast-1.compute.internal} FailedMount: Unable to attach or mount volumes: unmounted volumes=[volume2], unattached volumes=[kube-api-access-hsvfb volume1 volume2]: timed out waiting for the condition
Oct 13 07:01:05.009: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Oct 13 07:01:05.009: INFO: 
Oct 13 07:01:05.144: INFO: 
Logging node info for node ip-172-20-32-238.ap-northeast-1.compute.internal
Oct 13 07:01:05.279: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-32-238.ap-northeast-1.compute.internal    72e83de6-53eb-4d61-a863-1f0d71781415 15581 0 2021-10-13 06:47:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-1 failure-domain.beta.kubernetes.io/zone:ap-northeast-1a kops.k8s.io/instancegroup:nodes-ap-northeast-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-32-238.ap-northeast-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-northeast-1a topology.kubernetes.io/region:ap-northeast-1 topology.kubernetes.io/zone:ap-northeast-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-055639418da30da5f"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.32.238/19 projectcalico.org/IPv4IPIPTunnelAddr:100.123.127.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  [{kops-controller Update v1 2021-10-13 06:47:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}}} {kubelet Update v1 2021-10-13 06:47:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}}} {kube-controller-manager Update v1 2021-10-13 06:47:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}}} {calico-node Update v1 2021-10-13 06:48:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-10-13 06:52:29 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}}} {kubelet Update v1 2021-10-13 06:52:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}}}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-1a/i-055639418da30da5f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49895047168 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4059742208 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44905542377 0} {<nil>} 44905542377 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3954884608 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-10-13 06:48:01 +0000 UTC,LastTransitionTime:2021-10-13 06:48:01 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-10-13 07:00:51 +0000 UTC,LastTransitionTime:2021-10-13 06:47:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-10-13 07:00:51 +0000 UTC,LastTransitionTime:2021-10-13 06:47:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-10-13 07:00:51 +0000 UTC,LastTransitionTime:2021-10-13 06:47:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-10-13 07:00:51 +0000 UTC,LastTransitionTime:2021-10-13 06:47:50 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.32.238,},NodeAddress{Type:ExternalIP,Address:18.182.8.185,},NodeAddress{Type:Hostname,Address:ip-172-20-32-238.ap-northeast-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-32-238.ap-northeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-182-8-185.ap-northeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2832c0e336de27b177c033589cd3de,SystemUUID:ec2832c0-e336-de27-b177-c033589cd3de,BootID:d911c26c-a35b-49b2-8d24-4fc98e405074,KernelVersion:5.11.0-1019-aws,OSImage:Ubuntu 20.04.3 LTS,ContainerRuntimeVersion:containerd://1.4.11,KubeletVersion:v1.22.1,KubeProxyVersion:v1.22.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/provider-aws/aws-ebs-csi-driver@sha256:5c03401df9e8fa384b66efc8bfd954a0371ad584a9430eca7d4d9338654d7fe0 k8s.gcr.io/provider-aws/aws-ebs-csi-driver:v1.4.0],SizeBytes:116606616,},ContainerImage{Names:[docker.io/calico/node@sha256:1ae8f57edec7c3a84cd48dd94132a1dcfd7c61bfff819c559f9379d4a56fe3b1 docker.io/calico/node:v3.20.2],SizeBytes:57637498,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:8bd76a6a7778e203b61e18e5ee85b1faf52e6a30eb07e445a165ab90fe9633e3 k8s.gcr.io/e2e-test-images/agnhost:2.31],SizeBytes:49692421,},ContainerImage{Names:[docker.io/calico/cni@sha256:3dae26de7388ff3c124b9abd7e8d12863887391f23549c4aebfbfa20cc0700a5 docker.io/calico/cni:v3.20.2],SizeBytes:48389252,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:abe8cef9e116f2d5ec1175c386e33841ff3386779138b425af876384b0fd7ccb k8s.gcr.io/build-image/debian-iptables:buster-v1.5.0],SizeBytes:38088315,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:efcf1d5fb2fc95d28841f534f1385a4884230c7c876fb1b7cf66d2777ad6dc56 k8s.gcr.io/kube-proxy:v1.22.1],SizeBytes:35941601,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:43a9f52f5dce39bf1816afe6141724cc2d08811e466dd46e6628c925e2419bdc k8s.gcr.io/coredns/coredns:v1.8.5],SizeBytes:13581340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-validation-webhook@sha256:cc9dfe74bb10a5ceed6aac4db24e1177cad6d5f4b0cdae53630c9212b75c0dde k8s.gcr.io/sig-storage/snapshot-validation-webhook:v4.2.1],SizeBytes:10479598,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:4514cc1b2f7536fe1d514fad8a2c46103382243bb9db5ea2d0063fcd2001e8f7 docker.io/calico/pod2daemon-flexvol:v3.20.2],SizeBytes:9359081,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:48da0e4ed7238ad461ea05f68c25921783c37b315f21a5c5a2780157a6460994 k8s.gcr.io/sig-storage/livenessprobe:v2.2.0],SizeBytes:8279778,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-05e29d15900cc94c6],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-05e29d15900cc94c6,DevicePath:,},},Config:nil,},}
... skipping 169 lines ...
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow]
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly] [It]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:164

      Unexpected error:
          <*errors.errorString | 0xc0002533b0>: {
              s: "pod \"pod-33e41382-08c0-493f-a316-66225aa225b6\" is not Running: timed out waiting for the condition",
          }
          pod "pod-33e41382-08c0-493f-a316-66225aa225b6" is not Running: timed out waiting for the condition
      occurred

... skipping 405 lines ...
Oct 13 07:06:14.814: INFO: Waiting for pod aws-client to disappear
Oct 13 07:06:14.947: INFO: Pod aws-client still exists
Oct 13 07:06:16.813: INFO: Waiting for pod aws-client to disappear
Oct 13 07:06:16.947: INFO: Pod aws-client still exists
Oct 13 07:06:18.814: INFO: Waiting for pod aws-client to disappear
Oct 13 07:06:18.947: INFO: Pod aws-client no longer exists
Oct 13 07:06:18.948: FAIL: Failed to create client pod: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/volume.TestVolumeClient(...)
	/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/volume/fixtures.go:505
k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func3()
	/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:188 +0x4df
... skipping 21 lines ...
Oct 13 07:06:24.887: INFO: At 2021-10-13 06:59:11 +0000 UTC - event for awsjl8s2: {ebs.csi.aws.com_ebs-csi-controller-54dc46fc7b-lgqq8_6cf83f7a-ad51-4f6d-a7a4-598cc8ccca69 } ProvisioningSucceeded: Successfully provisioned volume pvc-a6ff7d52-3883-40a2-9b27-6a587a31a0ed
Oct 13 07:06:24.887: INFO: At 2021-10-13 06:59:14 +0000 UTC - event for aws-injector: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-a6ff7d52-3883-40a2-9b27-6a587a31a0ed" 
Oct 13 07:06:24.887: INFO: At 2021-10-13 06:59:29 +0000 UTC - event for aws-injector: {kubelet ip-172-20-43-128.ap-northeast-1.compute.internal} Started: Started container aws-injector
Oct 13 07:06:24.887: INFO: At 2021-10-13 06:59:29 +0000 UTC - event for aws-injector: {kubelet ip-172-20-43-128.ap-northeast-1.compute.internal} Created: Created container aws-injector
Oct 13 07:06:24.887: INFO: At 2021-10-13 06:59:29 +0000 UTC - event for aws-injector: {kubelet ip-172-20-43-128.ap-northeast-1.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/busybox:1.29-1" already present on machine
Oct 13 07:06:24.887: INFO: At 2021-10-13 06:59:35 +0000 UTC - event for aws-injector: {kubelet ip-172-20-43-128.ap-northeast-1.compute.internal} Killing: Stopping container aws-injector
Oct 13 07:06:24.887: INFO: At 2021-10-13 06:59:40 +0000 UTC - event for aws-client: {attachdetach-controller } FailedAttachVolume: Multi-Attach error for volume "pvc-a6ff7d52-3883-40a2-9b27-6a587a31a0ed" Volume is already exclusively attached to one node and can't be attached to another
Oct 13 07:06:24.887: INFO: At 2021-10-13 06:59:40 +0000 UTC - event for aws-client: {default-scheduler } Scheduled: Successfully assigned volume-7207/aws-client to ip-172-20-58-88.ap-northeast-1.compute.internal
Oct 13 07:06:24.887: INFO: At 2021-10-13 07:00:04 +0000 UTC - event for aws-client: {attachdetach-controller } FailedAttachVolume: AttachVolume.Attach failed for volume "pvc-a6ff7d52-3883-40a2-9b27-6a587a31a0ed" : rpc error: code = DeadlineExceeded desc = context deadline exceeded
Oct 13 07:06:24.887: INFO: At 2021-10-13 07:00:05 +0000 UTC - event for aws-client: {attachdetach-controller } FailedAttachVolume: AttachVolume.Attach failed for volume "pvc-a6ff7d52-3883-40a2-9b27-6a587a31a0ed" : rpc error: code = Internal desc = Could not attach volume "vol-0fff07a7a7a9075a1" to node "i-0460ca87765676457": attachment of disk "vol-0fff07a7a7a9075a1" failed, expected device to be attached but was attaching
Oct 13 07:06:24.887: INFO: At 2021-10-13 07:01:43 +0000 UTC - event for aws-client: {kubelet ip-172-20-58-88.ap-northeast-1.compute.internal} FailedMount: Unable to attach or mount volumes: unmounted volumes=[aws-volume-0], unattached volumes=[aws-volume-0 kube-api-access-t7pl4]: timed out waiting for the condition
Oct 13 07:06:25.020: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Oct 13 07:06:25.020: INFO: 
Oct 13 07:06:25.156: INFO: 
Logging node info for node ip-172-20-32-238.ap-northeast-1.compute.internal
Oct 13 07:06:25.289: INFO: Node Info: &Node{ObjectMeta:{ip-172-20-32-238.ap-northeast-1.compute.internal    72e83de6-53eb-4d61-a863-1f0d71781415 17376 0 2021-10-13 06:47:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-northeast-1 failure-domain.beta.kubernetes.io/zone:ap-northeast-1a kops.k8s.io/instancegroup:nodes-ap-northeast-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:ip-172-20-32-238.ap-northeast-1.compute.internal kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-northeast-1a topology.kubernetes.io/region:ap-northeast-1 topology.kubernetes.io/zone:ap-northeast-1a] map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-055639418da30da5f"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:172.20.32.238/19 projectcalico.org/IPv4IPIPTunnelAddr:100.123.127.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] []  [{kops-controller Update v1 2021-10-13 06:47:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/instancegroup":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}}} {kubelet Update v1 2021-10-13 06:47:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}}} {kube-controller-manager Update v1 2021-10-13 06:47:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}}} {calico-node Update v1 2021-10-13 06:48:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2021-10-13 06:52:29 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}}} {kubelet Update v1 2021-10-13 06:52:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}}}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-northeast-1a/i-055639418da30da5f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49895047168 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4059742208 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44905542377 0} {<nil>} 44905542377 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3954884608 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2021-10-13 06:48:01 +0000 UTC,LastTransitionTime:2021-10-13 06:48:01 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2021-10-13 07:05:51 +0000 UTC,LastTransitionTime:2021-10-13 06:47:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2021-10-13 07:05:51 +0000 UTC,LastTransitionTime:2021-10-13 06:47:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2021-10-13 07:05:51 +0000 UTC,LastTransitionTime:2021-10-13 06:47:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2021-10-13 07:05:51 +0000 UTC,LastTransitionTime:2021-10-13 06:47:50 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.32.238,},NodeAddress{Type:ExternalIP,Address:18.182.8.185,},NodeAddress{Type:Hostname,Address:ip-172-20-32-238.ap-northeast-1.compute.internal,},NodeAddress{Type:InternalDNS,Address:ip-172-20-32-238.ap-northeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-182-8-185.ap-northeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2832c0e336de27b177c033589cd3de,SystemUUID:ec2832c0-e336-de27-b177-c033589cd3de,BootID:d911c26c-a35b-49b2-8d24-4fc98e405074,KernelVersion:5.11.0-1019-aws,OSImage:Ubuntu 20.04.3 LTS,ContainerRuntimeVersion:containerd://1.4.11,KubeletVersion:v1.22.1,KubeProxyVersion:v1.22.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/provider-aws/aws-ebs-csi-driver@sha256:5c03401df9e8fa384b66efc8bfd954a0371ad584a9430eca7d4d9338654d7fe0 k8s.gcr.io/provider-aws/aws-ebs-csi-driver:v1.4.0],SizeBytes:116606616,},ContainerImage{Names:[docker.io/calico/node@sha256:1ae8f57edec7c3a84cd48dd94132a1dcfd7c61bfff819c559f9379d4a56fe3b1 docker.io/calico/node:v3.20.2],SizeBytes:57637498,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:8bd76a6a7778e203b61e18e5ee85b1faf52e6a30eb07e445a165ab90fe9633e3 k8s.gcr.io/e2e-test-images/agnhost:2.31],SizeBytes:49692421,},ContainerImage{Names:[docker.io/calico/cni@sha256:3dae26de7388ff3c124b9abd7e8d12863887391f23549c4aebfbfa20cc0700a5 docker.io/calico/cni:v3.20.2],SizeBytes:48389252,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:abe8cef9e116f2d5ec1175c386e33841ff3386779138b425af876384b0fd7ccb k8s.gcr.io/build-image/debian-iptables:buster-v1.5.0],SizeBytes:38088315,},ContainerImage{Names:[k8s.gcr.io/kube-proxy@sha256:efcf1d5fb2fc95d28841f534f1385a4884230c7c876fb1b7cf66d2777ad6dc56 k8s.gcr.io/kube-proxy:v1.22.1],SizeBytes:35941601,},ContainerImage{Names:[k8s.gcr.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[k8s.gcr.io/coredns/coredns@sha256:43a9f52f5dce39bf1816afe6141724cc2d08811e466dd46e6628c925e2419bdc k8s.gcr.io/coredns/coredns:v1.8.5],SizeBytes:13581340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-validation-webhook@sha256:cc9dfe74bb10a5ceed6aac4db24e1177cad6d5f4b0cdae53630c9212b75c0dde k8s.gcr.io/sig-storage/snapshot-validation-webhook:v4.2.1],SizeBytes:10479598,},ContainerImage{Names:[docker.io/calico/pod2daemon-flexvol@sha256:4514cc1b2f7536fe1d514fad8a2c46103382243bb9db5ea2d0063fcd2001e8f7 docker.io/calico/pod2daemon-flexvol:v3.20.2],SizeBytes:9359081,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:48da0e4ed7238ad461ea05f68c25921783c37b315f21a5c5a2780157a6460994 k8s.gcr.io/sig-storage/livenessprobe:v2.2.0],SizeBytes:8279778,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b k8s.gcr.io/e2e-test-images/nginx:1.14-1],SizeBytes:6979365,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-05e29d15900cc94c6],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-05e29d15900cc94c6,DevicePath:,},},Config:nil,},}
... skipping 158 lines ...
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (default fs)] volumes
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should store data [It]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159

      Oct 13 07:06:18.948: Failed to create client pod: timed out waiting for the condition

      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/volume/fixtures.go:505
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
... skipping 9 lines ...
Oct 13 06:59:50.017: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-7926p6cxq
STEP: creating a claim
Oct 13 06:59:50.151: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-t4rp
STEP: Creating a pod to test subpath
Oct 13 06:59:50.554: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-t4rp" in namespace "provisioning-7926" to be "Succeeded or Failed"
Oct 13 06:59:50.687: INFO: Pod "pod-subpath-test-dynamicpv-t4rp": Phase="Pending", Reason="", readiness=false. Elapsed: 133.18489ms
Oct 13 06:59:52.821: INFO: Pod "pod-subpath-test-dynamicpv-t4rp": Phase="Pending", Reason="", readiness=false. Elapsed: 2.266812754s
Oct 13 06:59:54.954: INFO: Pod "pod-subpath-test-dynamicpv-t4rp": Phase="Pending", Reason="", readiness=false. Elapsed: 4.400391931s
Oct 13 06:59:57.088: INFO: Pod "pod-subpath-test-dynamicpv-t4rp": Phase="Pending", Reason="", readiness=false. Elapsed: 6.534425079s
Oct 13 06:59:59.222: INFO: Pod "pod-subpath-test-dynamicpv-t4rp": Phase="Pending", Reason="", readiness=false. Elapsed: 8.668705331s
Oct 13 07:00:01.358: INFO: Pod "pod-subpath-test-dynamicpv-t4rp": Phase="Pending", Reason="", readiness=false. Elapsed: 10.804135447s
... skipping 129 lines ...
Oct 13 07:04:38.915: INFO: Pod "pod-subpath-test-dynamicpv-t4rp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.360749793s
Oct 13 07:04:41.053: INFO: Pod "pod-subpath-test-dynamicpv-t4rp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.499093106s
Oct 13 07:04:43.187: INFO: Pod "pod-subpath-test-dynamicpv-t4rp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.63342282s
Oct 13 07:04:45.321: INFO: Pod "pod-subpath-test-dynamicpv-t4rp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.767332049s
Oct 13 07:04:47.457: INFO: Pod "pod-subpath-test-dynamicpv-t4rp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.902811714s
Oct 13 07:04:49.591: INFO: Pod "pod-subpath-test-dynamicpv-t4rp": Phase="Pending", Reason="", readiness=false. Elapsed: 4m59.036802822s
Oct 13 07:04:51.881: INFO: Failed to get logs from node "ip-172-20-58-88.ap-northeast-1.compute.internal" pod "pod-subpath-test-dynamicpv-t4rp" container "init-volume-dynamicpv-t4rp": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-t4rp)
Oct 13 07:04:52.016: INFO: Failed to get logs from node "ip-172-20-58-88.ap-northeast-1.compute.internal" pod "pod-subpath-test-dynamicpv-t4rp" container "test-init-subpath-dynamicpv-t4rp": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-t4rp)
Oct 13 07:04:52.151: INFO: Failed to get logs from node "ip-172-20-58-88.ap-northeast-1.compute.internal" pod "pod-subpath-test-dynamicpv-t4rp" container "test-container-subpath-dynamicpv-t4rp": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-t4rp)
Oct 13 07:04:52.286: INFO: Failed to get logs from node "ip-172-20-58-88.ap-northeast-1.compute.internal" pod "pod-subpath-test-dynamicpv-t4rp" container "test-container-volume-dynamicpv-t4rp": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-t4rp)
STEP: delete the pod
Oct 13 07:04:52.423: INFO: Waiting for pod pod-subpath-test-dynamicpv-t4rp to disappear
Oct 13 07:04:52.557: INFO: Pod pod-subpath-test-dynamicpv-t4rp still exists
Oct 13 07:04:54.557: INFO: Waiting for pod pod-subpath-test-dynamicpv-t4rp to disappear
Oct 13 07:04:54.692: INFO: Pod pod-subpath-test-dynamicpv-t4rp still exists
Oct 13 07:04:56.558: INFO: Waiting for pod pod-subpath-test-dynamicpv-t4rp to disappear
... skipping 88 lines ...
STEP: Found 12 events.
Oct 13 07:06:27.039: INFO: At 2021-10-13 06:59:50 +0000 UTC - event for awscvf96: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Oct 13 07:06:27.039: INFO: At 2021-10-13 06:59:50 +0000 UTC - event for awscvf96: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Oct 13 07:06:27.039: INFO: At 2021-10-13 06:59:50 +0000 UTC - event for awscvf96: {ebs.csi.aws.com_ebs-csi-controller-54dc46fc7b-lgqq8_6cf83f7a-ad51-4f6d-a7a4-598cc8ccca69 } Provisioning: External provisioner is provisioning volume for claim "provisioning-7926/awscvf96"
Oct 13 07:06:27.039: INFO: At 2021-10-13 06:59:53 +0000 UTC - event for awscvf96: {ebs.csi.aws.com_ebs-csi-controller-54dc46fc7b-lgqq8_6cf83f7a-ad51-4f6d-a7a4-598cc8ccca69 } ProvisioningSucceeded: Successfully provisioned volume pvc-8024e3a1-a592-4b43-9ec4-4b9e848d000d
Oct 13 07:06:27.039: INFO: At 2021-10-13 06:59:54 +0000 UTC - event for pod-subpath-test-dynamicpv-t4rp: {default-scheduler } Scheduled: Successfully assigned provisioning-7926/pod-subpath-test-dynamicpv-t4rp to ip-172-20-58-88.ap-northeast-1.compute.internal
Oct 13 07:06:27.039: INFO: At 2021-10-13 07:00:09 +0000 UTC - event for pod-subpath-test-dynamicpv-t4rp: {attachdetach-controller } FailedAttachVolume: AttachVolume.Attach failed for volume "pvc-8024e3a1-a592-4b43-9ec4-4b9e848d000d" : rpc error: code = Internal desc = Could not attach volume "vol-07f6745399207dd59" to node "i-0460ca87765676457": attachment of disk "vol-07f6745399207dd59" failed, expected device to be attached but was attaching
Oct 13 07:06:27.040: INFO: At 2021-10-13 07:01:57 +0000 UTC - event for pod-subpath-test-dynamicpv-t4rp: {kubelet ip-172-20-58-88.ap-northeast-1.compute.internal} FailedMount: Unable to attach or mount volumes: unmounted volumes=[test-volume], unattached volumes=[kube-api-access-ltp8f test-volume liveness-probe-volume]: timed out waiting for the condition
Oct 13 07:06:27.040: INFO: At 2021-10-13 07:04:13 +0000 UTC - event for pod-subpath-test-dynamicpv-t4rp: {kubelet ip-172-20-58-88.ap-northeast-1.compute.internal} FailedMount: Unable to attach or mount volumes: unmounted volumes=[test-volume], unattached volumes=[test-volume liveness-probe-volume kube-api-access-ltp8f]: timed out waiting for the condition
Oct 13 07:06:27.040: INFO: At 2021-10-13 07:04:24 +0000 UTC - event for pod-subpath-test-dynamicpv-t4rp: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-8024e3a1-a592-4b43-9ec4-4b9e848d000d" 
Oct 13 07:06:27.040: INFO: At 2021-10-13 07:06:07 +0000 UTC - event for pod-subpath-test-dynamicpv-t4rp: {kubelet ip-172-20-58-88.ap-northeast-1.compute.internal} Pulled: Container image "k8s.gcr.io/e2e-test-images/busybox:1.29-1" already present on machine
Oct 13 07:06:27.040: INFO: At 2021-10-13 07:06:08 +0000 UTC - event for pod-subpath-test-dynamicpv-t4rp: {kubelet ip-172-20-58-88.ap-northeast-1.compute.internal} Created: Created container init-volume-dynamicpv-t4rp
Oct 13 07:06:27.040: INFO: At 2021-10-13 07:06:08 +0000 UTC - event for pod-subpath-test-dynamicpv-t4rp: {kubelet ip-172-20-58-88.ap-northeast-1.compute.internal} Started: Started container init-volume-dynamicpv-t4rp
... skipping 163 lines ...
  /tmp/kops.wQdHxBUmM/tests/e2e-kubernetes/e2e_test.go:91
    [Testpattern: Dynamic PV (default fs)] subPath
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support existing directory [It]
      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:205

      Unexpected error:
          <*errors.errorString | 0xc000cc3170>: {
              s: "expected pod \"pod-subpath-test-dynamicpv-t4rp\" success: Gave up after waiting 5m0s for pod \"pod-subpath-test-dynamicpv-t4rp\" to be \"Succeeded or Failed\"",
          }
          expected pod "pod-subpath-test-dynamicpv-t4rp" success: Gave up after waiting 5m0s for pod "pod-subpath-test-dynamicpv-t4rp" to be "Succeeded or Failed"
      occurred

      /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/util.go:742
------------------------------
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
... skipping 125 lines ...
    /tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumelimits.go:123
------------------------------


Summarizing 5 Failures:

[Fail] [ebs-csi-migration] EBS CSI Migration [Driver: aws] [Testpattern: Dynamic PV (default fs)] provisioning [It] should provision storage with mount options 
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:400

[Fail] [ebs-csi-migration] EBS CSI Migration [Driver: aws] [Testpattern: Pre-provisioned PV (default fs)] volumes [It] should store data 
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:186

[Fail] [ebs-csi-migration] EBS CSI Migration [Driver: aws] [Testpattern: Dynamic PV (block volmode)] multiVolume [Slow] [It] should access to two volumes with the same volume mode and retain data across pod recreation on different node [LinuxOnly] 
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/storage/testsuites/multivolume.go:419

[Fail] [ebs-csi-migration] EBS CSI Migration [Driver: aws] [Testpattern: Dynamic PV (default fs)] volumes [It] should store data 
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/volume/fixtures.go:505

[Fail] [ebs-csi-migration] EBS CSI Migration [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath [It] should support existing directory 
/tmp/kops.wQdHxBUmM/vendor/k8s.io/kubernetes/test/e2e/framework/util.go:742

Ran 140 of 485 Specs in 1560.700 seconds
FAIL! -- 135 Passed | 5 Failed | 0 Pending | 345 Skipped


Ginkgo ran 1 suite in 27m8.627781201s
Test Suite Failed

Ginkgo 2.0 is coming soon!
==========================
Ginkgo 2.0 is under active development and will introduce several new features, improvements, and a small handful of breaking changes.
A release candidate for 2.0 is now available and 2.0 should GA in Fall 2021.  Please give the RC a try and send us feedback!
  - To learn more, view the migration guide at https://github.com/onsi/ginkgo/blob/ver2/docs/MIGRATING_TO_V2.md
... skipping 1453 lines ...