This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 0 failed / 0 succeeded
Started2021-09-21 19:14
Elapsed56m55s
Revisionmaster

No Test Failures!


Error lines from build-log.txt

... skipping 135 lines ...
I0921 19:15:33.527026    4652 up.go:43] Cleaning up any leaked resources from previous cluster
I0921 19:15:33.527080    4652 dumplogs.go:40] /logs/artifacts/170e4607-1b10-11ec-996d-2e3f6126aee0/kops toolbox dump --name e2e-0143302838-62691.test-cncf-aws.k8s.io --dir /logs/artifacts --private-key /etc/aws-ssh/aws-ssh-private --ssh-user core
I0921 19:15:33.545520    4673 featureflag.go:165] FeatureFlag "SpecOverrideFlag"=true
I0921 19:15:33.545679    4673 featureflag.go:165] FeatureFlag "AlphaAllowGCE"=true

Cluster.kops.k8s.io "e2e-0143302838-62691.test-cncf-aws.k8s.io" not found
W0921 19:15:34.092057    4652 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1
I0921 19:15:34.092170    4652 down.go:48] /logs/artifacts/170e4607-1b10-11ec-996d-2e3f6126aee0/kops delete cluster --name e2e-0143302838-62691.test-cncf-aws.k8s.io --yes
I0921 19:15:34.115436    4684 featureflag.go:165] FeatureFlag "SpecOverrideFlag"=true
I0921 19:15:34.115737    4684 featureflag.go:165] FeatureFlag "AlphaAllowGCE"=true

error reading cluster configuration: Cluster.kops.k8s.io "e2e-0143302838-62691.test-cncf-aws.k8s.io" not found
I0921 19:15:34.658000    4652 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip
2021/09/21 19:15:34 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404
I0921 19:15:34.667443    4652 http.go:37] curl https://ip.jsb.workers.dev
I0921 19:15:34.772947    4652 up.go:144] /logs/artifacts/170e4607-1b10-11ec-996d-2e3f6126aee0/kops create cluster --name e2e-0143302838-62691.test-cncf-aws.k8s.io --cloud aws --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.21.5 --ssh-public-key /etc/aws-ssh/aws-ssh-public --override cluster.spec.nodePortAccess=0.0.0.0/0 --yes --image=075585003325/Flatcar-stable-2905.2.3-hvm --channel=alpha --networking=kopeio --container-runtime=containerd --admin-access 104.197.237.181/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones eu-west-3a --master-size c5.large
I0921 19:15:34.791745    4694 featureflag.go:165] FeatureFlag "SpecOverrideFlag"=true
I0921 19:15:34.791987    4694 featureflag.go:165] FeatureFlag "AlphaAllowGCE"=true
I0921 19:15:34.855454    4694 create_cluster.go:728] Using SSH public key: /etc/aws-ssh/aws-ssh-public
I0921 19:15:35.360094    4694 new_cluster.go:1011]  Cloud Provider ID = aws
... skipping 42 lines ...

I0921 19:16:01.598994    4652 up.go:181] /logs/artifacts/170e4607-1b10-11ec-996d-2e3f6126aee0/kops validate cluster --name e2e-0143302838-62691.test-cncf-aws.k8s.io --count 10 --wait 20m0s
I0921 19:16:01.623233    4715 featureflag.go:165] FeatureFlag "SpecOverrideFlag"=true
I0921 19:16:01.623359    4715 featureflag.go:165] FeatureFlag "AlphaAllowGCE"=true
Validating cluster e2e-0143302838-62691.test-cncf-aws.k8s.io

W0921 19:16:02.954621    4715 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-0143302838-62691.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:16:12.984709    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:16:23.027856    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:16:33.063844    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:16:43.101769    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:16:53.147149    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:17:03.182093    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:17:13.214075    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:17:23.245462    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:17:33.287027    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:17:43.318559    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:17:53.357580    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:18:03.390057    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:18:13.457236    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:18:23.499696    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:18:33.538576    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:18:43.576463    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:18:53.613639    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:19:03.649611    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:19:13.685100    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:19:23.725223    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:19:33.763001    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:19:43.800496    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:19:53.845886    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0921 19:20:03.881892    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

... skipping 9 lines ...
Machine	i-0b23ccf9b0c1ad58b				machine "i-0b23ccf9b0c1ad58b" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-klq65		system-cluster-critical pod "coredns-5dc785954d-klq65" is pending
Pod	kube-system/coredns-5dc785954d-kzbt7		system-cluster-critical pod "coredns-5dc785954d-kzbt7" is pending
Pod	kube-system/kopeio-networking-agent-8rzgd	system-node-critical pod "kopeio-networking-agent-8rzgd" is pending
Pod	kube-system/kopeio-networking-agent-lj8gw	system-node-critical pod "kopeio-networking-agent-lj8gw" is pending

Validation Failed
W0921 19:20:16.698714    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

... skipping 7 lines ...

VALIDATION ERRORS
KIND	NAME						MESSAGE
Node	ip-172-20-63-142.eu-west-3.compute.internal	node "ip-172-20-63-142.eu-west-3.compute.internal" of role "node" is not ready
Pod	kube-system/kopeio-networking-agent-nj7df	system-node-critical pod "kopeio-networking-agent-nj7df" is pending

Validation Failed
W0921 19:20:28.721504    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

... skipping 7 lines ...

VALIDATION ERRORS
KIND	NAME									MESSAGE
Pod	kube-system/kube-proxy-ip-172-20-35-229.eu-west-3.compute.internal	system-node-critical pod "kube-proxy-ip-172-20-35-229.eu-west-3.compute.internal" is pending
Pod	kube-system/kube-proxy-ip-172-20-63-30.eu-west-3.compute.internal	system-node-critical pod "kube-proxy-ip-172-20-63-30.eu-west-3.compute.internal" is pending

Validation Failed
W0921 19:20:40.614339    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

... skipping 6 lines ...
ip-172-20-63-30.eu-west-3.compute.internal	node	True

VALIDATION ERRORS
KIND	NAME									MESSAGE
Pod	kube-system/kube-proxy-ip-172-20-63-142.eu-west-3.compute.internal	system-node-critical pod "kube-proxy-ip-172-20-63-142.eu-west-3.compute.internal" is pending

Validation Failed
W0921 19:20:52.531667    4715 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-west-3a	Master	c5.large	1	1	eu-west-3a
nodes-eu-west-3a	Node	t3.medium	4	4	eu-west-3a

... skipping 757 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: local][LocalVolumeType: blockfs]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (immediate binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Driver local doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
... skipping 299 lines ...
Sep 21 19:23:24.964: INFO: pv is nil


S [SKIPPING] in Spec Setup (BeforeEach) [2.736 seconds]
[sig-storage] PersistentVolumes GCEPD
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  should test that deleting the PV before the pod does not cause pod deletion to fail on PD detach [BeforeEach]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-gce.go:142

  Only supported for providers [gce gke] (not aws)

  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-gce.go:85
------------------------------
... skipping 36 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:23:26.067: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "svcaccounts-7538" for this suite.

•
------------------------------
{"msg":"PASSED [sig-auth] ServiceAccounts should allow opting out of API token automount  [Conformance]","total":-1,"completed":1,"skipped":4,"failed":0}
[BeforeEach] [sig-storage] PersistentVolumes GCEPD
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:23:26.387: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename pv
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 31 lines ...
W0921 19:23:23.754697    5286 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
Sep 21 19:23:23.754: INFO: No PodSecurityPolicies found; assuming PodSecurityPolicy is disabled.
STEP: Waiting for a default service account to be provisioned in namespace
[It] should support seccomp unconfined on the container [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:161
STEP: Creating a pod to test seccomp.security.alpha.kubernetes.io/pod
Sep 21 19:23:24.066: INFO: Waiting up to 5m0s for pod "security-context-2ce3f90e-bba1-415a-8d7a-4a7a95ea3779" in namespace "security-context-356" to be "Succeeded or Failed"
Sep 21 19:23:24.170: INFO: Pod "security-context-2ce3f90e-bba1-415a-8d7a-4a7a95ea3779": Phase="Pending", Reason="", readiness=false. Elapsed: 103.413418ms
Sep 21 19:23:26.274: INFO: Pod "security-context-2ce3f90e-bba1-415a-8d7a-4a7a95ea3779": Phase="Pending", Reason="", readiness=false. Elapsed: 2.207662046s
Sep 21 19:23:28.380: INFO: Pod "security-context-2ce3f90e-bba1-415a-8d7a-4a7a95ea3779": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.314283164s
STEP: Saw pod success
Sep 21 19:23:28.381: INFO: Pod "security-context-2ce3f90e-bba1-415a-8d7a-4a7a95ea3779" satisfied condition "Succeeded or Failed"
Sep 21 19:23:28.484: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod security-context-2ce3f90e-bba1-415a-8d7a-4a7a95ea3779 container test-container: <nil>
STEP: delete the pod
Sep 21 19:23:29.028: INFO: Waiting for pod security-context-2ce3f90e-bba1-415a-8d7a-4a7a95ea3779 to disappear
Sep 21 19:23:29.131: INFO: Pod security-context-2ce3f90e-bba1-415a-8d7a-4a7a95ea3779 no longer exists
[AfterEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:7.283 seconds]
[sig-node] Security Context
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/framework.go:23
  should support seccomp unconfined on the container [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:161
------------------------------
{"msg":"PASSED [sig-node] Security Context should support seccomp unconfined on the container [LinuxOnly]","total":-1,"completed":1,"skipped":9,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:23:29.476: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 50 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-storage] Projected downwardAPI
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/projected_downwardapi.go:41
[It] should provide node allocatable (memory) as default memory limit if the limit is not set [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test downward API volume plugin
Sep 21 19:23:24.457: INFO: Waiting up to 5m0s for pod "downwardapi-volume-03c1467a-659a-4d8c-8850-33e945b12048" in namespace "projected-5507" to be "Succeeded or Failed"
Sep 21 19:23:24.563: INFO: Pod "downwardapi-volume-03c1467a-659a-4d8c-8850-33e945b12048": Phase="Pending", Reason="", readiness=false. Elapsed: 105.838936ms
Sep 21 19:23:26.668: INFO: Pod "downwardapi-volume-03c1467a-659a-4d8c-8850-33e945b12048": Phase="Pending", Reason="", readiness=false. Elapsed: 2.210771896s
Sep 21 19:23:28.773: INFO: Pod "downwardapi-volume-03c1467a-659a-4d8c-8850-33e945b12048": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.316443762s
STEP: Saw pod success
Sep 21 19:23:28.773: INFO: Pod "downwardapi-volume-03c1467a-659a-4d8c-8850-33e945b12048" satisfied condition "Succeeded or Failed"
Sep 21 19:23:28.879: INFO: Trying to get logs from node ip-172-20-35-229.eu-west-3.compute.internal pod downwardapi-volume-03c1467a-659a-4d8c-8850-33e945b12048 container client-container: <nil>
STEP: delete the pod
Sep 21 19:23:29.109: INFO: Waiting for pod downwardapi-volume-03c1467a-659a-4d8c-8850-33e945b12048 to disappear
Sep 21 19:23:29.213: INFO: Pod downwardapi-volume-03c1467a-659a-4d8c-8850-33e945b12048 no longer exists
[AfterEach] [sig-storage] Projected downwardAPI
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:7.353 seconds]
[sig-storage] Projected downwardAPI
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should provide node allocatable (memory) as default memory limit if the limit is not set [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Projected downwardAPI should provide node allocatable (memory) as default memory limit if the limit is not set [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":10,"failed":0}

S
------------------------------
[BeforeEach] [sig-storage] HostPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 4 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-storage] HostPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/host_path.go:37
[It] should support r/w [NodeConformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/host_path.go:65
STEP: Creating a pod to test hostPath r/w
Sep 21 19:23:22.489: INFO: Waiting up to 5m0s for pod "pod-host-path-test" in namespace "hostpath-4047" to be "Succeeded or Failed"
Sep 21 19:23:22.593: INFO: Pod "pod-host-path-test": Phase="Pending", Reason="", readiness=false. Elapsed: 104.053487ms
Sep 21 19:23:24.697: INFO: Pod "pod-host-path-test": Phase="Pending", Reason="", readiness=false. Elapsed: 2.208411589s
Sep 21 19:23:26.802: INFO: Pod "pod-host-path-test": Phase="Pending", Reason="", readiness=false. Elapsed: 4.313548661s
Sep 21 19:23:28.907: INFO: Pod "pod-host-path-test": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.418655244s
STEP: Saw pod success
Sep 21 19:23:28.908: INFO: Pod "pod-host-path-test" satisfied condition "Succeeded or Failed"
Sep 21 19:23:29.011: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod pod-host-path-test container test-container-2: <nil>
STEP: delete the pod
Sep 21 19:23:29.227: INFO: Waiting for pod pod-host-path-test to disappear
Sep 21 19:23:29.330: INFO: Pod pod-host-path-test no longer exists
[AfterEach] [sig-storage] HostPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 40 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-storage] Projected downwardAPI
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/projected_downwardapi.go:41
[It] should provide container's cpu request [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test downward API volume plugin
Sep 21 19:23:22.740: INFO: Waiting up to 5m0s for pod "downwardapi-volume-65567557-b79d-4044-a28b-7fa678377761" in namespace "projected-293" to be "Succeeded or Failed"
Sep 21 19:23:22.848: INFO: Pod "downwardapi-volume-65567557-b79d-4044-a28b-7fa678377761": Phase="Pending", Reason="", readiness=false. Elapsed: 107.462218ms
Sep 21 19:23:24.953: INFO: Pod "downwardapi-volume-65567557-b79d-4044-a28b-7fa678377761": Phase="Pending", Reason="", readiness=false. Elapsed: 2.212397793s
Sep 21 19:23:27.058: INFO: Pod "downwardapi-volume-65567557-b79d-4044-a28b-7fa678377761": Phase="Pending", Reason="", readiness=false. Elapsed: 4.317370156s
Sep 21 19:23:29.162: INFO: Pod "downwardapi-volume-65567557-b79d-4044-a28b-7fa678377761": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.421462988s
STEP: Saw pod success
Sep 21 19:23:29.162: INFO: Pod "downwardapi-volume-65567557-b79d-4044-a28b-7fa678377761" satisfied condition "Succeeded or Failed"
Sep 21 19:23:29.266: INFO: Trying to get logs from node ip-172-20-35-229.eu-west-3.compute.internal pod downwardapi-volume-65567557-b79d-4044-a28b-7fa678377761 container client-container: <nil>
STEP: delete the pod
Sep 21 19:23:29.477: INFO: Waiting for pod downwardapi-volume-65567557-b79d-4044-a28b-7fa678377761 to disappear
Sep 21 19:23:29.580: INFO: Pod downwardapi-volume-65567557-b79d-4044-a28b-7fa678377761 no longer exists
[AfterEach] [sig-storage] Projected downwardAPI
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:7.895 seconds]
[sig-storage] Projected downwardAPI
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should provide container's cpu request [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Projected downwardAPI should provide container's cpu request [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":0,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:23:29.912: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 48 lines ...
W0921 19:23:22.497482    5461 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
Sep 21 19:23:22.497: INFO: No PodSecurityPolicies found; assuming PodSecurityPolicy is disabled.
STEP: Waiting for a default service account to be provisioned in namespace
[It] volume on default medium should have the correct mode [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test emptydir volume type on node default medium
Sep 21 19:23:22.818: INFO: Waiting up to 5m0s for pod "pod-9f09662f-3866-48b4-a1ec-3fcc96af1e45" in namespace "emptydir-4410" to be "Succeeded or Failed"
Sep 21 19:23:22.927: INFO: Pod "pod-9f09662f-3866-48b4-a1ec-3fcc96af1e45": Phase="Pending", Reason="", readiness=false. Elapsed: 109.435514ms
Sep 21 19:23:25.033: INFO: Pod "pod-9f09662f-3866-48b4-a1ec-3fcc96af1e45": Phase="Pending", Reason="", readiness=false. Elapsed: 2.215084598s
Sep 21 19:23:27.137: INFO: Pod "pod-9f09662f-3866-48b4-a1ec-3fcc96af1e45": Phase="Pending", Reason="", readiness=false. Elapsed: 4.319743637s
Sep 21 19:23:29.242: INFO: Pod "pod-9f09662f-3866-48b4-a1ec-3fcc96af1e45": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.424677302s
STEP: Saw pod success
Sep 21 19:23:29.243: INFO: Pod "pod-9f09662f-3866-48b4-a1ec-3fcc96af1e45" satisfied condition "Succeeded or Failed"
Sep 21 19:23:29.347: INFO: Trying to get logs from node ip-172-20-53-119.eu-west-3.compute.internal pod pod-9f09662f-3866-48b4-a1ec-3fcc96af1e45 container test-container: <nil>
STEP: delete the pod
Sep 21 19:23:29.937: INFO: Waiting for pod pod-9f09662f-3866-48b4-a1ec-3fcc96af1e45 to disappear
Sep 21 19:23:30.040: INFO: Pod pod-9f09662f-3866-48b4-a1ec-3fcc96af1e45 no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:8.314 seconds]
[sig-storage] EmptyDir volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  volume on default medium should have the correct mode [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes volume on default medium should have the correct mode [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":0,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:23:30.374: INFO: Only supported for providers [azure] (not aws)
... skipping 49 lines ...
Sep 21 19:23:23.041: INFO: No PodSecurityPolicies found; assuming PodSecurityPolicy is disabled.
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable from pods in volume as non-root with FSGroup [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/projected_configmap.go:75
STEP: Creating configMap with name projected-configmap-test-volume-34b7d6a5-96c6-47b3-a91e-3bd6fbb3cadc
STEP: Creating a pod to test consume configMaps
Sep 21 19:23:23.479: INFO: Waiting up to 5m0s for pod "pod-projected-configmaps-a89336b7-4875-4ea5-a452-f4a081ed2254" in namespace "projected-7141" to be "Succeeded or Failed"
Sep 21 19:23:23.585: INFO: Pod "pod-projected-configmaps-a89336b7-4875-4ea5-a452-f4a081ed2254": Phase="Pending", Reason="", readiness=false. Elapsed: 106.190575ms
Sep 21 19:23:25.691: INFO: Pod "pod-projected-configmaps-a89336b7-4875-4ea5-a452-f4a081ed2254": Phase="Pending", Reason="", readiness=false. Elapsed: 2.211891147s
Sep 21 19:23:27.795: INFO: Pod "pod-projected-configmaps-a89336b7-4875-4ea5-a452-f4a081ed2254": Phase="Pending", Reason="", readiness=false. Elapsed: 4.316476335s
Sep 21 19:23:29.901: INFO: Pod "pod-projected-configmaps-a89336b7-4875-4ea5-a452-f4a081ed2254": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.422251589s
STEP: Saw pod success
Sep 21 19:23:29.901: INFO: Pod "pod-projected-configmaps-a89336b7-4875-4ea5-a452-f4a081ed2254" satisfied condition "Succeeded or Failed"
Sep 21 19:23:30.006: INFO: Trying to get logs from node ip-172-20-35-229.eu-west-3.compute.internal pod pod-projected-configmaps-a89336b7-4875-4ea5-a452-f4a081ed2254 container agnhost-container: <nil>
STEP: delete the pod
Sep 21 19:23:30.220: INFO: Waiting for pod pod-projected-configmaps-a89336b7-4875-4ea5-a452-f4a081ed2254 to disappear
Sep 21 19:23:30.324: INFO: Pod pod-projected-configmaps-a89336b7-4875-4ea5-a452-f4a081ed2254 no longer exists
[AfterEach] [sig-storage] Projected configMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:8.518 seconds]
[sig-storage] Projected configMap
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should be consumable from pods in volume as non-root with FSGroup [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/projected_configmap.go:75
------------------------------
{"msg":"PASSED [sig-storage] Projected configMap should be consumable from pods in volume as non-root with FSGroup [LinuxOnly] [NodeFeature:FSGroup]","total":-1,"completed":1,"skipped":7,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:23:30.650: INFO: Only supported for providers [azure] (not aws)
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 183 lines ...
W0921 19:23:23.420062    5435 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
Sep 21 19:23:23.420: INFO: No PodSecurityPolicies found; assuming PodSecurityPolicy is disabled.
STEP: Waiting for a default service account to be provisioned in namespace
[It] should support (non-root,0777,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test emptydir 0777 on tmpfs
Sep 21 19:23:23.741: INFO: Waiting up to 5m0s for pod "pod-988cdb06-94a7-43ac-83b5-c6a966d08bef" in namespace "emptydir-6703" to be "Succeeded or Failed"
Sep 21 19:23:23.846: INFO: Pod "pod-988cdb06-94a7-43ac-83b5-c6a966d08bef": Phase="Pending", Reason="", readiness=false. Elapsed: 104.373371ms
Sep 21 19:23:25.950: INFO: Pod "pod-988cdb06-94a7-43ac-83b5-c6a966d08bef": Phase="Pending", Reason="", readiness=false. Elapsed: 2.209114519s
Sep 21 19:23:28.067: INFO: Pod "pod-988cdb06-94a7-43ac-83b5-c6a966d08bef": Phase="Pending", Reason="", readiness=false. Elapsed: 4.325935316s
Sep 21 19:23:30.173: INFO: Pod "pod-988cdb06-94a7-43ac-83b5-c6a966d08bef": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.431341892s
STEP: Saw pod success
Sep 21 19:23:30.173: INFO: Pod "pod-988cdb06-94a7-43ac-83b5-c6a966d08bef" satisfied condition "Succeeded or Failed"
Sep 21 19:23:30.277: INFO: Trying to get logs from node ip-172-20-63-30.eu-west-3.compute.internal pod pod-988cdb06-94a7-43ac-83b5-c6a966d08bef container test-container: <nil>
STEP: delete the pod
Sep 21 19:23:30.830: INFO: Waiting for pod pod-988cdb06-94a7-43ac-83b5-c6a966d08bef to disappear
Sep 21 19:23:30.934: INFO: Pod pod-988cdb06-94a7-43ac-83b5-c6a966d08bef no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:9.112 seconds]
[sig-storage] EmptyDir volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should support (non-root,0777,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes should support (non-root,0777,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":8,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:23:31.257: INFO: Driver local doesn't support InlineVolume -- skipping
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 46 lines ...
Sep 21 19:23:22.479: INFO: No PodSecurityPolicies found; assuming PodSecurityPolicy is disabled.
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable from pods in volume with mappings as non-root [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating configMap with name configmap-test-volume-map-22a6aaf5-de4c-4b44-8d1f-0b716a9fd8a1
STEP: Creating a pod to test consume configMaps
Sep 21 19:23:22.896: INFO: Waiting up to 5m0s for pod "pod-configmaps-99994c8d-e372-48b8-8349-ef56e2223684" in namespace "configmap-8903" to be "Succeeded or Failed"
Sep 21 19:23:23.001: INFO: Pod "pod-configmaps-99994c8d-e372-48b8-8349-ef56e2223684": Phase="Pending", Reason="", readiness=false. Elapsed: 104.535057ms
Sep 21 19:23:25.106: INFO: Pod "pod-configmaps-99994c8d-e372-48b8-8349-ef56e2223684": Phase="Pending", Reason="", readiness=false. Elapsed: 2.209628727s
Sep 21 19:23:27.210: INFO: Pod "pod-configmaps-99994c8d-e372-48b8-8349-ef56e2223684": Phase="Pending", Reason="", readiness=false. Elapsed: 4.313631453s
Sep 21 19:23:29.314: INFO: Pod "pod-configmaps-99994c8d-e372-48b8-8349-ef56e2223684": Phase="Pending", Reason="", readiness=false. Elapsed: 6.417673651s
Sep 21 19:23:31.443: INFO: Pod "pod-configmaps-99994c8d-e372-48b8-8349-ef56e2223684": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.546977007s
STEP: Saw pod success
Sep 21 19:23:31.443: INFO: Pod "pod-configmaps-99994c8d-e372-48b8-8349-ef56e2223684" satisfied condition "Succeeded or Failed"
Sep 21 19:23:31.569: INFO: Trying to get logs from node ip-172-20-53-119.eu-west-3.compute.internal pod pod-configmaps-99994c8d-e372-48b8-8349-ef56e2223684 container agnhost-container: <nil>
STEP: delete the pod
Sep 21 19:23:31.784: INFO: Waiting for pod pod-configmaps-99994c8d-e372-48b8-8349-ef56e2223684 to disappear
Sep 21 19:23:31.890: INFO: Pod pod-configmaps-99994c8d-e372-48b8-8349-ef56e2223684 no longer exists
[AfterEach] [sig-storage] ConfigMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 22 lines ...
Sep 21 19:23:31.145: INFO: stderr: "Warning: v1 ComponentStatus is deprecated in v1.19+\n"
Sep 21 19:23:31.145: INFO: stdout: "controller-manager scheduler etcd-0 etcd-1"
STEP: getting details of componentstatuses
STEP: getting status of controller-manager
Sep 21 19:23:31.145: INFO: Running '/tmp/kubectl2224172770/kubectl --server=https://api.e2e-0143302838-62691.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-3211 get componentstatuses controller-manager'
Sep 21 19:23:31.622: INFO: stderr: "Warning: v1 ComponentStatus is deprecated in v1.19+\n"
Sep 21 19:23:31.622: INFO: stdout: "NAME                 STATUS    MESSAGE   ERROR\ncontroller-manager   Healthy   ok        \n"
STEP: getting status of scheduler
Sep 21 19:23:31.622: INFO: Running '/tmp/kubectl2224172770/kubectl --server=https://api.e2e-0143302838-62691.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-3211 get componentstatuses scheduler'
Sep 21 19:23:32.043: INFO: stderr: "Warning: v1 ComponentStatus is deprecated in v1.19+\n"
Sep 21 19:23:32.043: INFO: stdout: "NAME        STATUS    MESSAGE   ERROR\nscheduler   Healthy   ok        \n"
STEP: getting status of etcd-0
Sep 21 19:23:32.043: INFO: Running '/tmp/kubectl2224172770/kubectl --server=https://api.e2e-0143302838-62691.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-3211 get componentstatuses etcd-0'
Sep 21 19:23:32.600: INFO: stderr: "Warning: v1 ComponentStatus is deprecated in v1.19+\n"
Sep 21 19:23:32.600: INFO: stdout: "NAME     STATUS    MESSAGE             ERROR\netcd-0   Healthy   {\"health\":\"true\"}   \n"
STEP: getting status of etcd-1
Sep 21 19:23:32.600: INFO: Running '/tmp/kubectl2224172770/kubectl --server=https://api.e2e-0143302838-62691.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-3211 get componentstatuses etcd-1'
Sep 21 19:23:33.033: INFO: stderr: "Warning: v1 ComponentStatus is deprecated in v1.19+\n"
Sep 21 19:23:33.033: INFO: stdout: "NAME     STATUS    MESSAGE             ERROR\netcd-1   Healthy   {\"health\":\"true\"}   \n"
[AfterEach] [sig-cli] Kubectl client
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:23:33.033: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "kubectl-3211" for this suite.

•
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Kubectl get componentstatuses should get componentstatuses","total":-1,"completed":2,"skipped":14,"failed":0}

S
------------------------------
[BeforeEach] [sig-node] Pods
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 23 lines ...
• [SLOW TEST:11.521 seconds]
[sig-node] Pods
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should get a host IP [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Pods should get a host IP [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":0,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:23:33.571: INFO: Only supported for providers [gce gke] (not aws)
... skipping 105 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:23:33.996: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-limits-on-node-5027" for this suite.

•
------------------------------
{"msg":"PASSED [sig-storage] Volume limits should verify that all nodes have volume limits","total":-1,"completed":3,"skipped":15,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:23:34.219: INFO: Driver hostPath doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 67 lines ...
STEP: Building a namespace api object, basename projected
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable from pods in volume with mappings and Item mode set [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating configMap with name projected-configmap-test-volume-map-7eff04e3-2b6e-42b0-8b82-76a94355eaae
STEP: Creating a pod to test consume configMaps
Sep 21 19:23:31.580: INFO: Waiting up to 5m0s for pod "pod-projected-configmaps-13abe476-7fbf-436c-9242-988b9f69240e" in namespace "projected-1022" to be "Succeeded or Failed"
Sep 21 19:23:31.685: INFO: Pod "pod-projected-configmaps-13abe476-7fbf-436c-9242-988b9f69240e": Phase="Pending", Reason="", readiness=false. Elapsed: 104.80118ms
Sep 21 19:23:33.790: INFO: Pod "pod-projected-configmaps-13abe476-7fbf-436c-9242-988b9f69240e": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.209850979s
STEP: Saw pod success
Sep 21 19:23:33.790: INFO: Pod "pod-projected-configmaps-13abe476-7fbf-436c-9242-988b9f69240e" satisfied condition "Succeeded or Failed"
Sep 21 19:23:33.895: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod pod-projected-configmaps-13abe476-7fbf-436c-9242-988b9f69240e container agnhost-container: <nil>
STEP: delete the pod
Sep 21 19:23:34.110: INFO: Waiting for pod pod-projected-configmaps-13abe476-7fbf-436c-9242-988b9f69240e to disappear
Sep 21 19:23:34.215: INFO: Pod pod-projected-configmaps-13abe476-7fbf-436c-9242-988b9f69240e no longer exists
[AfterEach] [sig-storage] Projected configMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:23:34.215: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "projected-1022" for this suite.

•
------------------------------
{"msg":"PASSED [sig-storage] Projected configMap should be consumable from pods in volume with mappings and Item mode set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":29,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:23:34.459: INFO: Only supported for providers [gce gke] (not aws)
... skipping 71 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  when the NodeLease feature is enabled
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/node_lease.go:49
    the kubelet should report node status infrequently
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/node_lease.go:112
------------------------------
{"msg":"PASSED [sig-node] NodeLease when the NodeLease feature is enabled the kubelet should report node status infrequently","total":-1,"completed":2,"skipped":8,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:23:35.515: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 80 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/framework.go:23
  Kubectl client-side validation
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:982
    should create/apply a valid CR for CRD with validation schema
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1001
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Kubectl client-side validation should create/apply a valid CR for CRD with validation schema","total":-1,"completed":1,"skipped":0,"failed":0}

SSS
------------------------------
{"msg":"PASSED [sig-storage] ConfigMap should be consumable from pods in volume with mappings as non-root [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":0,"failed":0}
[BeforeEach] [sig-cli] Kubectl client
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:23:32.251: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename kubectl
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 33 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/framework.go:23
  Kubectl patch
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1460
    should add annotations for pods in rc  [Conformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Kubectl patch should add annotations for pods in rc  [Conformance]","total":-1,"completed":2,"skipped":0,"failed":0}

S
------------------------------
[BeforeEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 2 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:50
[It] volume on default medium should have the correct mode using FSGroup
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:71
STEP: Creating a pod to test emptydir volume type on node default medium
Sep 21 19:23:34.262: INFO: Waiting up to 5m0s for pod "pod-73782a25-54de-4c48-be13-493d4eab3a83" in namespace "emptydir-4601" to be "Succeeded or Failed"
Sep 21 19:23:34.366: INFO: Pod "pod-73782a25-54de-4c48-be13-493d4eab3a83": Phase="Pending", Reason="", readiness=false. Elapsed: 104.367134ms
Sep 21 19:23:36.472: INFO: Pod "pod-73782a25-54de-4c48-be13-493d4eab3a83": Phase="Pending", Reason="", readiness=false. Elapsed: 2.209477545s
Sep 21 19:23:38.578: INFO: Pod "pod-73782a25-54de-4c48-be13-493d4eab3a83": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.315579701s
STEP: Saw pod success
Sep 21 19:23:38.578: INFO: Pod "pod-73782a25-54de-4c48-be13-493d4eab3a83" satisfied condition "Succeeded or Failed"
Sep 21 19:23:38.684: INFO: Trying to get logs from node ip-172-20-35-229.eu-west-3.compute.internal pod pod-73782a25-54de-4c48-be13-493d4eab3a83 container test-container: <nil>
STEP: delete the pod
Sep 21 19:23:38.951: INFO: Waiting for pod pod-73782a25-54de-4c48-be13-493d4eab3a83 to disappear
Sep 21 19:23:39.055: INFO: Pod pod-73782a25-54de-4c48-be13-493d4eab3a83 no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 6 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:48
    volume on default medium should have the correct mode using FSGroup
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:71
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup] volume on default medium should have the correct mode using FSGroup","total":-1,"completed":2,"skipped":9,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:23:39.281: INFO: Only supported for providers [gce gke] (not aws)
[AfterEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 97 lines ...
STEP: Destroying namespace "apply-1299" for this suite.
[AfterEach] [sig-api-machinery] ServerSideApply
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/apply.go:56

•
------------------------------
{"msg":"PASSED [sig-api-machinery] ServerSideApply should ignore conflict errors if force apply is used","total":-1,"completed":3,"skipped":1,"failed":0}

S
------------------------------
[BeforeEach] [sig-storage] Projected secret
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:23:34.499: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename projected
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable in multiple volumes in a pod [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating secret with name projected-secret-test-64937361-5be9-4d14-b52b-e885099698c5
STEP: Creating a pod to test consume secrets
Sep 21 19:23:35.243: INFO: Waiting up to 5m0s for pod "pod-projected-secrets-5a5a1b1e-476c-48cb-b41c-74b1aecb1c11" in namespace "projected-8968" to be "Succeeded or Failed"
Sep 21 19:23:35.347: INFO: Pod "pod-projected-secrets-5a5a1b1e-476c-48cb-b41c-74b1aecb1c11": Phase="Pending", Reason="", readiness=false. Elapsed: 104.302291ms
Sep 21 19:23:37.454: INFO: Pod "pod-projected-secrets-5a5a1b1e-476c-48cb-b41c-74b1aecb1c11": Phase="Running", Reason="", readiness=true. Elapsed: 2.211264378s
Sep 21 19:23:39.560: INFO: Pod "pod-projected-secrets-5a5a1b1e-476c-48cb-b41c-74b1aecb1c11": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.317219986s
STEP: Saw pod success
Sep 21 19:23:39.560: INFO: Pod "pod-projected-secrets-5a5a1b1e-476c-48cb-b41c-74b1aecb1c11" satisfied condition "Succeeded or Failed"
Sep 21 19:23:39.666: INFO: Trying to get logs from node ip-172-20-53-119.eu-west-3.compute.internal pod pod-projected-secrets-5a5a1b1e-476c-48cb-b41c-74b1aecb1c11 container secret-volume-test: <nil>
STEP: delete the pod
Sep 21 19:23:39.881: INFO: Waiting for pod pod-projected-secrets-5a5a1b1e-476c-48cb-b41c-74b1aecb1c11 to disappear
Sep 21 19:23:39.985: INFO: Pod pod-projected-secrets-5a5a1b1e-476c-48cb-b41c-74b1aecb1c11 no longer exists
[AfterEach] [sig-storage] Projected secret
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:5.698 seconds]
[sig-storage] Projected secret
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should be consumable in multiple volumes in a pod [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Projected secret should be consumable in multiple volumes in a pod [NodeConformance] [Conformance]","total":-1,"completed":3,"skipped":38,"failed":0}
[BeforeEach] [sig-api-machinery] Servers with support for Table transformation
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:23:40.209: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename tables
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 6 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:23:41.505: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "tables-6800" for this suite.

•
------------------------------
{"msg":"PASSED [sig-api-machinery] Servers with support for Table transformation should return chunks of table results for list calls","total":-1,"completed":4,"skipped":38,"failed":0}

SSSSSSSSSSS
------------------------------
[BeforeEach] [sig-api-machinery] ResourceQuota
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 22 lines ...
• [SLOW TEST:14.915 seconds]
[sig-api-machinery] ResourceQuota
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should create a ResourceQuota and capture the life of a pod. [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a pod. [Conformance]","total":-1,"completed":2,"skipped":21,"failed":0}

S
------------------------------
[BeforeEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 29 lines ...
• [SLOW TEST:15.870 seconds]
[sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  works for CRD preserving unknown fields in an embedded object [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD preserving unknown fields in an embedded object [Conformance]","total":-1,"completed":2,"skipped":15,"failed":0}

SSSSSSS
------------------------------
[BeforeEach] [sig-apps] DisruptionController
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 19 lines ...
• [SLOW TEST:9.561 seconds]
[sig-apps] DisruptionController
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  should observe PodDisruptionBudget status updated [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-apps] DisruptionController should observe PodDisruptionBudget status updated [Conformance]","total":-1,"completed":4,"skipped":2,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:23:49.291: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian)
[AfterEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 2 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: gluster]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (delayed binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Only supported for node OS distro [gci ubuntu custom] (not debian)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:263
------------------------------
{"msg":"PASSED [sig-storage] HostPath should support r/w [NodeConformance]","total":-1,"completed":1,"skipped":1,"failed":0}
[BeforeEach] [sig-node] Pods Extended
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:23:29.548: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename pods
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 21 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/framework.go:23
  Delete Grace Period
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pods.go:51
    should be submitted and removed
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pods.go:62
------------------------------
{"msg":"PASSED [sig-node] Pods Extended Delete Grace Period should be submitted and removed","total":-1,"completed":2,"skipped":1,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:23:50.248: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian)
... skipping 39 lines ...
Sep 21 19:23:42.681: INFO: PersistentVolumeClaim pvc-67skh found but phase is Pending instead of Bound.
Sep 21 19:23:44.787: INFO: PersistentVolumeClaim pvc-67skh found and phase=Bound (4.315969916s)
Sep 21 19:23:44.787: INFO: Waiting up to 3m0s for PersistentVolume local-k82h4 to have phase Bound
Sep 21 19:23:44.891: INFO: PersistentVolume local-k82h4 found and phase=Bound (104.290278ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-wcwr
STEP: Creating a pod to test subpath
Sep 21 19:23:45.213: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-wcwr" in namespace "provisioning-7076" to be "Succeeded or Failed"
Sep 21 19:23:45.319: INFO: Pod "pod-subpath-test-preprovisionedpv-wcwr": Phase="Pending", Reason="", readiness=false. Elapsed: 106.096607ms
Sep 21 19:23:47.425: INFO: Pod "pod-subpath-test-preprovisionedpv-wcwr": Phase="Pending", Reason="", readiness=false. Elapsed: 2.212253597s
Sep 21 19:23:49.531: INFO: Pod "pod-subpath-test-preprovisionedpv-wcwr": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.318398009s
STEP: Saw pod success
Sep 21 19:23:49.531: INFO: Pod "pod-subpath-test-preprovisionedpv-wcwr" satisfied condition "Succeeded or Failed"
Sep 21 19:23:49.643: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod pod-subpath-test-preprovisionedpv-wcwr container test-container-volume-preprovisionedpv-wcwr: <nil>
STEP: delete the pod
Sep 21 19:23:49.864: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-wcwr to disappear
Sep 21 19:23:49.969: INFO: Pod pod-subpath-test-preprovisionedpv-wcwr no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-wcwr
Sep 21 19:23:49.969: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-wcwr" in namespace "provisioning-7076"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support non-existent path
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:194
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-bindmounted] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path","total":-1,"completed":2,"skipped":3,"failed":0}

SSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:23:51.516: INFO: Driver hostPathSymlink doesn't support DynamicPV -- skipping
... skipping 43 lines ...
Sep 21 19:23:41.248: INFO: PersistentVolumeClaim pvc-nww8c found but phase is Pending instead of Bound.
Sep 21 19:23:43.353: INFO: PersistentVolumeClaim pvc-nww8c found and phase=Bound (12.740533898s)
Sep 21 19:23:43.353: INFO: Waiting up to 3m0s for PersistentVolume local-6k8fs to have phase Bound
Sep 21 19:23:43.457: INFO: PersistentVolume local-6k8fs found and phase=Bound (103.580931ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-bs9f
STEP: Creating a pod to test subpath
Sep 21 19:23:43.771: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-bs9f" in namespace "provisioning-5734" to be "Succeeded or Failed"
Sep 21 19:23:43.875: INFO: Pod "pod-subpath-test-preprovisionedpv-bs9f": Phase="Pending", Reason="", readiness=false. Elapsed: 104.126814ms
Sep 21 19:23:45.980: INFO: Pod "pod-subpath-test-preprovisionedpv-bs9f": Phase="Pending", Reason="", readiness=false. Elapsed: 2.208646149s
Sep 21 19:23:48.084: INFO: Pod "pod-subpath-test-preprovisionedpv-bs9f": Phase="Pending", Reason="", readiness=false. Elapsed: 4.313283373s
Sep 21 19:23:50.189: INFO: Pod "pod-subpath-test-preprovisionedpv-bs9f": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.417727637s
STEP: Saw pod success
Sep 21 19:23:50.189: INFO: Pod "pod-subpath-test-preprovisionedpv-bs9f" satisfied condition "Succeeded or Failed"
Sep 21 19:23:50.293: INFO: Trying to get logs from node ip-172-20-63-30.eu-west-3.compute.internal pod pod-subpath-test-preprovisionedpv-bs9f container test-container-subpath-preprovisionedpv-bs9f: <nil>
STEP: delete the pod
Sep 21 19:23:50.523: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-bs9f to disappear
Sep 21 19:23:50.628: INFO: Pod pod-subpath-test-preprovisionedpv-bs9f no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-bs9f
Sep 21 19:23:50.628: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-bs9f" in namespace "provisioning-5734"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support readOnly file specified in the volumeMount [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:384
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]","total":-1,"completed":1,"skipped":1,"failed":0}

SSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
... skipping 16 lines ...
Sep 21 19:23:41.661: INFO: PersistentVolumeClaim pvc-wpx8x found but phase is Pending instead of Bound.
Sep 21 19:23:43.766: INFO: PersistentVolumeClaim pvc-wpx8x found and phase=Bound (4.323917924s)
Sep 21 19:23:43.766: INFO: Waiting up to 3m0s for PersistentVolume local-k4lc2 to have phase Bound
Sep 21 19:23:43.870: INFO: PersistentVolume local-k4lc2 found and phase=Bound (103.179381ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-m6jg
STEP: Creating a pod to test subpath
Sep 21 19:23:44.187: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-m6jg" in namespace "provisioning-5984" to be "Succeeded or Failed"
Sep 21 19:23:44.294: INFO: Pod "pod-subpath-test-preprovisionedpv-m6jg": Phase="Pending", Reason="", readiness=false. Elapsed: 107.668535ms
Sep 21 19:23:46.398: INFO: Pod "pod-subpath-test-preprovisionedpv-m6jg": Phase="Pending", Reason="", readiness=false. Elapsed: 2.211640375s
Sep 21 19:23:48.506: INFO: Pod "pod-subpath-test-preprovisionedpv-m6jg": Phase="Pending", Reason="", readiness=false. Elapsed: 4.319560523s
Sep 21 19:23:50.610: INFO: Pod "pod-subpath-test-preprovisionedpv-m6jg": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.42307893s
STEP: Saw pod success
Sep 21 19:23:50.610: INFO: Pod "pod-subpath-test-preprovisionedpv-m6jg" satisfied condition "Succeeded or Failed"
Sep 21 19:23:50.713: INFO: Trying to get logs from node ip-172-20-63-30.eu-west-3.compute.internal pod pod-subpath-test-preprovisionedpv-m6jg container test-container-subpath-preprovisionedpv-m6jg: <nil>
STEP: delete the pod
Sep 21 19:23:50.928: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-m6jg to disappear
Sep 21 19:23:51.031: INFO: Pod pod-subpath-test-preprovisionedpv-m6jg no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-m6jg
Sep 21 19:23:51.031: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-m6jg" in namespace "provisioning-5984"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support readOnly file specified in the volumeMount [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:384
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link-bindmounted] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]","total":-1,"completed":3,"skipped":16,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:23:52.523: INFO: Driver csi-hostpath doesn't support PreprovisionedPV -- skipping
... skipping 86 lines ...
• [SLOW TEST:18.588 seconds]
[sig-api-machinery] ResourceQuota
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should create a ResourceQuota and capture the life of a secret. [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a secret. [Conformance]","total":-1,"completed":4,"skipped":45,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:23:53.002: INFO: Only supported for providers [azure] (not aws)
[AfterEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 126 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-storage] Downward API volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/downwardapi_volume.go:41
[It] should set mode on item file [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test downward API volume plugin
Sep 21 19:23:52.170: INFO: Waiting up to 5m0s for pod "downwardapi-volume-57dc79ba-2a94-45b2-aa92-ecdbfa53612f" in namespace "downward-api-9577" to be "Succeeded or Failed"
Sep 21 19:23:52.275: INFO: Pod "downwardapi-volume-57dc79ba-2a94-45b2-aa92-ecdbfa53612f": Phase="Pending", Reason="", readiness=false. Elapsed: 104.286139ms
Sep 21 19:23:54.380: INFO: Pod "downwardapi-volume-57dc79ba-2a94-45b2-aa92-ecdbfa53612f": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.209869615s
STEP: Saw pod success
Sep 21 19:23:54.381: INFO: Pod "downwardapi-volume-57dc79ba-2a94-45b2-aa92-ecdbfa53612f" satisfied condition "Succeeded or Failed"
Sep 21 19:23:54.486: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod downwardapi-volume-57dc79ba-2a94-45b2-aa92-ecdbfa53612f container client-container: <nil>
STEP: delete the pod
Sep 21 19:23:54.701: INFO: Waiting for pod downwardapi-volume-57dc79ba-2a94-45b2-aa92-ecdbfa53612f to disappear
Sep 21 19:23:54.806: INFO: Pod downwardapi-volume-57dc79ba-2a94-45b2-aa92-ecdbfa53612f no longer exists
[AfterEach] [sig-storage] Downward API volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:23:54.806: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "downward-api-9577" for this suite.

•
------------------------------
{"msg":"PASSED [sig-storage] Downward API volume should set mode on item file [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":3,"skipped":9,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-windows] Services
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/windows/framework.go:28
Sep 21 19:23:55.050: INFO: Only supported for node OS distro [windows] (not debian)
... skipping 64 lines ...
STEP: Building a namespace api object, basename secrets
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be able to mount in a volume regardless of a different secret existing with same name in different namespace [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating secret with name secret-test-bf65f816-5116-48a3-9314-f385621fbe57
STEP: Creating a pod to test consume secrets
Sep 21 19:23:50.441: INFO: Waiting up to 5m0s for pod "pod-secrets-e0910040-a5c1-4bf0-abc4-aba85b00dd5d" in namespace "secrets-6109" to be "Succeeded or Failed"
Sep 21 19:23:50.544: INFO: Pod "pod-secrets-e0910040-a5c1-4bf0-abc4-aba85b00dd5d": Phase="Pending", Reason="", readiness=false. Elapsed: 103.011102ms
Sep 21 19:23:52.649: INFO: Pod "pod-secrets-e0910040-a5c1-4bf0-abc4-aba85b00dd5d": Phase="Pending", Reason="", readiness=false. Elapsed: 2.208491629s
Sep 21 19:23:54.754: INFO: Pod "pod-secrets-e0910040-a5c1-4bf0-abc4-aba85b00dd5d": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.312947058s
STEP: Saw pod success
Sep 21 19:23:54.754: INFO: Pod "pod-secrets-e0910040-a5c1-4bf0-abc4-aba85b00dd5d" satisfied condition "Succeeded or Failed"
Sep 21 19:23:54.862: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod pod-secrets-e0910040-a5c1-4bf0-abc4-aba85b00dd5d container secret-volume-test: <nil>
STEP: delete the pod
Sep 21 19:23:55.084: INFO: Waiting for pod pod-secrets-e0910040-a5c1-4bf0-abc4-aba85b00dd5d to disappear
Sep 21 19:23:55.186: INFO: Pod pod-secrets-e0910040-a5c1-4bf0-abc4-aba85b00dd5d no longer exists
[AfterEach] [sig-storage] Secrets
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 5 lines ...
• [SLOW TEST:6.211 seconds]
[sig-storage] Secrets
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should be able to mount in a volume regardless of a different secret existing with same name in different namespace [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Secrets should be able to mount in a volume regardless of a different secret existing with same name in different namespace [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":3,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
... skipping 26 lines ...
Sep 21 19:23:42.203: INFO: PersistentVolumeClaim pvc-p4cwg found but phase is Pending instead of Bound.
Sep 21 19:23:44.311: INFO: PersistentVolumeClaim pvc-p4cwg found and phase=Bound (10.636420041s)
Sep 21 19:23:44.311: INFO: Waiting up to 3m0s for PersistentVolume local-4h4bb to have phase Bound
Sep 21 19:23:44.417: INFO: PersistentVolume local-4h4bb found and phase=Bound (106.327025ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-6ncx
STEP: Creating a pod to test subpath
Sep 21 19:23:44.731: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-6ncx" in namespace "provisioning-6174" to be "Succeeded or Failed"
Sep 21 19:23:44.834: INFO: Pod "pod-subpath-test-preprovisionedpv-6ncx": Phase="Pending", Reason="", readiness=false. Elapsed: 102.957615ms
Sep 21 19:23:46.938: INFO: Pod "pod-subpath-test-preprovisionedpv-6ncx": Phase="Pending", Reason="", readiness=false. Elapsed: 2.206612754s
Sep 21 19:23:49.043: INFO: Pod "pod-subpath-test-preprovisionedpv-6ncx": Phase="Pending", Reason="", readiness=false. Elapsed: 4.31140102s
Sep 21 19:23:51.147: INFO: Pod "pod-subpath-test-preprovisionedpv-6ncx": Phase="Pending", Reason="", readiness=false. Elapsed: 6.415431584s
Sep 21 19:23:53.252: INFO: Pod "pod-subpath-test-preprovisionedpv-6ncx": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.52030463s
STEP: Saw pod success
Sep 21 19:23:53.252: INFO: Pod "pod-subpath-test-preprovisionedpv-6ncx" satisfied condition "Succeeded or Failed"
Sep 21 19:23:53.366: INFO: Trying to get logs from node ip-172-20-35-229.eu-west-3.compute.internal pod pod-subpath-test-preprovisionedpv-6ncx container test-container-volume-preprovisionedpv-6ncx: <nil>
STEP: delete the pod
Sep 21 19:23:53.639: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-6ncx to disappear
Sep 21 19:23:53.743: INFO: Pod pod-subpath-test-preprovisionedpv-6ncx no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-6ncx
Sep 21 19:23:53.743: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-6ncx" in namespace "provisioning-6174"
... skipping 26 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support non-existent path
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:194
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: blockfs] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path","total":-1,"completed":1,"skipped":13,"failed":0}

SSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
... skipping 25 lines ...
Sep 21 19:23:42.802: INFO: PersistentVolumeClaim pvc-pd7x5 found but phase is Pending instead of Bound.
Sep 21 19:23:44.904: INFO: PersistentVolumeClaim pvc-pd7x5 found and phase=Bound (12.728823843s)
Sep 21 19:23:44.904: INFO: Waiting up to 3m0s for PersistentVolume local-l27ts to have phase Bound
Sep 21 19:23:45.006: INFO: PersistentVolume local-l27ts found and phase=Bound (101.590054ms)
STEP: Creating pod exec-volume-test-preprovisionedpv-lj6r
STEP: Creating a pod to test exec-volume-test
Sep 21 19:23:45.315: INFO: Waiting up to 5m0s for pod "exec-volume-test-preprovisionedpv-lj6r" in namespace "volume-3445" to be "Succeeded or Failed"
Sep 21 19:23:45.417: INFO: Pod "exec-volume-test-preprovisionedpv-lj6r": Phase="Pending", Reason="", readiness=false. Elapsed: 101.376328ms
Sep 21 19:23:47.519: INFO: Pod "exec-volume-test-preprovisionedpv-lj6r": Phase="Pending", Reason="", readiness=false. Elapsed: 2.203652457s
Sep 21 19:23:49.622: INFO: Pod "exec-volume-test-preprovisionedpv-lj6r": Phase="Pending", Reason="", readiness=false. Elapsed: 4.306597338s
Sep 21 19:23:51.724: INFO: Pod "exec-volume-test-preprovisionedpv-lj6r": Phase="Pending", Reason="", readiness=false. Elapsed: 6.408822241s
Sep 21 19:23:53.829: INFO: Pod "exec-volume-test-preprovisionedpv-lj6r": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.513685592s
STEP: Saw pod success
Sep 21 19:23:53.829: INFO: Pod "exec-volume-test-preprovisionedpv-lj6r" satisfied condition "Succeeded or Failed"
Sep 21 19:23:53.935: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod exec-volume-test-preprovisionedpv-lj6r container exec-container-preprovisionedpv-lj6r: <nil>
STEP: delete the pod
Sep 21 19:23:54.142: INFO: Waiting for pod exec-volume-test-preprovisionedpv-lj6r to disappear
Sep 21 19:23:54.244: INFO: Pod exec-volume-test-preprovisionedpv-lj6r no longer exists
STEP: Deleting pod exec-volume-test-preprovisionedpv-lj6r
Sep 21 19:23:54.244: INFO: Deleting pod "exec-volume-test-preprovisionedpv-lj6r" in namespace "volume-3445"
... skipping 24 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should allow exec of files on the volume
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: blockfs] [Testpattern: Pre-provisioned PV (default fs)] volumes should allow exec of files on the volume","total":-1,"completed":1,"skipped":13,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:23:57.759: INFO: Driver local doesn't support ext4 -- skipping
... skipping 46 lines ...
Sep 21 19:23:50.289: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename emptydir
STEP: Waiting for a default service account to be provisioned in namespace
[It] should support (non-root,0644,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test emptydir 0644 on tmpfs
Sep 21 19:23:50.920: INFO: Waiting up to 5m0s for pod "pod-014474d0-49f6-4e51-ae16-24834ebbb0ca" in namespace "emptydir-5901" to be "Succeeded or Failed"
Sep 21 19:23:51.024: INFO: Pod "pod-014474d0-49f6-4e51-ae16-24834ebbb0ca": Phase="Pending", Reason="", readiness=false. Elapsed: 103.406816ms
Sep 21 19:23:53.132: INFO: Pod "pod-014474d0-49f6-4e51-ae16-24834ebbb0ca": Phase="Pending", Reason="", readiness=false. Elapsed: 2.212130376s
Sep 21 19:23:55.242: INFO: Pod "pod-014474d0-49f6-4e51-ae16-24834ebbb0ca": Phase="Pending", Reason="", readiness=false. Elapsed: 4.321775365s
Sep 21 19:23:57.350: INFO: Pod "pod-014474d0-49f6-4e51-ae16-24834ebbb0ca": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.430154459s
STEP: Saw pod success
Sep 21 19:23:57.350: INFO: Pod "pod-014474d0-49f6-4e51-ae16-24834ebbb0ca" satisfied condition "Succeeded or Failed"
Sep 21 19:23:57.454: INFO: Trying to get logs from node ip-172-20-35-229.eu-west-3.compute.internal pod pod-014474d0-49f6-4e51-ae16-24834ebbb0ca container test-container: <nil>
STEP: delete the pod
Sep 21 19:23:57.669: INFO: Waiting for pod pod-014474d0-49f6-4e51-ae16-24834ebbb0ca to disappear
Sep 21 19:23:57.772: INFO: Pod pod-014474d0-49f6-4e51-ae16-24834ebbb0ca no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:7.693 seconds]
[sig-storage] EmptyDir volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should support (non-root,0644,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes should support (non-root,0644,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":3,"skipped":8,"failed":0}

S
------------------------------
[BeforeEach] [sig-storage] Downward API volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 18 lines ...
• [SLOW TEST:8.204 seconds]
[sig-storage] Downward API volume
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should update annotations on modification [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Downward API volume should update annotations on modification [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":46,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:01.243: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 23 lines ...
Sep 21 19:23:57.829: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename emptydir
STEP: Waiting for a default service account to be provisioned in namespace
[It] should support (non-root,0777,default) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test emptydir 0777 on node default medium
Sep 21 19:23:58.447: INFO: Waiting up to 5m0s for pod "pod-b84e621c-e3a9-433e-ab49-16c80fd801eb" in namespace "emptydir-7412" to be "Succeeded or Failed"
Sep 21 19:23:58.549: INFO: Pod "pod-b84e621c-e3a9-433e-ab49-16c80fd801eb": Phase="Pending", Reason="", readiness=false. Elapsed: 102.08679ms
Sep 21 19:24:00.652: INFO: Pod "pod-b84e621c-e3a9-433e-ab49-16c80fd801eb": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.204952415s
STEP: Saw pod success
Sep 21 19:24:00.652: INFO: Pod "pod-b84e621c-e3a9-433e-ab49-16c80fd801eb" satisfied condition "Succeeded or Failed"
Sep 21 19:24:00.753: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod pod-b84e621c-e3a9-433e-ab49-16c80fd801eb container test-container: <nil>
STEP: delete the pod
Sep 21 19:24:00.960: INFO: Waiting for pod pod-b84e621c-e3a9-433e-ab49-16c80fd801eb to disappear
Sep 21 19:24:01.061: INFO: Pod pod-b84e621c-e3a9-433e-ab49-16c80fd801eb no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 20 lines ...
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159

      Driver local doesn't support InlineVolume -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes should support (non-root,0777,default) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":24,"failed":0}

SSSS
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes pod should support shared volumes between containers [Conformance]","total":-1,"completed":1,"skipped":11,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:23:33.719: INFO: >>> kubeConfig: /root/.kube/config
... skipping 43 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should be able to unmount after the subpath directory is deleted [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:449
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]","total":-1,"completed":2,"skipped":11,"failed":0}

S
------------------------------
[BeforeEach] [sig-storage] PersistentVolumes-local 
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 271 lines ...
• [SLOW TEST:5.256 seconds]
[sig-apps] DisruptionController
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  evictions: no PDB => should allow an eviction
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/disruption.go:267
------------------------------
{"msg":"PASSED [sig-apps] DisruptionController evictions: no PDB =\u003e should allow an eviction","total":-1,"completed":2,"skipped":18,"failed":0}

SSSSSSS
------------------------------
[BeforeEach] [sig-node] PodTemplates
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 15 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:24:02.820: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "podtemplate-6024" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] PodTemplates should delete a collection of pod templates [Conformance]","total":-1,"completed":4,"skipped":27,"failed":0}

S
------------------------------
[BeforeEach] [sig-instrumentation] MetricsGrabber
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 10 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:24:02.823: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "metrics-grabber-4995" for this suite.

•S
------------------------------
{"msg":"PASSED [sig-instrumentation] MetricsGrabber should grab all metrics from a Kubelet.","total":-1,"completed":6,"skipped":51,"failed":0}

SSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:03.097: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 74 lines ...
Sep 21 19:23:31.875: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
STEP: creating a test aws volume
Sep 21 19:23:32.601: INFO: Successfully created a new PD: "aws://eu-west-3a/vol-07715e82d281b3f37".
Sep 21 19:23:32.602: INFO: Creating resource for inline volume
STEP: Creating pod exec-volume-test-inlinevolume-mpkp
STEP: Creating a pod to test exec-volume-test
Sep 21 19:23:32.711: INFO: Waiting up to 5m0s for pod "exec-volume-test-inlinevolume-mpkp" in namespace "volume-3373" to be "Succeeded or Failed"
Sep 21 19:23:32.815: INFO: Pod "exec-volume-test-inlinevolume-mpkp": Phase="Pending", Reason="", readiness=false. Elapsed: 103.660826ms
Sep 21 19:23:34.919: INFO: Pod "exec-volume-test-inlinevolume-mpkp": Phase="Pending", Reason="", readiness=false. Elapsed: 2.208251644s
Sep 21 19:23:37.026: INFO: Pod "exec-volume-test-inlinevolume-mpkp": Phase="Pending", Reason="", readiness=false. Elapsed: 4.314890861s
Sep 21 19:23:39.131: INFO: Pod "exec-volume-test-inlinevolume-mpkp": Phase="Pending", Reason="", readiness=false. Elapsed: 6.419702661s
Sep 21 19:23:41.236: INFO: Pod "exec-volume-test-inlinevolume-mpkp": Phase="Pending", Reason="", readiness=false. Elapsed: 8.52504312s
Sep 21 19:23:43.342: INFO: Pod "exec-volume-test-inlinevolume-mpkp": Phase="Pending", Reason="", readiness=false. Elapsed: 10.631096449s
Sep 21 19:23:45.448: INFO: Pod "exec-volume-test-inlinevolume-mpkp": Phase="Pending", Reason="", readiness=false. Elapsed: 12.736390431s
Sep 21 19:23:47.553: INFO: Pod "exec-volume-test-inlinevolume-mpkp": Phase="Pending", Reason="", readiness=false. Elapsed: 14.841671788s
Sep 21 19:23:49.657: INFO: Pod "exec-volume-test-inlinevolume-mpkp": Phase="Pending", Reason="", readiness=false. Elapsed: 16.945597457s
Sep 21 19:23:51.761: INFO: Pod "exec-volume-test-inlinevolume-mpkp": Phase="Succeeded", Reason="", readiness=false. Elapsed: 19.049972724s
STEP: Saw pod success
Sep 21 19:23:51.761: INFO: Pod "exec-volume-test-inlinevolume-mpkp" satisfied condition "Succeeded or Failed"
Sep 21 19:23:51.867: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod exec-volume-test-inlinevolume-mpkp container exec-container-inlinevolume-mpkp: <nil>
STEP: delete the pod
Sep 21 19:23:52.083: INFO: Waiting for pod exec-volume-test-inlinevolume-mpkp to disappear
Sep 21 19:23:52.186: INFO: Pod exec-volume-test-inlinevolume-mpkp no longer exists
STEP: Deleting pod exec-volume-test-inlinevolume-mpkp
Sep 21 19:23:52.186: INFO: Deleting pod "exec-volume-test-inlinevolume-mpkp" in namespace "volume-3373"
Sep 21 19:23:52.493: INFO: Couldn't delete PD "aws://eu-west-3a/vol-07715e82d281b3f37", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-07715e82d281b3f37 is currently attached to i-091b483121e935118
	status code: 400, request id: e1045851-edd5-4848-b928-3a0d3f71c7d9
Sep 21 19:23:58.073: INFO: Couldn't delete PD "aws://eu-west-3a/vol-07715e82d281b3f37", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-07715e82d281b3f37 is currently attached to i-091b483121e935118
	status code: 400, request id: 130c9fb0-e616-45fa-9b65-5ceca140b356
Sep 21 19:24:03.625: INFO: Successfully deleted PD "aws://eu-west-3a/vol-07715e82d281b3f37".
[AfterEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:24:03.625: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-3373" for this suite.
... skipping 6 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (ext4)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should allow exec of files on the volume
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Inline-volume (ext4)] volumes should allow exec of files on the volume","total":-1,"completed":2,"skipped":15,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:03.861: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 127 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should be able to unmount after the subpath directory is deleted [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:449
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: tmpfs] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]","total":-1,"completed":1,"skipped":1,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:05.839: INFO: Only supported for providers [gce gke] (not aws)
... skipping 65 lines ...
• [SLOW TEST:22.200 seconds]
[sig-node] Probing container
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should be restarted with a /healthz http liveness probe [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Probing container should be restarted with a /healthz http liveness probe [NodeConformance] [Conformance]","total":-1,"completed":3,"skipped":22,"failed":0}

SS
------------------------------
{"msg":"PASSED [sig-storage] Ephemeralstorage When pod refers to non-existent ephemeral storage should allow deletion of pod with invalid volume : projected","total":-1,"completed":1,"skipped":19,"failed":0}
[BeforeEach] [sig-node] Downward API
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:24:04.174: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename downward-api
STEP: Waiting for a default service account to be provisioned in namespace
[It] should provide host IP and pod IP as an env var if pod uses host network [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/downwardapi.go:109
STEP: Creating a pod to test downward api env vars
Sep 21 19:24:04.808: INFO: Waiting up to 5m0s for pod "downward-api-b4841856-5ff2-4194-86e4-60e97d7034af" in namespace "downward-api-2606" to be "Succeeded or Failed"
Sep 21 19:24:04.913: INFO: Pod "downward-api-b4841856-5ff2-4194-86e4-60e97d7034af": Phase="Pending", Reason="", readiness=false. Elapsed: 104.696118ms
Sep 21 19:24:07.019: INFO: Pod "downward-api-b4841856-5ff2-4194-86e4-60e97d7034af": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.210384869s
STEP: Saw pod success
Sep 21 19:24:07.019: INFO: Pod "downward-api-b4841856-5ff2-4194-86e4-60e97d7034af" satisfied condition "Succeeded or Failed"
Sep 21 19:24:07.123: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod downward-api-b4841856-5ff2-4194-86e4-60e97d7034af container dapi-container: <nil>
STEP: delete the pod
Sep 21 19:24:07.338: INFO: Waiting for pod downward-api-b4841856-5ff2-4194-86e4-60e97d7034af to disappear
Sep 21 19:24:07.443: INFO: Pod downward-api-b4841856-5ff2-4194-86e4-60e97d7034af no longer exists
[AfterEach] [sig-node] Downward API
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:24:07.443: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "downward-api-2606" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Downward API should provide host IP and pod IP as an env var if pod uses host network [LinuxOnly]","total":-1,"completed":2,"skipped":19,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:07.676: INFO: Only supported for providers [azure] (not aws)
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 215 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:192
    Two pods mounting a local volume at the same time
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:248
      should be able to write from pod1 and read from pod2
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:249
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: blockfswithformat] Two pods mounting a local volume at the same time should be able to write from pod1 and read from pod2","total":-1,"completed":5,"skipped":49,"failed":0}

SSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:12.238: INFO: Only supported for providers [gce gke] (not aws)
... skipping 44 lines ...
• [SLOW TEST:8.718 seconds]
[sig-apps] ReplicaSet
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  Replace and Patch tests [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-apps] ReplicaSet Replace and Patch tests [Conformance]","total":-1,"completed":3,"skipped":21,"failed":0}

SSSSSSS
------------------------------
[BeforeEach] [sig-node] Variable Expansion
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:24:07.740: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename var-expansion
STEP: Waiting for a default service account to be provisioned in namespace
[It] should allow substituting values in a container's command [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test substitution in container's command
Sep 21 19:24:08.373: INFO: Waiting up to 5m0s for pod "var-expansion-5826b9c9-e8e8-423f-baea-7ece5e569ffb" in namespace "var-expansion-1835" to be "Succeeded or Failed"
Sep 21 19:24:08.478: INFO: Pod "var-expansion-5826b9c9-e8e8-423f-baea-7ece5e569ffb": Phase="Pending", Reason="", readiness=false. Elapsed: 104.948089ms
Sep 21 19:24:10.585: INFO: Pod "var-expansion-5826b9c9-e8e8-423f-baea-7ece5e569ffb": Phase="Pending", Reason="", readiness=false. Elapsed: 2.211743864s
Sep 21 19:24:12.691: INFO: Pod "var-expansion-5826b9c9-e8e8-423f-baea-7ece5e569ffb": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.318375679s
STEP: Saw pod success
Sep 21 19:24:12.692: INFO: Pod "var-expansion-5826b9c9-e8e8-423f-baea-7ece5e569ffb" satisfied condition "Succeeded or Failed"
Sep 21 19:24:12.798: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod var-expansion-5826b9c9-e8e8-423f-baea-7ece5e569ffb container dapi-container: <nil>
STEP: delete the pod
Sep 21 19:24:13.013: INFO: Waiting for pod var-expansion-5826b9c9-e8e8-423f-baea-7ece5e569ffb to disappear
Sep 21 19:24:13.117: INFO: Pod var-expansion-5826b9c9-e8e8-423f-baea-7ece5e569ffb no longer exists
[AfterEach] [sig-node] Variable Expansion
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:5.591 seconds]
[sig-node] Variable Expansion
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should allow substituting values in a container's command [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Variable Expansion should allow substituting values in a container's command [NodeConformance] [Conformance]","total":-1,"completed":3,"skipped":25,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:13.348: INFO: Driver csi-hostpath doesn't support PreprovisionedPV -- skipping
[AfterEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 50 lines ...
Sep 21 19:23:30.946: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-6561jsxvs
STEP: creating a claim
Sep 21 19:23:31.050: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-t42p
STEP: Creating a pod to test subpath
Sep 21 19:23:31.364: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-t42p" in namespace "provisioning-6561" to be "Succeeded or Failed"
Sep 21 19:23:31.469: INFO: Pod "pod-subpath-test-dynamicpv-t42p": Phase="Pending", Reason="", readiness=false. Elapsed: 105.517168ms
Sep 21 19:23:33.574: INFO: Pod "pod-subpath-test-dynamicpv-t42p": Phase="Pending", Reason="", readiness=false. Elapsed: 2.209714282s
Sep 21 19:23:35.679: INFO: Pod "pod-subpath-test-dynamicpv-t42p": Phase="Pending", Reason="", readiness=false. Elapsed: 4.315172037s
Sep 21 19:23:37.788: INFO: Pod "pod-subpath-test-dynamicpv-t42p": Phase="Pending", Reason="", readiness=false. Elapsed: 6.424089428s
Sep 21 19:23:39.893: INFO: Pod "pod-subpath-test-dynamicpv-t42p": Phase="Pending", Reason="", readiness=false. Elapsed: 8.528962328s
Sep 21 19:23:41.997: INFO: Pod "pod-subpath-test-dynamicpv-t42p": Phase="Pending", Reason="", readiness=false. Elapsed: 10.633114008s
... skipping 2 lines ...
Sep 21 19:23:48.311: INFO: Pod "pod-subpath-test-dynamicpv-t42p": Phase="Pending", Reason="", readiness=false. Elapsed: 16.947254754s
Sep 21 19:23:50.417: INFO: Pod "pod-subpath-test-dynamicpv-t42p": Phase="Pending", Reason="", readiness=false. Elapsed: 19.052960329s
Sep 21 19:23:52.522: INFO: Pod "pod-subpath-test-dynamicpv-t42p": Phase="Pending", Reason="", readiness=false. Elapsed: 21.158417385s
Sep 21 19:23:54.633: INFO: Pod "pod-subpath-test-dynamicpv-t42p": Phase="Pending", Reason="", readiness=false. Elapsed: 23.268687332s
Sep 21 19:23:56.737: INFO: Pod "pod-subpath-test-dynamicpv-t42p": Phase="Succeeded", Reason="", readiness=false. Elapsed: 25.373135475s
STEP: Saw pod success
Sep 21 19:23:56.737: INFO: Pod "pod-subpath-test-dynamicpv-t42p" satisfied condition "Succeeded or Failed"
Sep 21 19:23:56.841: INFO: Trying to get logs from node ip-172-20-35-229.eu-west-3.compute.internal pod pod-subpath-test-dynamicpv-t42p container test-container-subpath-dynamicpv-t42p: <nil>
STEP: delete the pod
Sep 21 19:23:57.056: INFO: Waiting for pod pod-subpath-test-dynamicpv-t42p to disappear
Sep 21 19:23:57.159: INFO: Pod pod-subpath-test-dynamicpv-t42p no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-t42p
Sep 21 19:23:57.159: INFO: Deleting pod "pod-subpath-test-dynamicpv-t42p" in namespace "provisioning-6561"
... skipping 41 lines ...
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:157

      Only supported for providers [openstack] (not aws)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:1092
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount","total":-1,"completed":2,"skipped":11,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
... skipping 22 lines ...
Sep 21 19:23:41.963: INFO: PersistentVolumeClaim pvc-mkwcz found but phase is Pending instead of Bound.
Sep 21 19:23:44.066: INFO: PersistentVolumeClaim pvc-mkwcz found and phase=Bound (12.746994028s)
Sep 21 19:23:44.066: INFO: Waiting up to 3m0s for PersistentVolume local-llfk7 to have phase Bound
Sep 21 19:23:44.167: INFO: PersistentVolume local-llfk7 found and phase=Bound (101.572631ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-pg25
STEP: Creating a pod to test atomic-volume-subpath
Sep 21 19:23:44.476: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-pg25" in namespace "provisioning-8887" to be "Succeeded or Failed"
Sep 21 19:23:44.580: INFO: Pod "pod-subpath-test-preprovisionedpv-pg25": Phase="Pending", Reason="", readiness=false. Elapsed: 103.527382ms
Sep 21 19:23:46.683: INFO: Pod "pod-subpath-test-preprovisionedpv-pg25": Phase="Pending", Reason="", readiness=false. Elapsed: 2.206225096s
Sep 21 19:23:48.786: INFO: Pod "pod-subpath-test-preprovisionedpv-pg25": Phase="Pending", Reason="", readiness=false. Elapsed: 4.309770212s
Sep 21 19:23:50.890: INFO: Pod "pod-subpath-test-preprovisionedpv-pg25": Phase="Pending", Reason="", readiness=false. Elapsed: 6.413352938s
Sep 21 19:23:52.993: INFO: Pod "pod-subpath-test-preprovisionedpv-pg25": Phase="Pending", Reason="", readiness=false. Elapsed: 8.516657114s
Sep 21 19:23:55.097: INFO: Pod "pod-subpath-test-preprovisionedpv-pg25": Phase="Running", Reason="", readiness=true. Elapsed: 10.620690722s
... skipping 3 lines ...
Sep 21 19:24:03.512: INFO: Pod "pod-subpath-test-preprovisionedpv-pg25": Phase="Running", Reason="", readiness=true. Elapsed: 19.035881184s
Sep 21 19:24:05.615: INFO: Pod "pod-subpath-test-preprovisionedpv-pg25": Phase="Running", Reason="", readiness=true. Elapsed: 21.138603048s
Sep 21 19:24:07.721: INFO: Pod "pod-subpath-test-preprovisionedpv-pg25": Phase="Running", Reason="", readiness=true. Elapsed: 23.244815353s
Sep 21 19:24:09.829: INFO: Pod "pod-subpath-test-preprovisionedpv-pg25": Phase="Running", Reason="", readiness=true. Elapsed: 25.352551129s
Sep 21 19:24:11.932: INFO: Pod "pod-subpath-test-preprovisionedpv-pg25": Phase="Succeeded", Reason="", readiness=false. Elapsed: 27.455925574s
STEP: Saw pod success
Sep 21 19:24:11.933: INFO: Pod "pod-subpath-test-preprovisionedpv-pg25" satisfied condition "Succeeded or Failed"
Sep 21 19:24:12.035: INFO: Trying to get logs from node ip-172-20-53-119.eu-west-3.compute.internal pod pod-subpath-test-preprovisionedpv-pg25 container test-container-subpath-preprovisionedpv-pg25: <nil>
STEP: delete the pod
Sep 21 19:24:12.246: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-pg25 to disappear
Sep 21 19:24:12.349: INFO: Pod pod-subpath-test-preprovisionedpv-pg25 no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-pg25
Sep 21 19:24:12.349: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-pg25" in namespace "provisioning-8887"
... skipping 37 lines ...
STEP: Destroying namespace "node-problem-detector-1803" for this suite.


S [SKIPPING] in Spec Setup (BeforeEach) [0.731 seconds]
[sig-node] NodeProblemDetector
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/framework.go:23
  should run without error [BeforeEach]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:60

  Only supported for providers [gce gke] (not aws)

  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/node_problem_detector.go:55
------------------------------
... skipping 74 lines ...
Sep 21 19:23:41.660: INFO: PersistentVolumeClaim pvc-5hnfl found but phase is Pending instead of Bound.
Sep 21 19:23:43.765: INFO: PersistentVolumeClaim pvc-5hnfl found and phase=Bound (12.754114287s)
Sep 21 19:23:43.765: INFO: Waiting up to 3m0s for PersistentVolume local-9wb2l to have phase Bound
Sep 21 19:23:43.869: INFO: PersistentVolume local-9wb2l found and phase=Bound (103.561357ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-b2zh
STEP: Creating a pod to test atomic-volume-subpath
Sep 21 19:23:44.189: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-b2zh" in namespace "provisioning-916" to be "Succeeded or Failed"
Sep 21 19:23:44.295: INFO: Pod "pod-subpath-test-preprovisionedpv-b2zh": Phase="Pending", Reason="", readiness=false. Elapsed: 105.316429ms
Sep 21 19:23:46.398: INFO: Pod "pod-subpath-test-preprovisionedpv-b2zh": Phase="Pending", Reason="", readiness=false. Elapsed: 2.209030744s
Sep 21 19:23:48.506: INFO: Pod "pod-subpath-test-preprovisionedpv-b2zh": Phase="Pending", Reason="", readiness=false. Elapsed: 4.316603732s
Sep 21 19:23:50.611: INFO: Pod "pod-subpath-test-preprovisionedpv-b2zh": Phase="Pending", Reason="", readiness=false. Elapsed: 6.421194508s
Sep 21 19:23:52.715: INFO: Pod "pod-subpath-test-preprovisionedpv-b2zh": Phase="Pending", Reason="", readiness=false. Elapsed: 8.526023856s
Sep 21 19:23:54.821: INFO: Pod "pod-subpath-test-preprovisionedpv-b2zh": Phase="Running", Reason="", readiness=true. Elapsed: 10.631427684s
... skipping 3 lines ...
Sep 21 19:24:03.242: INFO: Pod "pod-subpath-test-preprovisionedpv-b2zh": Phase="Running", Reason="", readiness=true. Elapsed: 19.052633124s
Sep 21 19:24:05.346: INFO: Pod "pod-subpath-test-preprovisionedpv-b2zh": Phase="Running", Reason="", readiness=true. Elapsed: 21.156816352s
Sep 21 19:24:07.451: INFO: Pod "pod-subpath-test-preprovisionedpv-b2zh": Phase="Running", Reason="", readiness=true. Elapsed: 23.262021357s
Sep 21 19:24:09.557: INFO: Pod "pod-subpath-test-preprovisionedpv-b2zh": Phase="Running", Reason="", readiness=true. Elapsed: 25.367425024s
Sep 21 19:24:11.665: INFO: Pod "pod-subpath-test-preprovisionedpv-b2zh": Phase="Succeeded", Reason="", readiness=false. Elapsed: 27.475998058s
STEP: Saw pod success
Sep 21 19:24:11.666: INFO: Pod "pod-subpath-test-preprovisionedpv-b2zh" satisfied condition "Succeeded or Failed"
Sep 21 19:24:11.770: INFO: Trying to get logs from node ip-172-20-53-119.eu-west-3.compute.internal pod pod-subpath-test-preprovisionedpv-b2zh container test-container-subpath-preprovisionedpv-b2zh: <nil>
STEP: delete the pod
Sep 21 19:24:11.992: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-b2zh to disappear
Sep 21 19:24:12.096: INFO: Pod pod-subpath-test-preprovisionedpv-b2zh no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-b2zh
Sep 21 19:24:12.097: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-b2zh" in namespace "provisioning-916"
... skipping 22 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support file as subpath [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:230
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: tmpfs] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]","total":-1,"completed":1,"skipped":4,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:14.346: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 48 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeFeature:Sysctls]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/sysctl.go:64
[It] should support unsafe sysctls which are actually allowed [MinimumKubeletVersion:1.21] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod with the kernel.shm_rmid_forced sysctl
STEP: Watching for error events or started pod
STEP: Waiting for pod completion
STEP: Checking that the pod succeeded
STEP: Getting logs from the pod
STEP: Checking that the sysctl is actually updated
[AfterEach] [sig-node] Sysctls [LinuxOnly] [NodeFeature:Sysctls]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:24:16.501: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "sysctl-7361" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Sysctls [LinuxOnly] [NodeFeature:Sysctls] should support unsafe sysctls which are actually allowed [MinimumKubeletVersion:1.21] [Conformance]","total":-1,"completed":4,"skipped":32,"failed":0}

SS
------------------------------
[BeforeEach] [sig-apps] Deployment
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 35 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  test Deployment ReplicaSet orphaning and adoption regarding controllerRef
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:133
------------------------------
SS
------------------------------
{"msg":"PASSED [sig-apps] Deployment test Deployment ReplicaSet orphaning and adoption regarding controllerRef","total":-1,"completed":3,"skipped":30,"failed":0}

SSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:16.795: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 65 lines ...
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:246

      Only supported for node OS distro [gci ubuntu custom] (not debian)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:263
------------------------------
{"msg":"PASSED [sig-node] Probing container should be restarted with an exec liveness probe with timeout [MinimumKubeletVersion:1.20] [NodeConformance]","total":-1,"completed":1,"skipped":6,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:16.900: INFO: Driver supports dynamic provisioning, skipping InlineVolume pattern
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 232 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:192
    One pod requesting one prebound PVC
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:209
      should be able to mount volume and write from pod1
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:238
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: dir-bindmounted] One pod requesting one prebound PVC should be able to mount volume and write from pod1","total":-1,"completed":2,"skipped":9,"failed":0}

SSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:18.550: INFO: Driver hostPath doesn't support PreprovisionedPV -- skipping
... skipping 179 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:192
    Two pods mounting a local volume one after the other
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:254
      should be able to write from pod1 and read from pod2
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:255
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: dir] Two pods mounting a local volume one after the other should be able to write from pod1 and read from pod2","total":-1,"completed":5,"skipped":43,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:20.315: INFO: Driver emptydir doesn't support PreprovisionedPV -- skipping
[AfterEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 156 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/framework.go:23
  Simple pod
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:376
    should support exec
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:388
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Simple pod should support exec","total":-1,"completed":3,"skipped":28,"failed":0}

S
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-bindmounted] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]","total":-1,"completed":1,"skipped":9,"failed":0}
[BeforeEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:24:13.795: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename emptydir
STEP: Waiting for a default service account to be provisioned in namespace
[It] should support (root,0666,default) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test emptydir 0666 on node default medium
Sep 21 19:24:14.412: INFO: Waiting up to 5m0s for pod "pod-bf604aef-4715-42d8-9da9-e8251afa40ff" in namespace "emptydir-3595" to be "Succeeded or Failed"
Sep 21 19:24:14.514: INFO: Pod "pod-bf604aef-4715-42d8-9da9-e8251afa40ff": Phase="Pending", Reason="", readiness=false. Elapsed: 102.05739ms
Sep 21 19:24:16.617: INFO: Pod "pod-bf604aef-4715-42d8-9da9-e8251afa40ff": Phase="Pending", Reason="", readiness=false. Elapsed: 2.204515634s
Sep 21 19:24:18.720: INFO: Pod "pod-bf604aef-4715-42d8-9da9-e8251afa40ff": Phase="Pending", Reason="", readiness=false. Elapsed: 4.307891103s
Sep 21 19:24:20.826: INFO: Pod "pod-bf604aef-4715-42d8-9da9-e8251afa40ff": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.413869597s
STEP: Saw pod success
Sep 21 19:24:20.826: INFO: Pod "pod-bf604aef-4715-42d8-9da9-e8251afa40ff" satisfied condition "Succeeded or Failed"
Sep 21 19:24:20.930: INFO: Trying to get logs from node ip-172-20-53-119.eu-west-3.compute.internal pod pod-bf604aef-4715-42d8-9da9-e8251afa40ff container test-container: <nil>
STEP: delete the pod
Sep 21 19:24:21.140: INFO: Waiting for pod pod-bf604aef-4715-42d8-9da9-e8251afa40ff to disappear
Sep 21 19:24:21.243: INFO: Pod pod-bf604aef-4715-42d8-9da9-e8251afa40ff no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:7.657 seconds]
[sig-storage] EmptyDir volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should support (root,0666,default) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes should support (root,0666,default) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":9,"failed":0}

SSSSSSSSSS
------------------------------
[BeforeEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:24:17.119: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename security-context-test
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:46
[It] should not allow privilege escalation when false [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
Sep 21 19:24:17.755: INFO: Waiting up to 5m0s for pod "alpine-nnp-false-7fbd201a-8e17-4649-bba9-8f166da15ed1" in namespace "security-context-test-4424" to be "Succeeded or Failed"
Sep 21 19:24:17.861: INFO: Pod "alpine-nnp-false-7fbd201a-8e17-4649-bba9-8f166da15ed1": Phase="Pending", Reason="", readiness=false. Elapsed: 105.938893ms
Sep 21 19:24:19.973: INFO: Pod "alpine-nnp-false-7fbd201a-8e17-4649-bba9-8f166da15ed1": Phase="Pending", Reason="", readiness=false. Elapsed: 2.218419957s
Sep 21 19:24:22.083: INFO: Pod "alpine-nnp-false-7fbd201a-8e17-4649-bba9-8f166da15ed1": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.327951482s
Sep 21 19:24:22.083: INFO: Pod "alpine-nnp-false-7fbd201a-8e17-4649-bba9-8f166da15ed1" satisfied condition "Succeeded or Failed"
[AfterEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:24:22.199: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "security-context-test-4424" for this suite.


... skipping 2 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  when creating containers with AllowPrivilegeEscalation
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:296
    should not allow privilege escalation when false [LinuxOnly] [NodeConformance] [Conformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Security Context when creating containers with AllowPrivilegeEscalation should not allow privilege escalation when false [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":21,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:22.427: INFO: Driver hostPathSymlink doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 50 lines ...
Sep 21 19:23:53.107: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(aws) supported size:{ 1Gi} 
STEP: creating a StorageClass volume-expand-5438l8cfs
STEP: creating a claim
Sep 21 19:23:53.214: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Expanding non-expandable pvc
Sep 21 19:23:53.435: INFO: currentPvcSize {{1073741824 0} {<nil>} 1Gi BinarySI}, newSize {{2147483648 0} {<nil>}  BinarySI}
Sep 21 19:23:53.645: INFO: Error updating pvc awsw8t5m: PersistentVolumeClaim "awsw8t5m" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-5438l8cfs",
  	... // 2 identical fields
  }

Sep 21 19:23:55.862: INFO: Error updating pvc awsw8t5m: PersistentVolumeClaim "awsw8t5m" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-5438l8cfs",
  	... // 2 identical fields
  }

Sep 21 19:23:57.855: INFO: Error updating pvc awsw8t5m: PersistentVolumeClaim "awsw8t5m" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-5438l8cfs",
  	... // 2 identical fields
  }

Sep 21 19:23:59.853: INFO: Error updating pvc awsw8t5m: PersistentVolumeClaim "awsw8t5m" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-5438l8cfs",
  	... // 2 identical fields
  }

Sep 21 19:24:01.855: INFO: Error updating pvc awsw8t5m: PersistentVolumeClaim "awsw8t5m" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-5438l8cfs",
  	... // 2 identical fields
  }

Sep 21 19:24:03.854: INFO: Error updating pvc awsw8t5m: PersistentVolumeClaim "awsw8t5m" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-5438l8cfs",
  	... // 2 identical fields
  }

Sep 21 19:24:05.853: INFO: Error updating pvc awsw8t5m: PersistentVolumeClaim "awsw8t5m" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-5438l8cfs",
  	... // 2 identical fields
  }

Sep 21 19:24:07.855: INFO: Error updating pvc awsw8t5m: PersistentVolumeClaim "awsw8t5m" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-5438l8cfs",
  	... // 2 identical fields
  }

Sep 21 19:24:09.858: INFO: Error updating pvc awsw8t5m: PersistentVolumeClaim "awsw8t5m" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-5438l8cfs",
  	... // 2 identical fields
  }

Sep 21 19:24:11.857: INFO: Error updating pvc awsw8t5m: PersistentVolumeClaim "awsw8t5m" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-5438l8cfs",
  	... // 2 identical fields
  }

Sep 21 19:24:13.856: INFO: Error updating pvc awsw8t5m: PersistentVolumeClaim "awsw8t5m" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-5438l8cfs",
  	... // 2 identical fields
  }

Sep 21 19:24:15.852: INFO: Error updating pvc awsw8t5m: PersistentVolumeClaim "awsw8t5m" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-5438l8cfs",
  	... // 2 identical fields
  }

Sep 21 19:24:17.858: INFO: Error updating pvc awsw8t5m: PersistentVolumeClaim "awsw8t5m" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-5438l8cfs",
  	... // 2 identical fields
  }

Sep 21 19:24:19.856: INFO: Error updating pvc awsw8t5m: PersistentVolumeClaim "awsw8t5m" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-5438l8cfs",
  	... // 2 identical fields
  }

Sep 21 19:24:21.859: INFO: Error updating pvc awsw8t5m: PersistentVolumeClaim "awsw8t5m" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-5438l8cfs",
  	... // 2 identical fields
  }

Sep 21 19:24:23.853: INFO: Error updating pvc awsw8t5m: PersistentVolumeClaim "awsw8t5m" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-5438l8cfs",
  	... // 2 identical fields
  }

Sep 21 19:24:24.060: INFO: Error updating pvc awsw8t5m: PersistentVolumeClaim "awsw8t5m" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 24 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (default fs)] volume-expand
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should not allow expansion of pvcs without AllowVolumeExpansion property
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:157
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property","total":-1,"completed":4,"skipped":26,"failed":0}

SSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:24.643: INFO: Only supported for providers [gce gke] (not aws)
... skipping 24 lines ...
STEP: Building a namespace api object, basename secrets
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating secret with name secret-test-2272ea19-5967-4dfb-948e-85660d23bdc2
STEP: Creating a pod to test consume secrets
Sep 21 19:24:21.155: INFO: Waiting up to 5m0s for pod "pod-secrets-23c6fd1e-b322-4cad-bfe9-537bd1bdd4f4" in namespace "secrets-9294" to be "Succeeded or Failed"
Sep 21 19:24:21.260: INFO: Pod "pod-secrets-23c6fd1e-b322-4cad-bfe9-537bd1bdd4f4": Phase="Pending", Reason="", readiness=false. Elapsed: 104.425123ms
Sep 21 19:24:23.364: INFO: Pod "pod-secrets-23c6fd1e-b322-4cad-bfe9-537bd1bdd4f4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.209218806s
Sep 21 19:24:25.472: INFO: Pod "pod-secrets-23c6fd1e-b322-4cad-bfe9-537bd1bdd4f4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.316753251s
Sep 21 19:24:27.580: INFO: Pod "pod-secrets-23c6fd1e-b322-4cad-bfe9-537bd1bdd4f4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.424906213s
STEP: Saw pod success
Sep 21 19:24:27.580: INFO: Pod "pod-secrets-23c6fd1e-b322-4cad-bfe9-537bd1bdd4f4" satisfied condition "Succeeded or Failed"
Sep 21 19:24:27.685: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod pod-secrets-23c6fd1e-b322-4cad-bfe9-537bd1bdd4f4 container secret-volume-test: <nil>
STEP: delete the pod
Sep 21 19:24:27.900: INFO: Waiting for pod pod-secrets-23c6fd1e-b322-4cad-bfe9-537bd1bdd4f4 to disappear
Sep 21 19:24:28.008: INFO: Pod pod-secrets-23c6fd1e-b322-4cad-bfe9-537bd1bdd4f4 no longer exists
[AfterEach] [sig-storage] Secrets
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:7.806 seconds]
[sig-storage] Secrets
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Secrets should be consumable from pods in volume as non-root with defaultMode and fsGroup set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":6,"skipped":54,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:28.239: INFO: Driver local doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 35 lines ...
• [SLOW TEST:38.319 seconds]
[sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  updates the published spec when one version gets renamed [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] updates the published spec when one version gets renamed [Conformance]","total":-1,"completed":2,"skipped":7,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
... skipping 20 lines ...
Sep 21 19:24:12.144: INFO: PersistentVolumeClaim pvc-lz5vx found but phase is Pending instead of Bound.
Sep 21 19:24:14.252: INFO: PersistentVolumeClaim pvc-lz5vx found and phase=Bound (6.424194866s)
Sep 21 19:24:14.252: INFO: Waiting up to 3m0s for PersistentVolume local-wj2g4 to have phase Bound
Sep 21 19:24:14.357: INFO: PersistentVolume local-wj2g4 found and phase=Bound (104.388736ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-lmsk
STEP: Creating a pod to test subpath
Sep 21 19:24:14.672: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-lmsk" in namespace "provisioning-417" to be "Succeeded or Failed"
Sep 21 19:24:14.777: INFO: Pod "pod-subpath-test-preprovisionedpv-lmsk": Phase="Pending", Reason="", readiness=false. Elapsed: 104.681786ms
Sep 21 19:24:16.883: INFO: Pod "pod-subpath-test-preprovisionedpv-lmsk": Phase="Pending", Reason="", readiness=false. Elapsed: 2.210375119s
Sep 21 19:24:18.990: INFO: Pod "pod-subpath-test-preprovisionedpv-lmsk": Phase="Pending", Reason="", readiness=false. Elapsed: 4.317301876s
Sep 21 19:24:21.096: INFO: Pod "pod-subpath-test-preprovisionedpv-lmsk": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.423115445s
STEP: Saw pod success
Sep 21 19:24:21.096: INFO: Pod "pod-subpath-test-preprovisionedpv-lmsk" satisfied condition "Succeeded or Failed"
Sep 21 19:24:21.200: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod pod-subpath-test-preprovisionedpv-lmsk container test-container-subpath-preprovisionedpv-lmsk: <nil>
STEP: delete the pod
Sep 21 19:24:21.417: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-lmsk to disappear
Sep 21 19:24:21.521: INFO: Pod pod-subpath-test-preprovisionedpv-lmsk no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-lmsk
Sep 21 19:24:21.521: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-lmsk" in namespace "provisioning-417"
STEP: Creating pod pod-subpath-test-preprovisionedpv-lmsk
STEP: Creating a pod to test subpath
Sep 21 19:24:21.733: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-lmsk" in namespace "provisioning-417" to be "Succeeded or Failed"
Sep 21 19:24:21.840: INFO: Pod "pod-subpath-test-preprovisionedpv-lmsk": Phase="Pending", Reason="", readiness=false. Elapsed: 107.069106ms
Sep 21 19:24:23.946: INFO: Pod "pod-subpath-test-preprovisionedpv-lmsk": Phase="Pending", Reason="", readiness=false. Elapsed: 2.213188154s
Sep 21 19:24:26.051: INFO: Pod "pod-subpath-test-preprovisionedpv-lmsk": Phase="Pending", Reason="", readiness=false. Elapsed: 4.318708326s
Sep 21 19:24:28.158: INFO: Pod "pod-subpath-test-preprovisionedpv-lmsk": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.425351194s
STEP: Saw pod success
Sep 21 19:24:28.158: INFO: Pod "pod-subpath-test-preprovisionedpv-lmsk" satisfied condition "Succeeded or Failed"
Sep 21 19:24:28.264: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod pod-subpath-test-preprovisionedpv-lmsk container test-container-subpath-preprovisionedpv-lmsk: <nil>
STEP: delete the pod
Sep 21 19:24:28.506: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-lmsk to disappear
Sep 21 19:24:28.611: INFO: Pod pod-subpath-test-preprovisionedpv-lmsk no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-lmsk
Sep 21 19:24:28.612: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-lmsk" in namespace "provisioning-417"
... skipping 24 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support existing directories when readOnly specified in the volumeSource
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:399
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: block] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource","total":-1,"completed":7,"skipped":58,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:31.652: INFO: Only supported for providers [gce gke] (not aws)
[AfterEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 2 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: gcepd]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (immediate binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Only supported for providers [gce gke] (not aws)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:1301
------------------------------
... skipping 152 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_volumes.go:40
    [Testpattern: Dynamic PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should be able to unmount after the subpath directory is deleted [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:449
------------------------------
{"msg":"PASSED [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]","total":-1,"completed":1,"skipped":0,"failed":0}

SS
------------------------------
[BeforeEach] [sig-cli] Kubectl client
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 12 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:24:32.948: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "kubectl-8874" for this suite.

•
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Kubectl cluster-info should check if Kubernetes control plane services is included in cluster-info  [Conformance]","total":-1,"completed":2,"skipped":2,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:33.181: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 28 lines ...
[sig-storage] CSI Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: csi-hostpath]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_volumes.go:40
    [Testpattern: Dynamic PV (immediate binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Driver "csi-hostpath" does not support topology - skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:92
------------------------------
... skipping 8 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:50
[It] new files should be created with FSGroup ownership when container is non-root
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:59
STEP: Creating a pod to test emptydir 0644 on tmpfs
Sep 21 19:24:27.403: INFO: Waiting up to 5m0s for pod "pod-8efec22b-e46b-45c0-a362-3e8c7f1043b1" in namespace "emptydir-6716" to be "Succeeded or Failed"
Sep 21 19:24:27.507: INFO: Pod "pod-8efec22b-e46b-45c0-a362-3e8c7f1043b1": Phase="Pending", Reason="", readiness=false. Elapsed: 103.892894ms
Sep 21 19:24:29.612: INFO: Pod "pod-8efec22b-e46b-45c0-a362-3e8c7f1043b1": Phase="Pending", Reason="", readiness=false. Elapsed: 2.208765185s
Sep 21 19:24:31.717: INFO: Pod "pod-8efec22b-e46b-45c0-a362-3e8c7f1043b1": Phase="Pending", Reason="", readiness=false. Elapsed: 4.313114944s
Sep 21 19:24:33.820: INFO: Pod "pod-8efec22b-e46b-45c0-a362-3e8c7f1043b1": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.417054694s
STEP: Saw pod success
Sep 21 19:24:33.821: INFO: Pod "pod-8efec22b-e46b-45c0-a362-3e8c7f1043b1" satisfied condition "Succeeded or Failed"
Sep 21 19:24:33.925: INFO: Trying to get logs from node ip-172-20-53-119.eu-west-3.compute.internal pod pod-8efec22b-e46b-45c0-a362-3e8c7f1043b1 container test-container: <nil>
STEP: delete the pod
Sep 21 19:24:34.137: INFO: Waiting for pod pod-8efec22b-e46b-45c0-a362-3e8c7f1043b1 to disappear
Sep 21 19:24:34.240: INFO: Pod pod-8efec22b-e46b-45c0-a362-3e8c7f1043b1 no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 6 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:48
    new files should be created with FSGroup ownership when container is non-root
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:59
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup] new files should be created with FSGroup ownership when container is non-root","total":-1,"completed":5,"skipped":35,"failed":0}
[BeforeEach] [sig-api-machinery] client-go should negotiate
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:24:34.461: INFO: >>> kubeConfig: /root/.kube/config
[It] watch and report errors with accept "application/json"
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/protocol.go:46
Sep 21 19:24:34.463: INFO: >>> kubeConfig: /root/.kube/config
[AfterEach] [sig-api-machinery] client-go should negotiate
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:24:34.671: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready

•
------------------------------
{"msg":"PASSED [sig-api-machinery] client-go should negotiate watch and report errors with accept \"application/json\"","total":-1,"completed":6,"skipped":35,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:34.792: INFO: Driver local doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 42 lines ...
STEP: Creating a kubernetes client
Sep 21 19:24:28.258: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename init-container
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-node] InitContainer [NodeConformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/init_container.go:162
[It] should not start app containers and fail the pod if init containers fail on a RestartNever pod [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: creating the pod
Sep 21 19:24:28.784: INFO: PodSpec: initContainers in spec.initContainers
[AfterEach] [sig-node] InitContainer [NodeConformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:24:34.723: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "init-container-3613" for this suite.


• [SLOW TEST:6.675 seconds]
[sig-node] InitContainer [NodeConformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should not start app containers and fail the pod if init containers fail on a RestartNever pod [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] InitContainer [NodeConformance] should not start app containers and fail the pod if init containers fail on a RestartNever pod [Conformance]","total":-1,"completed":7,"skipped":55,"failed":0}

SSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:35.028: INFO: Driver supports dynamic provisioning, skipping PreprovisionedPV pattern
... skipping 100 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should not mount / map unused volumes in a pod [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:351
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":-1,"completed":6,"skipped":6,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-api-machinery] ResourceQuota
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 25 lines ...
• [SLOW TEST:18.203 seconds]
[sig-api-machinery] ResourceQuota
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should verify ResourceQuota with terminating scopes. [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] ResourceQuota should verify ResourceQuota with terminating scopes. [Conformance]","total":-1,"completed":3,"skipped":31,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:37.706: INFO: Driver hostPath doesn't support ext4 -- skipping
... skipping 37 lines ...
Sep 21 19:24:26.979: INFO: PersistentVolumeClaim pvc-8nmmv found but phase is Pending instead of Bound.
Sep 21 19:24:29.085: INFO: PersistentVolumeClaim pvc-8nmmv found and phase=Bound (4.316889844s)
Sep 21 19:24:29.085: INFO: Waiting up to 3m0s for PersistentVolume local-x8hlm to have phase Bound
Sep 21 19:24:29.190: INFO: PersistentVolume local-x8hlm found and phase=Bound (104.533583ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-ttps
STEP: Creating a pod to test subpath
Sep 21 19:24:29.506: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-ttps" in namespace "provisioning-5942" to be "Succeeded or Failed"
Sep 21 19:24:29.612: INFO: Pod "pod-subpath-test-preprovisionedpv-ttps": Phase="Pending", Reason="", readiness=false. Elapsed: 105.828187ms
Sep 21 19:24:31.718: INFO: Pod "pod-subpath-test-preprovisionedpv-ttps": Phase="Pending", Reason="", readiness=false. Elapsed: 2.211473349s
Sep 21 19:24:33.826: INFO: Pod "pod-subpath-test-preprovisionedpv-ttps": Phase="Pending", Reason="", readiness=false. Elapsed: 4.319912551s
Sep 21 19:24:35.933: INFO: Pod "pod-subpath-test-preprovisionedpv-ttps": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.426153193s
STEP: Saw pod success
Sep 21 19:24:35.933: INFO: Pod "pod-subpath-test-preprovisionedpv-ttps" satisfied condition "Succeeded or Failed"
Sep 21 19:24:36.037: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod pod-subpath-test-preprovisionedpv-ttps container test-container-subpath-preprovisionedpv-ttps: <nil>
STEP: delete the pod
Sep 21 19:24:36.262: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-ttps to disappear
Sep 21 19:24:36.367: INFO: Pod pod-subpath-test-preprovisionedpv-ttps no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-ttps
Sep 21 19:24:36.367: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-ttps" in namespace "provisioning-5942"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support readOnly directory specified in the volumeMount
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:369
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly directory specified in the volumeMount","total":-1,"completed":4,"skipped":39,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:37.860: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 35 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:24:39.058: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "configmap-2711" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] ConfigMap should run through a ConfigMap lifecycle [Conformance]","total":-1,"completed":5,"skipped":44,"failed":0}

SS
------------------------------
[BeforeEach] [sig-storage] PersistentVolumes-local 
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 58 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:192
    One pod requesting one prebound PVC
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:209
      should be able to mount volume and read from pod1
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:232
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: tmpfs] One pod requesting one prebound PVC should be able to mount volume and read from pod1","total":-1,"completed":3,"skipped":25,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:39.523: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 85 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:192
    Two pods mounting a local volume one after the other
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:254
      should be able to write from pod1 and read from pod2
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:255
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: tmpfs] Two pods mounting a local volume one after the other should be able to write from pod1 and read from pod2","total":-1,"completed":5,"skipped":55,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
... skipping 9 lines ...
Sep 21 19:24:03.230: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-3191gzkdd
STEP: creating a claim
Sep 21 19:24:03.334: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-w87q
STEP: Creating a pod to test subpath
Sep 21 19:24:03.650: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-w87q" in namespace "provisioning-3191" to be "Succeeded or Failed"
Sep 21 19:24:03.753: INFO: Pod "pod-subpath-test-dynamicpv-w87q": Phase="Pending", Reason="", readiness=false. Elapsed: 103.168512ms
Sep 21 19:24:05.857: INFO: Pod "pod-subpath-test-dynamicpv-w87q": Phase="Pending", Reason="", readiness=false. Elapsed: 2.207436193s
Sep 21 19:24:07.962: INFO: Pod "pod-subpath-test-dynamicpv-w87q": Phase="Pending", Reason="", readiness=false. Elapsed: 4.31272629s
Sep 21 19:24:10.068: INFO: Pod "pod-subpath-test-dynamicpv-w87q": Phase="Pending", Reason="", readiness=false. Elapsed: 6.418069114s
Sep 21 19:24:12.172: INFO: Pod "pod-subpath-test-dynamicpv-w87q": Phase="Pending", Reason="", readiness=false. Elapsed: 8.522171485s
Sep 21 19:24:14.277: INFO: Pod "pod-subpath-test-dynamicpv-w87q": Phase="Pending", Reason="", readiness=false. Elapsed: 10.627805388s
Sep 21 19:24:16.382: INFO: Pod "pod-subpath-test-dynamicpv-w87q": Phase="Pending", Reason="", readiness=false. Elapsed: 12.732648537s
Sep 21 19:24:18.487: INFO: Pod "pod-subpath-test-dynamicpv-w87q": Phase="Pending", Reason="", readiness=false. Elapsed: 14.837671881s
Sep 21 19:24:20.592: INFO: Pod "pod-subpath-test-dynamicpv-w87q": Phase="Pending", Reason="", readiness=false. Elapsed: 16.942648266s
Sep 21 19:24:22.696: INFO: Pod "pod-subpath-test-dynamicpv-w87q": Phase="Pending", Reason="", readiness=false. Elapsed: 19.046816673s
Sep 21 19:24:24.801: INFO: Pod "pod-subpath-test-dynamicpv-w87q": Phase="Pending", Reason="", readiness=false. Elapsed: 21.150940558s
Sep 21 19:24:26.905: INFO: Pod "pod-subpath-test-dynamicpv-w87q": Phase="Succeeded", Reason="", readiness=false. Elapsed: 23.255169361s
STEP: Saw pod success
Sep 21 19:24:26.905: INFO: Pod "pod-subpath-test-dynamicpv-w87q" satisfied condition "Succeeded or Failed"
Sep 21 19:24:27.009: INFO: Trying to get logs from node ip-172-20-35-229.eu-west-3.compute.internal pod pod-subpath-test-dynamicpv-w87q container test-container-volume-dynamicpv-w87q: <nil>
STEP: delete the pod
Sep 21 19:24:27.229: INFO: Waiting for pod pod-subpath-test-dynamicpv-w87q to disappear
Sep 21 19:24:27.336: INFO: Pod pod-subpath-test-dynamicpv-w87q no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-w87q
Sep 21 19:24:27.337: INFO: Deleting pod "pod-subpath-test-dynamicpv-w87q" in namespace "provisioning-3191"
... skipping 20 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support non-existent path
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:194
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path","total":-1,"completed":3,"skipped":25,"failed":0}

S
------------------------------
[BeforeEach] [sig-node] Downward API
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:24:40.864: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename downward-api
STEP: Waiting for a default service account to be provisioned in namespace
[It] should provide default limits.cpu/memory from node allocatable [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test downward api env vars
Sep 21 19:24:41.497: INFO: Waiting up to 5m0s for pod "downward-api-d3e122dd-739d-4f70-8e23-a3801fd94b2b" in namespace "downward-api-5749" to be "Succeeded or Failed"
Sep 21 19:24:41.602: INFO: Pod "downward-api-d3e122dd-739d-4f70-8e23-a3801fd94b2b": Phase="Pending", Reason="", readiness=false. Elapsed: 104.53178ms
Sep 21 19:24:43.707: INFO: Pod "downward-api-d3e122dd-739d-4f70-8e23-a3801fd94b2b": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.210077383s
STEP: Saw pod success
Sep 21 19:24:43.707: INFO: Pod "downward-api-d3e122dd-739d-4f70-8e23-a3801fd94b2b" satisfied condition "Succeeded or Failed"
Sep 21 19:24:43.812: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod downward-api-d3e122dd-739d-4f70-8e23-a3801fd94b2b container dapi-container: <nil>
STEP: delete the pod
Sep 21 19:24:44.032: INFO: Waiting for pod downward-api-d3e122dd-739d-4f70-8e23-a3801fd94b2b to disappear
Sep 21 19:24:44.138: INFO: Pod downward-api-d3e122dd-739d-4f70-8e23-a3801fd94b2b no longer exists
[AfterEach] [sig-node] Downward API
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:24:44.138: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "downward-api-5749" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Downward API should provide default limits.cpu/memory from node allocatable [NodeConformance] [Conformance]","total":-1,"completed":6,"skipped":56,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:44.380: INFO: Only supported for providers [gce gke] (not aws)
... skipping 179 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (ext4)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should store data
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Inline-volume (ext4)] volumes should store data","total":-1,"completed":1,"skipped":30,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:46.237: INFO: Driver hostPathSymlink doesn't support DynamicPV -- skipping
... skipping 5 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: hostPathSymlink]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (delayed binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Driver hostPathSymlink doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
... skipping 17 lines ...
• [SLOW TEST:16.043 seconds]
[sig-api-machinery] Watchers
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should receive events on concurrent watches in same order [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] Watchers should receive events on concurrent watches in same order [Conformance]","total":-1,"completed":7,"skipped":39,"failed":0}

SS
------------------------------
[BeforeEach] [sig-api-machinery] client-go should negotiate
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 4 lines ...
[AfterEach] [sig-api-machinery] client-go should negotiate
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:24:51.107: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready

•
------------------------------
{"msg":"PASSED [sig-api-machinery] client-go should negotiate watch and report errors with accept \"application/vnd.kubernetes.protobuf\"","total":-1,"completed":8,"skipped":41,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:51.240: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 35 lines ...
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159

      Only supported for providers [azure] (not aws)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:1566
------------------------------
{"msg":"PASSED [sig-storage] PV Protection Verify \"immediate\" deletion of a PV that is not bound to a PVC","total":-1,"completed":7,"skipped":63,"failed":0}
[BeforeEach] [sig-apps] Deployment
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:24:45.929: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename deployment
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 23 lines ...
• [SLOW TEST:6.218 seconds]
[sig-apps] Deployment
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  deployment should delete old replica sets [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-apps] Deployment deployment should delete old replica sets [Conformance]","total":-1,"completed":8,"skipped":63,"failed":0}

S
------------------------------
[BeforeEach] [sig-storage] PersistentVolumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 27 lines ...
Sep 21 19:24:29.545: INFO: PersistentVolume nfs-xl7t2 found and phase=Bound (105.402364ms)
Sep 21 19:24:29.648: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-zswr8] to have phase Bound
Sep 21 19:24:29.752: INFO: PersistentVolumeClaim pvc-zswr8 found and phase=Bound (103.45417ms)
STEP: Checking pod has write access to PersistentVolumes
Sep 21 19:24:29.856: INFO: Creating nfs test pod
Sep 21 19:24:29.960: INFO: Pod should terminate with exitcode 0 (success)
Sep 21 19:24:29.960: INFO: Waiting up to 5m0s for pod "pvc-tester-hghl4" in namespace "pv-7759" to be "Succeeded or Failed"
Sep 21 19:24:30.064: INFO: Pod "pvc-tester-hghl4": Phase="Pending", Reason="", readiness=false. Elapsed: 103.840452ms
Sep 21 19:24:32.168: INFO: Pod "pvc-tester-hghl4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.20786178s
Sep 21 19:24:34.273: INFO: Pod "pvc-tester-hghl4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.312976978s
Sep 21 19:24:36.377: INFO: Pod "pvc-tester-hghl4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.417121202s
STEP: Saw pod success
Sep 21 19:24:36.377: INFO: Pod "pvc-tester-hghl4" satisfied condition "Succeeded or Failed"
Sep 21 19:24:36.377: INFO: Pod pvc-tester-hghl4 succeeded 
Sep 21 19:24:36.378: INFO: Deleting pod "pvc-tester-hghl4" in namespace "pv-7759"
Sep 21 19:24:36.488: INFO: Wait up to 5m0s for pod "pvc-tester-hghl4" to be fully deleted
Sep 21 19:24:36.698: INFO: Creating nfs test pod
Sep 21 19:24:36.803: INFO: Pod should terminate with exitcode 0 (success)
Sep 21 19:24:36.803: INFO: Waiting up to 5m0s for pod "pvc-tester-vcbsg" in namespace "pv-7759" to be "Succeeded or Failed"
Sep 21 19:24:36.907: INFO: Pod "pvc-tester-vcbsg": Phase="Pending", Reason="", readiness=false. Elapsed: 103.719715ms
Sep 21 19:24:39.012: INFO: Pod "pvc-tester-vcbsg": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.209003337s
STEP: Saw pod success
Sep 21 19:24:39.012: INFO: Pod "pvc-tester-vcbsg" satisfied condition "Succeeded or Failed"
Sep 21 19:24:39.012: INFO: Pod pvc-tester-vcbsg succeeded 
Sep 21 19:24:39.012: INFO: Deleting pod "pvc-tester-vcbsg" in namespace "pv-7759"
Sep 21 19:24:39.122: INFO: Wait up to 5m0s for pod "pvc-tester-vcbsg" to be fully deleted
Sep 21 19:24:39.329: INFO: Creating nfs test pod
Sep 21 19:24:39.434: INFO: Pod should terminate with exitcode 0 (success)
Sep 21 19:24:39.434: INFO: Waiting up to 5m0s for pod "pvc-tester-nt775" in namespace "pv-7759" to be "Succeeded or Failed"
Sep 21 19:24:39.538: INFO: Pod "pvc-tester-nt775": Phase="Pending", Reason="", readiness=false. Elapsed: 104.096248ms
Sep 21 19:24:41.643: INFO: Pod "pvc-tester-nt775": Phase="Pending", Reason="", readiness=false. Elapsed: 2.208627135s
Sep 21 19:24:43.748: INFO: Pod "pvc-tester-nt775": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.313945103s
STEP: Saw pod success
Sep 21 19:24:43.748: INFO: Pod "pvc-tester-nt775" satisfied condition "Succeeded or Failed"
Sep 21 19:24:43.748: INFO: Pod pvc-tester-nt775 succeeded 
Sep 21 19:24:43.748: INFO: Deleting pod "pvc-tester-nt775" in namespace "pv-7759"
Sep 21 19:24:43.862: INFO: Wait up to 5m0s for pod "pvc-tester-nt775" to be fully deleted
STEP: Deleting PVCs to invoke reclaim policy
Sep 21 19:24:44.173: INFO: Deleting PVC pvc-zswr8 to trigger reclamation of PV nfs-xl7t2
Sep 21 19:24:44.173: INFO: Deleting PersistentVolumeClaim "pvc-zswr8"
... skipping 36 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes.go:122
    with multiple PVs and PVCs all in same ns
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes.go:212
      should create 3 PVs and 3 PVCs: test write access
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes.go:243
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes NFS with multiple PVs and PVCs all in same ns should create 3 PVs and 3 PVCs: test write access","total":-1,"completed":4,"skipped":28,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
... skipping 28 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should be able to unmount after the subpath directory is deleted [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:449
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]","total":-1,"completed":6,"skipped":46,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
... skipping 50 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should be able to unmount after the subpath directory is deleted [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:449
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]","total":-1,"completed":3,"skipped":24,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
... skipping 2 lines ...
Sep 21 19:24:46.250: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
STEP: Waiting for a default service account to be provisioned in namespace
[It] should support readOnly file specified in the volumeMount [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:384
Sep 21 19:24:46.772: INFO: In-tree plugin kubernetes.io/host-path is not migrated, not validating any metrics
Sep 21 19:24:46.984: INFO: Waiting up to 5m0s for pod "hostpath-symlink-prep-provisioning-325" in namespace "provisioning-325" to be "Succeeded or Failed"
Sep 21 19:24:47.088: INFO: Pod "hostpath-symlink-prep-provisioning-325": Phase="Pending", Reason="", readiness=false. Elapsed: 104.016512ms
Sep 21 19:24:49.193: INFO: Pod "hostpath-symlink-prep-provisioning-325": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.208747613s
STEP: Saw pod success
Sep 21 19:24:49.193: INFO: Pod "hostpath-symlink-prep-provisioning-325" satisfied condition "Succeeded or Failed"
Sep 21 19:24:49.193: INFO: Deleting pod "hostpath-symlink-prep-provisioning-325" in namespace "provisioning-325"
Sep 21 19:24:49.301: INFO: Wait up to 5m0s for pod "hostpath-symlink-prep-provisioning-325" to be fully deleted
Sep 21 19:24:49.405: INFO: Creating resource for inline volume
STEP: Creating pod pod-subpath-test-inlinevolume-v4xs
STEP: Creating a pod to test subpath
Sep 21 19:24:49.511: INFO: Waiting up to 5m0s for pod "pod-subpath-test-inlinevolume-v4xs" in namespace "provisioning-325" to be "Succeeded or Failed"
Sep 21 19:24:49.616: INFO: Pod "pod-subpath-test-inlinevolume-v4xs": Phase="Pending", Reason="", readiness=false. Elapsed: 104.521747ms
Sep 21 19:24:51.721: INFO: Pod "pod-subpath-test-inlinevolume-v4xs": Phase="Pending", Reason="", readiness=false. Elapsed: 2.209914713s
Sep 21 19:24:53.826: INFO: Pod "pod-subpath-test-inlinevolume-v4xs": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.314881859s
STEP: Saw pod success
Sep 21 19:24:53.826: INFO: Pod "pod-subpath-test-inlinevolume-v4xs" satisfied condition "Succeeded or Failed"
Sep 21 19:24:53.930: INFO: Trying to get logs from node ip-172-20-35-229.eu-west-3.compute.internal pod pod-subpath-test-inlinevolume-v4xs container test-container-subpath-inlinevolume-v4xs: <nil>
STEP: delete the pod
Sep 21 19:24:54.152: INFO: Waiting for pod pod-subpath-test-inlinevolume-v4xs to disappear
Sep 21 19:24:54.256: INFO: Pod pod-subpath-test-inlinevolume-v4xs no longer exists
STEP: Deleting pod pod-subpath-test-inlinevolume-v4xs
Sep 21 19:24:54.256: INFO: Deleting pod "pod-subpath-test-inlinevolume-v4xs" in namespace "provisioning-325"
STEP: Deleting pod
Sep 21 19:24:54.359: INFO: Deleting pod "pod-subpath-test-inlinevolume-v4xs" in namespace "provisioning-325"
Sep 21 19:24:54.568: INFO: Waiting up to 5m0s for pod "hostpath-symlink-prep-provisioning-325" in namespace "provisioning-325" to be "Succeeded or Failed"
Sep 21 19:24:54.672: INFO: Pod "hostpath-symlink-prep-provisioning-325": Phase="Pending", Reason="", readiness=false. Elapsed: 104.167165ms
Sep 21 19:24:56.777: INFO: Pod "hostpath-symlink-prep-provisioning-325": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.208633618s
STEP: Saw pod success
Sep 21 19:24:56.777: INFO: Pod "hostpath-symlink-prep-provisioning-325" satisfied condition "Succeeded or Failed"
Sep 21 19:24:56.777: INFO: Deleting pod "hostpath-symlink-prep-provisioning-325" in namespace "provisioning-325"
Sep 21 19:24:56.887: INFO: Wait up to 5m0s for pod "hostpath-symlink-prep-provisioning-325" to be fully deleted
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:24:56.991: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "provisioning-325" for this suite.
... skipping 6 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support readOnly file specified in the volumeMount [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:384
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Inline-volume (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]","total":-1,"completed":2,"skipped":32,"failed":0}

SSSSS
------------------------------
[BeforeEach] [sig-apps] DisruptionController
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 15 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:24:58.136: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "disruption-4231" for this suite.

•
------------------------------
{"msg":"PASSED [sig-apps] DisruptionController should create a PodDisruptionBudget [Conformance]","total":-1,"completed":4,"skipped":26,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:24:58.362: INFO: Only supported for providers [vsphere] (not aws)
[AfterEach] [Testpattern: Dynamic PV (default fs)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 11 lines ...
      Only supported for providers [vsphere] (not aws)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:1437
------------------------------
SS
------------------------------
{"msg":"PASSED [sig-apps] Deployment should run the lifecycle of a Deployment [Conformance]","total":-1,"completed":1,"skipped":18,"failed":0}
[BeforeEach] [sig-api-machinery] CustomResourceDefinition Watch [Privileged:ClusterAdmin]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:23:53.998: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename crd-watch
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 76 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (block volmode)] volumeMode
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should not mount / map unused volumes in a pod [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:351
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":-1,"completed":3,"skipped":19,"failed":0}

SSSS
------------------------------
[BeforeEach] [sig-node] Downward API
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:24:57.266: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename downward-api
STEP: Waiting for a default service account to be provisioned in namespace
[It] should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test downward api env vars
Sep 21 19:24:57.895: INFO: Waiting up to 5m0s for pod "downward-api-9be3cce5-14cc-423a-9404-190cf54f3504" in namespace "downward-api-4290" to be "Succeeded or Failed"
Sep 21 19:24:57.999: INFO: Pod "downward-api-9be3cce5-14cc-423a-9404-190cf54f3504": Phase="Pending", Reason="", readiness=false. Elapsed: 104.21705ms
Sep 21 19:25:00.105: INFO: Pod "downward-api-9be3cce5-14cc-423a-9404-190cf54f3504": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.209324668s
STEP: Saw pod success
Sep 21 19:25:00.105: INFO: Pod "downward-api-9be3cce5-14cc-423a-9404-190cf54f3504" satisfied condition "Succeeded or Failed"
Sep 21 19:25:00.212: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod downward-api-9be3cce5-14cc-423a-9404-190cf54f3504 container dapi-container: <nil>
STEP: delete the pod
Sep 21 19:25:00.427: INFO: Waiting for pod downward-api-9be3cce5-14cc-423a-9404-190cf54f3504 to disappear
Sep 21 19:25:00.531: INFO: Pod downward-api-9be3cce5-14cc-423a-9404-190cf54f3504 no longer exists
[AfterEach] [sig-node] Downward API
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:25:00.531: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "downward-api-4290" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Downward API should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance]","total":-1,"completed":3,"skipped":37,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:25:00.767: INFO: Only supported for providers [azure] (not aws)
... skipping 87 lines ...
• [SLOW TEST:99.740 seconds]
[sig-apps] CronJob
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  should replace jobs when ReplaceConcurrent [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-apps] CronJob should replace jobs when ReplaceConcurrent [Conformance]","total":-1,"completed":1,"skipped":1,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:25:01.767: INFO: Driver hostPath doesn't support PreprovisionedPV -- skipping
[AfterEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 111 lines ...
Sep 21 19:24:56.156: INFO: PersistentVolumeClaim pvc-p9wpt found but phase is Pending instead of Bound.
Sep 21 19:24:58.262: INFO: PersistentVolumeClaim pvc-p9wpt found and phase=Bound (2.213474526s)
Sep 21 19:24:58.262: INFO: Waiting up to 3m0s for PersistentVolume local-j2lk4 to have phase Bound
Sep 21 19:24:58.366: INFO: PersistentVolume local-j2lk4 found and phase=Bound (104.355337ms)
STEP: Creating pod exec-volume-test-preprovisionedpv-nnqf
STEP: Creating a pod to test exec-volume-test
Sep 21 19:24:58.685: INFO: Waiting up to 5m0s for pod "exec-volume-test-preprovisionedpv-nnqf" in namespace "volume-9260" to be "Succeeded or Failed"
Sep 21 19:24:58.791: INFO: Pod "exec-volume-test-preprovisionedpv-nnqf": Phase="Pending", Reason="", readiness=false. Elapsed: 105.574251ms
Sep 21 19:25:00.897: INFO: Pod "exec-volume-test-preprovisionedpv-nnqf": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.212012073s
STEP: Saw pod success
Sep 21 19:25:00.897: INFO: Pod "exec-volume-test-preprovisionedpv-nnqf" satisfied condition "Succeeded or Failed"
Sep 21 19:25:01.008: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod exec-volume-test-preprovisionedpv-nnqf container exec-container-preprovisionedpv-nnqf: <nil>
STEP: delete the pod
Sep 21 19:25:01.225: INFO: Waiting for pod exec-volume-test-preprovisionedpv-nnqf to disappear
Sep 21 19:25:01.330: INFO: Pod exec-volume-test-preprovisionedpv-nnqf no longer exists
STEP: Deleting pod exec-volume-test-preprovisionedpv-nnqf
Sep 21 19:25:01.330: INFO: Deleting pod "exec-volume-test-preprovisionedpv-nnqf" in namespace "volume-9260"
... skipping 20 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should allow exec of files on the volume
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: tmpfs] [Testpattern: Pre-provisioned PV (default fs)] volumes should allow exec of files on the volume","total":-1,"completed":9,"skipped":64,"failed":0}

S
------------------------------
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 8 lines ...
STEP: Wait for the deployment to be ready
Sep 21 19:23:59.671: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63767849039, loc:(*time.Location)(0x9e12f00)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63767849039, loc:(*time.Location)(0x9e12f00)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63767849039, loc:(*time.Location)(0x9e12f00)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63767849039, loc:(*time.Location)(0x9e12f00)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-78988fc6cd\" is progressing."}}, CollisionCount:(*int32)(nil)}
Sep 21 19:24:01.776: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63767849039, loc:(*time.Location)(0x9e12f00)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63767849039, loc:(*time.Location)(0x9e12f00)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63767849039, loc:(*time.Location)(0x9e12f00)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63767849039, loc:(*time.Location)(0x9e12f00)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-78988fc6cd\" is progressing."}}, CollisionCount:(*int32)(nil)}
STEP: Deploying the webhook service
STEP: Verifying the service has paired with the endpoint
Sep 21 19:24:04.897: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
[It] should unconditionally reject operations on fail closed webhook [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Registering a webhook that server cannot talk to, with fail closed policy, via the AdmissionRegistration API
Sep 21 19:24:15.336: INFO: Waiting for webhook configuration to be ready...
Sep 21 19:24:25.649: INFO: Waiting for webhook configuration to be ready...
Sep 21 19:24:35.948: INFO: Waiting for webhook configuration to be ready...
Sep 21 19:24:46.256: INFO: Waiting for webhook configuration to be ready...
Sep 21 19:24:56.470: INFO: Waiting for webhook configuration to be ready...
Sep 21 19:24:56.471: FAIL: waiting for webhook configuration to be ready
Unexpected error:
    <*errors.errorString | 0xc000244250>: {
        s: "timed out waiting for the condition",
    }
    timed out waiting for the condition
occurred

... skipping 355 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102


• Failure [67.963 seconds]
[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should unconditionally reject operations on fail closed webhook [Conformance] [It]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630

  Sep 21 19:24:56.471: waiting for webhook configuration to be ready
  Unexpected error:
      <*errors.errorString | 0xc000244250>: {
          s: "timed out waiting for the condition",
      }
      timed out waiting for the condition
  occurred

  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:1275
------------------------------
{"msg":"FAILED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should unconditionally reject operations on fail closed webhook [Conformance]","total":-1,"completed":3,"skipped":9,"failed":1,"failures":["[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should unconditionally reject operations on fail closed webhook [Conformance]"]}

SS
------------------------------
[BeforeEach] [sig-network] IngressClass API
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 66 lines ...
• [SLOW TEST:9.943 seconds]
[sig-network] Services
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/common/framework.go:23
  should serve a basic endpoint from pods  [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-network] Services should serve a basic endpoint from pods  [Conformance]","total":-1,"completed":4,"skipped":23,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:25:09.668: INFO: Only supported for providers [gce gke] (not aws)
... skipping 41 lines ...
• [SLOW TEST:29.573 seconds]
[sig-api-machinery] ResourceQuota
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should create a ResourceQuota and capture the life of a configMap. [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a configMap. [Conformance]","total":-1,"completed":4,"skipped":26,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-apps] Job
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 66 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  when create a pod with lifecycle hook
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/lifecycle_hook.go:43
    should execute prestop exec hook properly [NodeConformance] [Conformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute prestop exec hook properly [NodeConformance] [Conformance]","total":-1,"completed":7,"skipped":50,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
... skipping 110 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (ext4)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should store data
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: block] [Testpattern: Pre-provisioned PV (ext4)] volumes should store data","total":-1,"completed":6,"skipped":62,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Inline-volume (default fs)] volumes
... skipping 43 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (default fs)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should store data
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] volumes should store data","total":-1,"completed":2,"skipped":8,"failed":0}

SSSSSSSS
------------------------------
[BeforeEach] [sig-instrumentation] Events API
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 13 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:25:17.283: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "events-6798" for this suite.

•
------------------------------
{"msg":"PASSED [sig-instrumentation] Events API should delete a collection of events [Conformance]","total":-1,"completed":8,"skipped":52,"failed":0}

SSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:25:17.559: INFO: Only supported for providers [azure] (not aws)
... skipping 72 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: local][LocalVolumeType: block]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (immediate binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Driver local doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
... skipping 103 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  CSIStorageCapacity
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:1134
    CSIStorageCapacity used, insufficient capacity
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:1177
------------------------------
{"msg":"PASSED [sig-storage] CSI mock volume CSIStorageCapacity CSIStorageCapacity used, insufficient capacity","total":-1,"completed":3,"skipped":23,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:25:20.225: INFO: Driver supports dynamic provisioning, skipping InlineVolume pattern
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 120 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:25:20.397: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "security-context-test-9682" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Security Context When creating a container with runAsNonRoot should not run with an explicit root user ID [LinuxOnly]","total":-1,"completed":9,"skipped":69,"failed":0}

S
------------------------------
{"msg":"PASSED [sig-apps] Job should delete a job [Conformance]","total":-1,"completed":3,"skipped":11,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:25:15.023: INFO: >>> kubeConfig: /root/.kube/config
... skipping 2 lines ...
[It] should support readOnly file specified in the volumeMount [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:384
Sep 21 19:25:15.548: INFO: In-tree plugin kubernetes.io/empty-dir is not migrated, not validating any metrics
Sep 21 19:25:15.548: INFO: Creating resource for inline volume
STEP: Creating pod pod-subpath-test-inlinevolume-pct4
STEP: Creating a pod to test subpath
Sep 21 19:25:15.657: INFO: Waiting up to 5m0s for pod "pod-subpath-test-inlinevolume-pct4" in namespace "provisioning-5706" to be "Succeeded or Failed"
Sep 21 19:25:15.762: INFO: Pod "pod-subpath-test-inlinevolume-pct4": Phase="Pending", Reason="", readiness=false. Elapsed: 104.5779ms
Sep 21 19:25:17.872: INFO: Pod "pod-subpath-test-inlinevolume-pct4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.214891497s
Sep 21 19:25:19.979: INFO: Pod "pod-subpath-test-inlinevolume-pct4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.321701344s
STEP: Saw pod success
Sep 21 19:25:19.979: INFO: Pod "pod-subpath-test-inlinevolume-pct4" satisfied condition "Succeeded or Failed"
Sep 21 19:25:20.086: INFO: Trying to get logs from node ip-172-20-53-119.eu-west-3.compute.internal pod pod-subpath-test-inlinevolume-pct4 container test-container-subpath-inlinevolume-pct4: <nil>
STEP: delete the pod
Sep 21 19:25:20.301: INFO: Waiting for pod pod-subpath-test-inlinevolume-pct4 to disappear
Sep 21 19:25:20.405: INFO: Pod pod-subpath-test-inlinevolume-pct4 no longer exists
STEP: Deleting pod pod-subpath-test-inlinevolume-pct4
Sep 21 19:25:20.405: INFO: Deleting pod "pod-subpath-test-inlinevolume-pct4" in namespace "provisioning-5706"
... skipping 12 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support readOnly file specified in the volumeMount [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:384
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]","total":-1,"completed":4,"skipped":11,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:25:20.876: INFO: Only supported for providers [vsphere] (not aws)
... skipping 56 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/portforward.go:474
    that expects NO client request
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/portforward.go:484
      should support a client that connects, sends DATA, and disconnects
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/portforward.go:485
------------------------------
{"msg":"PASSED [sig-cli] Kubectl Port forwarding With a server listening on localhost that expects NO client request should support a client that connects, sends DATA, and disconnects","total":-1,"completed":5,"skipped":27,"failed":0}

SSSS
------------------------------
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 19 lines ...
STEP: Registering the webhook via the AdmissionRegistration API
Sep 21 19:24:36.117: INFO: Waiting for webhook configuration to be ready...
Sep 21 19:24:46.432: INFO: Waiting for webhook configuration to be ready...
Sep 21 19:24:56.727: INFO: Waiting for webhook configuration to be ready...
Sep 21 19:25:07.028: INFO: Waiting for webhook configuration to be ready...
Sep 21 19:25:17.240: INFO: Waiting for webhook configuration to be ready...
Sep 21 19:25:17.240: FAIL: waiting for webhook configuration to be ready
Unexpected error:
    <*errors.errorString | 0xc0002b6250>: {
        s: "timed out waiting for the condition",
    }
    timed out waiting for the condition
occurred

... skipping 365 lines ...
[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should be able to deny attaching pod [Conformance] [It]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630

  Sep 21 19:25:17.240: waiting for webhook configuration to be ready
  Unexpected error:
      <*errors.errorString | 0xc0002b6250>: {
          s: "timed out waiting for the condition",
      }
      timed out waiting for the condition
  occurred

... skipping 26 lines ...
Sep 21 19:25:11.021: INFO: PersistentVolumeClaim pvc-fjggd found but phase is Pending instead of Bound.
Sep 21 19:25:13.126: INFO: PersistentVolumeClaim pvc-fjggd found and phase=Bound (14.846965976s)
Sep 21 19:25:13.126: INFO: Waiting up to 3m0s for PersistentVolume local-cq84c to have phase Bound
Sep 21 19:25:13.230: INFO: PersistentVolume local-cq84c found and phase=Bound (103.794786ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-h47m
STEP: Creating a pod to test subpath
Sep 21 19:25:13.546: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-h47m" in namespace "provisioning-2288" to be "Succeeded or Failed"
Sep 21 19:25:13.651: INFO: Pod "pod-subpath-test-preprovisionedpv-h47m": Phase="Pending", Reason="", readiness=false. Elapsed: 104.660103ms
Sep 21 19:25:15.755: INFO: Pod "pod-subpath-test-preprovisionedpv-h47m": Phase="Pending", Reason="", readiness=false. Elapsed: 2.20905357s
Sep 21 19:25:17.868: INFO: Pod "pod-subpath-test-preprovisionedpv-h47m": Phase="Pending", Reason="", readiness=false. Elapsed: 4.322058331s
Sep 21 19:25:19.973: INFO: Pod "pod-subpath-test-preprovisionedpv-h47m": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.426476626s
STEP: Saw pod success
Sep 21 19:25:19.973: INFO: Pod "pod-subpath-test-preprovisionedpv-h47m" satisfied condition "Succeeded or Failed"
Sep 21 19:25:20.078: INFO: Trying to get logs from node ip-172-20-35-229.eu-west-3.compute.internal pod pod-subpath-test-preprovisionedpv-h47m container test-container-subpath-preprovisionedpv-h47m: <nil>
STEP: delete the pod
Sep 21 19:25:20.295: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-h47m to disappear
Sep 21 19:25:20.399: INFO: Pod pod-subpath-test-preprovisionedpv-h47m no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-h47m
Sep 21 19:25:20.399: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-h47m" in namespace "provisioning-2288"
STEP: Creating pod pod-subpath-test-preprovisionedpv-h47m
STEP: Creating a pod to test subpath
Sep 21 19:25:20.610: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-h47m" in namespace "provisioning-2288" to be "Succeeded or Failed"
Sep 21 19:25:20.729: INFO: Pod "pod-subpath-test-preprovisionedpv-h47m": Phase="Pending", Reason="", readiness=false. Elapsed: 119.124564ms
Sep 21 19:25:22.836: INFO: Pod "pod-subpath-test-preprovisionedpv-h47m": Phase="Pending", Reason="", readiness=false. Elapsed: 2.226111405s
Sep 21 19:25:24.942: INFO: Pod "pod-subpath-test-preprovisionedpv-h47m": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.33156098s
STEP: Saw pod success
Sep 21 19:25:24.942: INFO: Pod "pod-subpath-test-preprovisionedpv-h47m" satisfied condition "Succeeded or Failed"
Sep 21 19:25:25.046: INFO: Trying to get logs from node ip-172-20-35-229.eu-west-3.compute.internal pod pod-subpath-test-preprovisionedpv-h47m container test-container-subpath-preprovisionedpv-h47m: <nil>
STEP: delete the pod
Sep 21 19:25:25.260: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-h47m to disappear
Sep 21 19:25:25.364: INFO: Pod pod-subpath-test-preprovisionedpv-h47m no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-h47m
Sep 21 19:25:25.364: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-h47m" in namespace "provisioning-2288"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support existing directories when readOnly specified in the volumeSource
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:399
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource","total":-1,"completed":5,"skipped":29,"failed":0}

SSSSSS
------------------------------
{"msg":"FAILED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny attaching pod [Conformance]","total":-1,"completed":1,"skipped":9,"failed":1,"failures":["[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny attaching pod [Conformance]"]}
[BeforeEach] [sig-network] Services
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:25:26.523: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename services
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 7 lines ...
STEP: Destroying namespace "services-6087" for this suite.
[AfterEach] [sig-network] Services
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:750

•
------------------------------
{"msg":"PASSED [sig-network] Services should provide secure master service  [Conformance]","total":-1,"completed":2,"skipped":9,"failed":1,"failures":["[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny attaching pod [Conformance]"]}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:25:27.389: INFO: Driver emptydir doesn't support DynamicPV -- skipping
... skipping 44 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:25:28.134: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "clientset-2811" for this suite.

•
------------------------------
{"msg":"PASSED [sig-api-machinery] Generated clientset should create v1beta1 cronJobs, delete cronJobs, watch cronJobs","total":-1,"completed":6,"skipped":35,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumes
... skipping 79 lines ...
Sep 21 19:25:25.485: INFO: Waiting for pod aws-client to disappear
Sep 21 19:25:25.587: INFO: Pod aws-client no longer exists
STEP: cleaning the environment after aws
STEP: Deleting pv and pvc
Sep 21 19:25:25.587: INFO: Deleting PersistentVolumeClaim "pvc-8k922"
Sep 21 19:25:25.692: INFO: Deleting PersistentVolume "aws-mb8tv"
Sep 21 19:25:26.399: INFO: Couldn't delete PD "aws://eu-west-3a/vol-0b6db7375b744a252", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0b6db7375b744a252 is currently attached to i-091b483121e935118
	status code: 400, request id: 58235557-dc61-42ce-9d1f-77402b606066
Sep 21 19:25:31.992: INFO: Successfully deleted PD "aws://eu-west-3a/vol-0b6db7375b744a252".
[AfterEach] [Testpattern: Pre-provisioned PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:25:31.992: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-5209" for this suite.
... skipping 6 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (block volmode)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should store data
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (block volmode)] volumes should store data","total":-1,"completed":3,"skipped":28,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
... skipping 15 lines ...
Sep 21 19:25:26.309: INFO: PersistentVolumeClaim pvc-nhqdl found but phase is Pending instead of Bound.
Sep 21 19:25:28.415: INFO: PersistentVolumeClaim pvc-nhqdl found and phase=Bound (2.209937356s)
Sep 21 19:25:28.415: INFO: Waiting up to 3m0s for PersistentVolume local-c228t to have phase Bound
Sep 21 19:25:28.519: INFO: PersistentVolume local-c228t found and phase=Bound (103.956131ms)
STEP: Creating pod exec-volume-test-preprovisionedpv-xr2g
STEP: Creating a pod to test exec-volume-test
Sep 21 19:25:28.835: INFO: Waiting up to 5m0s for pod "exec-volume-test-preprovisionedpv-xr2g" in namespace "volume-1620" to be "Succeeded or Failed"
Sep 21 19:25:28.939: INFO: Pod "exec-volume-test-preprovisionedpv-xr2g": Phase="Pending", Reason="", readiness=false. Elapsed: 103.678407ms
Sep 21 19:25:31.045: INFO: Pod "exec-volume-test-preprovisionedpv-xr2g": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.209869086s
STEP: Saw pod success
Sep 21 19:25:31.045: INFO: Pod "exec-volume-test-preprovisionedpv-xr2g" satisfied condition "Succeeded or Failed"
Sep 21 19:25:31.152: INFO: Trying to get logs from node ip-172-20-35-229.eu-west-3.compute.internal pod exec-volume-test-preprovisionedpv-xr2g container exec-container-preprovisionedpv-xr2g: <nil>
STEP: delete the pod
Sep 21 19:25:31.369: INFO: Waiting for pod exec-volume-test-preprovisionedpv-xr2g to disappear
Sep 21 19:25:31.473: INFO: Pod exec-volume-test-preprovisionedpv-xr2g no longer exists
STEP: Deleting pod exec-volume-test-preprovisionedpv-xr2g
Sep 21 19:25:31.473: INFO: Deleting pod "exec-volume-test-preprovisionedpv-xr2g" in namespace "volume-1620"
... skipping 17 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should allow exec of files on the volume
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link] [Testpattern: Pre-provisioned PV (default fs)] volumes should allow exec of files on the volume","total":-1,"completed":4,"skipped":35,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:25:33.308: INFO: Driver hostPath doesn't support DynamicPV -- skipping
... skipping 81 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  Simple CustomResourceDefinition
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/custom_resource_definition.go:48
    listing custom resource definition objects works  [Conformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition listing custom resource definition objects works  [Conformance]","total":-1,"completed":7,"skipped":36,"failed":0}

SSSSSSSSSS
------------------------------
[BeforeEach] [sig-storage] PVC Protection
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 57 lines ...
Sep 21 19:25:26.122: INFO: PersistentVolumeClaim pvc-fvwvm found but phase is Pending instead of Bound.
Sep 21 19:25:28.226: INFO: PersistentVolumeClaim pvc-fvwvm found and phase=Bound (2.211754471s)
Sep 21 19:25:28.226: INFO: Waiting up to 3m0s for PersistentVolume local-j2hdf to have phase Bound
Sep 21 19:25:28.328: INFO: PersistentVolume local-j2hdf found and phase=Bound (101.818423ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-8rgs
STEP: Creating a pod to test subpath
Sep 21 19:25:28.641: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-8rgs" in namespace "provisioning-4361" to be "Succeeded or Failed"
Sep 21 19:25:28.743: INFO: Pod "pod-subpath-test-preprovisionedpv-8rgs": Phase="Pending", Reason="", readiness=false. Elapsed: 102.216862ms
Sep 21 19:25:30.847: INFO: Pod "pod-subpath-test-preprovisionedpv-8rgs": Phase="Pending", Reason="", readiness=false. Elapsed: 2.205652746s
Sep 21 19:25:33.027: INFO: Pod "pod-subpath-test-preprovisionedpv-8rgs": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.386395406s
STEP: Saw pod success
Sep 21 19:25:33.027: INFO: Pod "pod-subpath-test-preprovisionedpv-8rgs" satisfied condition "Succeeded or Failed"
Sep 21 19:25:33.131: INFO: Trying to get logs from node ip-172-20-53-119.eu-west-3.compute.internal pod pod-subpath-test-preprovisionedpv-8rgs container test-container-volume-preprovisionedpv-8rgs: <nil>
STEP: delete the pod
Sep 21 19:25:33.359: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-8rgs to disappear
Sep 21 19:25:33.463: INFO: Pod pod-subpath-test-preprovisionedpv-8rgs no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-8rgs
Sep 21 19:25:33.463: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-8rgs" in namespace "provisioning-4361"
... skipping 22 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support non-existent path
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:194
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: tmpfs] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path","total":-1,"completed":6,"skipped":31,"failed":0}

SSSSSSS
------------------------------
[BeforeEach] [sig-apps] StatefulSet
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 10 lines ...
STEP: Looking for a node to schedule stateful set and pod
STEP: Creating pod with conflicting port in namespace statefulset-8447
STEP: Creating statefulset with conflicting port in namespace statefulset-8447
STEP: Waiting until pod test-pod will start running in namespace statefulset-8447
STEP: Waiting until stateful pod ss-0 will be recreated and deleted at least once in namespace statefulset-8447
Sep 21 19:25:22.145: INFO: Observed stateful pod in namespace: statefulset-8447, name: ss-0, uid: 168357a9-8e29-4932-97c2-d22e1c6a4cec, status phase: Pending. Waiting for statefulset controller to delete.
Sep 21 19:25:22.510: INFO: Observed stateful pod in namespace: statefulset-8447, name: ss-0, uid: 168357a9-8e29-4932-97c2-d22e1c6a4cec, status phase: Failed. Waiting for statefulset controller to delete.
Sep 21 19:25:22.520: INFO: Observed stateful pod in namespace: statefulset-8447, name: ss-0, uid: 168357a9-8e29-4932-97c2-d22e1c6a4cec, status phase: Failed. Waiting for statefulset controller to delete.
Sep 21 19:25:22.520: INFO: Observed delete event for stateful pod ss-0 in namespace statefulset-8447
STEP: Removing pod with conflicting port in namespace statefulset-8447
STEP: Waiting when stateful pod ss-0 will be recreated in namespace statefulset-8447 and will be in running state
[AfterEach] Basic StatefulSet functionality [StatefulSetBasic]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:116
Sep 21 19:25:24.841: INFO: Deleting all statefulset in ns statefulset-8447
... skipping 11 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  Basic StatefulSet functionality [StatefulSetBasic]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:95
    Should recreate evicted statefulset [Conformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]","total":-1,"completed":7,"skipped":64,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
... skipping 2 lines ...
Sep 21 19:25:20.940: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
STEP: Waiting for a default service account to be provisioned in namespace
[It] should support existing single file [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219
Sep 21 19:25:21.466: INFO: In-tree plugin kubernetes.io/host-path is not migrated, not validating any metrics
Sep 21 19:25:21.678: INFO: Waiting up to 5m0s for pod "hostpath-symlink-prep-provisioning-6940" in namespace "provisioning-6940" to be "Succeeded or Failed"
Sep 21 19:25:21.783: INFO: Pod "hostpath-symlink-prep-provisioning-6940": Phase="Pending", Reason="", readiness=false. Elapsed: 104.48876ms
Sep 21 19:25:23.889: INFO: Pod "hostpath-symlink-prep-provisioning-6940": Phase="Pending", Reason="", readiness=false. Elapsed: 2.210307066s
Sep 21 19:25:25.994: INFO: Pod "hostpath-symlink-prep-provisioning-6940": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.315882966s
STEP: Saw pod success
Sep 21 19:25:25.994: INFO: Pod "hostpath-symlink-prep-provisioning-6940" satisfied condition "Succeeded or Failed"
Sep 21 19:25:25.994: INFO: Deleting pod "hostpath-symlink-prep-provisioning-6940" in namespace "provisioning-6940"
Sep 21 19:25:26.110: INFO: Wait up to 5m0s for pod "hostpath-symlink-prep-provisioning-6940" to be fully deleted
Sep 21 19:25:26.217: INFO: Creating resource for inline volume
STEP: Creating pod pod-subpath-test-inlinevolume-gjv9
STEP: Creating a pod to test subpath
Sep 21 19:25:26.328: INFO: Waiting up to 5m0s for pod "pod-subpath-test-inlinevolume-gjv9" in namespace "provisioning-6940" to be "Succeeded or Failed"
Sep 21 19:25:26.432: INFO: Pod "pod-subpath-test-inlinevolume-gjv9": Phase="Pending", Reason="", readiness=false. Elapsed: 104.55073ms
Sep 21 19:25:28.539: INFO: Pod "pod-subpath-test-inlinevolume-gjv9": Phase="Pending", Reason="", readiness=false. Elapsed: 2.211130748s
Sep 21 19:25:30.658: INFO: Pod "pod-subpath-test-inlinevolume-gjv9": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.330443689s
STEP: Saw pod success
Sep 21 19:25:30.658: INFO: Pod "pod-subpath-test-inlinevolume-gjv9" satisfied condition "Succeeded or Failed"
Sep 21 19:25:30.764: INFO: Trying to get logs from node ip-172-20-35-229.eu-west-3.compute.internal pod pod-subpath-test-inlinevolume-gjv9 container test-container-subpath-inlinevolume-gjv9: <nil>
STEP: delete the pod
Sep 21 19:25:31.077: INFO: Waiting for pod pod-subpath-test-inlinevolume-gjv9 to disappear
Sep 21 19:25:31.183: INFO: Pod pod-subpath-test-inlinevolume-gjv9 no longer exists
STEP: Deleting pod pod-subpath-test-inlinevolume-gjv9
Sep 21 19:25:31.183: INFO: Deleting pod "pod-subpath-test-inlinevolume-gjv9" in namespace "provisioning-6940"
STEP: Deleting pod
Sep 21 19:25:31.288: INFO: Deleting pod "pod-subpath-test-inlinevolume-gjv9" in namespace "provisioning-6940"
Sep 21 19:25:31.500: INFO: Waiting up to 5m0s for pod "hostpath-symlink-prep-provisioning-6940" in namespace "provisioning-6940" to be "Succeeded or Failed"
Sep 21 19:25:31.638: INFO: Pod "hostpath-symlink-prep-provisioning-6940": Phase="Pending", Reason="", readiness=false. Elapsed: 137.439311ms
Sep 21 19:25:33.745: INFO: Pod "hostpath-symlink-prep-provisioning-6940": Phase="Pending", Reason="", readiness=false. Elapsed: 2.244334687s
Sep 21 19:25:35.852: INFO: Pod "hostpath-symlink-prep-provisioning-6940": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.351336356s
STEP: Saw pod success
Sep 21 19:25:35.852: INFO: Pod "hostpath-symlink-prep-provisioning-6940" satisfied condition "Succeeded or Failed"
Sep 21 19:25:35.852: INFO: Deleting pod "hostpath-symlink-prep-provisioning-6940" in namespace "provisioning-6940"
Sep 21 19:25:35.962: INFO: Wait up to 5m0s for pod "hostpath-symlink-prep-provisioning-6940" to be fully deleted
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:25:36.067: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "provisioning-6940" for this suite.
... skipping 6 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support existing single file [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Inline-volume (default fs)] subPath should support existing single file [LinuxOnly]","total":-1,"completed":5,"skipped":23,"failed":0}

S
------------------------------
[BeforeEach] [sig-auth] Certificates API [Privileged:ClusterAdmin]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 26 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:25:36.454: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "certificates-6567" for this suite.

•
------------------------------
{"msg":"PASSED [sig-auth] Certificates API [Privileged:ClusterAdmin] should support CSR API operations [Conformance]","total":-1,"completed":4,"skipped":29,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:25:36.675: INFO: Driver local doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 64 lines ...
Sep 21 19:25:33.839: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename containers
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be able to override the image's default command and arguments [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test override all
Sep 21 19:25:34.473: INFO: Waiting up to 5m0s for pod "client-containers-c522aeb3-9ede-43ca-a105-589e471fa216" in namespace "containers-7532" to be "Succeeded or Failed"
Sep 21 19:25:34.578: INFO: Pod "client-containers-c522aeb3-9ede-43ca-a105-589e471fa216": Phase="Pending", Reason="", readiness=false. Elapsed: 104.962552ms
Sep 21 19:25:36.682: INFO: Pod "client-containers-c522aeb3-9ede-43ca-a105-589e471fa216": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.209176681s
STEP: Saw pod success
Sep 21 19:25:36.682: INFO: Pod "client-containers-c522aeb3-9ede-43ca-a105-589e471fa216" satisfied condition "Succeeded or Failed"
Sep 21 19:25:36.786: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod client-containers-c522aeb3-9ede-43ca-a105-589e471fa216 container agnhost-container: <nil>
STEP: delete the pod
Sep 21 19:25:37.000: INFO: Waiting for pod client-containers-c522aeb3-9ede-43ca-a105-589e471fa216 to disappear
Sep 21 19:25:37.103: INFO: Pod client-containers-c522aeb3-9ede-43ca-a105-589e471fa216 no longer exists
[AfterEach] [sig-node] Docker Containers
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:25:37.103: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "containers-7532" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Docker Containers should be able to override the image's default command and arguments [NodeConformance] [Conformance]","total":-1,"completed":8,"skipped":46,"failed":0}

S
------------------------------
{"msg":"PASSED [sig-api-machinery] CustomResourceDefinition Watch [Privileged:ClusterAdmin] CustomResourceDefinition Watch watch on custom resource definition objects [Conformance]","total":-1,"completed":2,"skipped":18,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:24:58.396: INFO: >>> kubeConfig: /root/.kube/config
... skipping 53 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should not mount / map unused volumes in a pod [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:351
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link-bindmounted] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":-1,"completed":3,"skipped":18,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:25:38.118: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 49 lines ...
[It] should support existing directory
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:205
Sep 21 19:25:33.903: INFO: In-tree plugin kubernetes.io/empty-dir is not migrated, not validating any metrics
Sep 21 19:25:33.904: INFO: Creating resource for inline volume
STEP: Creating pod pod-subpath-test-inlinevolume-pqtz
STEP: Creating a pod to test subpath
Sep 21 19:25:34.011: INFO: Waiting up to 5m0s for pod "pod-subpath-test-inlinevolume-pqtz" in namespace "provisioning-5286" to be "Succeeded or Failed"
Sep 21 19:25:34.115: INFO: Pod "pod-subpath-test-inlinevolume-pqtz": Phase="Pending", Reason="", readiness=false. Elapsed: 104.018653ms
Sep 21 19:25:36.220: INFO: Pod "pod-subpath-test-inlinevolume-pqtz": Phase="Pending", Reason="", readiness=false. Elapsed: 2.208635722s
Sep 21 19:25:38.324: INFO: Pod "pod-subpath-test-inlinevolume-pqtz": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.312967575s
STEP: Saw pod success
Sep 21 19:25:38.325: INFO: Pod "pod-subpath-test-inlinevolume-pqtz" satisfied condition "Succeeded or Failed"
Sep 21 19:25:38.429: INFO: Trying to get logs from node ip-172-20-35-229.eu-west-3.compute.internal pod pod-subpath-test-inlinevolume-pqtz container test-container-volume-inlinevolume-pqtz: <nil>
STEP: delete the pod
Sep 21 19:25:38.644: INFO: Waiting for pod pod-subpath-test-inlinevolume-pqtz to disappear
Sep 21 19:25:38.748: INFO: Pod pod-subpath-test-inlinevolume-pqtz no longer exists
STEP: Deleting pod pod-subpath-test-inlinevolume-pqtz
Sep 21 19:25:38.749: INFO: Deleting pod "pod-subpath-test-inlinevolume-pqtz" in namespace "provisioning-5286"
... skipping 12 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support existing directory
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:205
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should support existing directory","total":-1,"completed":5,"skipped":44,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:25:39.181: INFO: Only supported for providers [gce gke] (not aws)
[AfterEach] [Testpattern: Dynamic PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 54 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:25:39.314: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "clientset-4679" for this suite.

•
------------------------------
{"msg":"PASSED [sig-api-machinery] Generated clientset should create pods, set the deletionTimestamp and deletionGracePeriodSeconds of the pod","total":-1,"completed":8,"skipped":67,"failed":0}

SSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
... skipping 2 lines ...
Sep 21 19:25:03.463: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename provisioning
STEP: Waiting for a default service account to be provisioned in namespace
[It] should support file as subpath [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:230
Sep 21 19:25:04.002: INFO: In-tree plugin kubernetes.io/host-path is not migrated, not validating any metrics
Sep 21 19:25:04.215: INFO: Waiting up to 5m0s for pod "hostpath-symlink-prep-provisioning-8087" in namespace "provisioning-8087" to be "Succeeded or Failed"
Sep 21 19:25:04.319: INFO: Pod "hostpath-symlink-prep-provisioning-8087": Phase="Pending", Reason="", readiness=false. Elapsed: 104.318955ms
Sep 21 19:25:06.425: INFO: Pod "hostpath-symlink-prep-provisioning-8087": Phase="Pending", Reason="", readiness=false. Elapsed: 2.209621323s
Sep 21 19:25:08.531: INFO: Pod "hostpath-symlink-prep-provisioning-8087": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.315461707s
STEP: Saw pod success
Sep 21 19:25:08.531: INFO: Pod "hostpath-symlink-prep-provisioning-8087" satisfied condition "Succeeded or Failed"
Sep 21 19:25:08.531: INFO: Deleting pod "hostpath-symlink-prep-provisioning-8087" in namespace "provisioning-8087"
Sep 21 19:25:08.647: INFO: Wait up to 5m0s for pod "hostpath-symlink-prep-provisioning-8087" to be fully deleted
Sep 21 19:25:08.752: INFO: Creating resource for inline volume
STEP: Creating pod pod-subpath-test-inlinevolume-gks4
STEP: Creating a pod to test atomic-volume-subpath
Sep 21 19:25:08.858: INFO: Waiting up to 5m0s for pod "pod-subpath-test-inlinevolume-gks4" in namespace "provisioning-8087" to be "Succeeded or Failed"
Sep 21 19:25:08.963: INFO: Pod "pod-subpath-test-inlinevolume-gks4": Phase="Pending", Reason="", readiness=false. Elapsed: 105.083018ms
Sep 21 19:25:11.070: INFO: Pod "pod-subpath-test-inlinevolume-gks4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.211468782s
Sep 21 19:25:13.176: INFO: Pod "pod-subpath-test-inlinevolume-gks4": Phase="Running", Reason="", readiness=true. Elapsed: 4.318076593s
Sep 21 19:25:15.283: INFO: Pod "pod-subpath-test-inlinevolume-gks4": Phase="Running", Reason="", readiness=true. Elapsed: 6.424155487s
Sep 21 19:25:17.390: INFO: Pod "pod-subpath-test-inlinevolume-gks4": Phase="Running", Reason="", readiness=true. Elapsed: 8.531431715s
Sep 21 19:25:19.496: INFO: Pod "pod-subpath-test-inlinevolume-gks4": Phase="Running", Reason="", readiness=true. Elapsed: 10.637584628s
... skipping 2 lines ...
Sep 21 19:25:25.814: INFO: Pod "pod-subpath-test-inlinevolume-gks4": Phase="Running", Reason="", readiness=true. Elapsed: 16.955224608s
Sep 21 19:25:27.920: INFO: Pod "pod-subpath-test-inlinevolume-gks4": Phase="Running", Reason="", readiness=true. Elapsed: 19.062035868s
Sep 21 19:25:30.035: INFO: Pod "pod-subpath-test-inlinevolume-gks4": Phase="Running", Reason="", readiness=true. Elapsed: 21.177058102s
Sep 21 19:25:32.186: INFO: Pod "pod-subpath-test-inlinevolume-gks4": Phase="Running", Reason="", readiness=true. Elapsed: 23.327181282s
Sep 21 19:25:34.293: INFO: Pod "pod-subpath-test-inlinevolume-gks4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 25.434201564s
STEP: Saw pod success
Sep 21 19:25:34.293: INFO: Pod "pod-subpath-test-inlinevolume-gks4" satisfied condition "Succeeded or Failed"
Sep 21 19:25:34.405: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod pod-subpath-test-inlinevolume-gks4 container test-container-subpath-inlinevolume-gks4: <nil>
STEP: delete the pod
Sep 21 19:25:34.680: INFO: Waiting for pod pod-subpath-test-inlinevolume-gks4 to disappear
Sep 21 19:25:34.788: INFO: Pod pod-subpath-test-inlinevolume-gks4 no longer exists
STEP: Deleting pod pod-subpath-test-inlinevolume-gks4
Sep 21 19:25:34.788: INFO: Deleting pod "pod-subpath-test-inlinevolume-gks4" in namespace "provisioning-8087"
STEP: Deleting pod
Sep 21 19:25:34.893: INFO: Deleting pod "pod-subpath-test-inlinevolume-gks4" in namespace "provisioning-8087"
Sep 21 19:25:35.124: INFO: Waiting up to 5m0s for pod "hostpath-symlink-prep-provisioning-8087" in namespace "provisioning-8087" to be "Succeeded or Failed"
Sep 21 19:25:35.229: INFO: Pod "hostpath-symlink-prep-provisioning-8087": Phase="Pending", Reason="", readiness=false. Elapsed: 104.920477ms
Sep 21 19:25:37.336: INFO: Pod "hostpath-symlink-prep-provisioning-8087": Phase="Pending", Reason="", readiness=false. Elapsed: 2.211370415s
Sep 21 19:25:39.442: INFO: Pod "hostpath-symlink-prep-provisioning-8087": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.317473072s
STEP: Saw pod success
Sep 21 19:25:39.442: INFO: Pod "hostpath-symlink-prep-provisioning-8087" satisfied condition "Succeeded or Failed"
Sep 21 19:25:39.442: INFO: Deleting pod "hostpath-symlink-prep-provisioning-8087" in namespace "provisioning-8087"
Sep 21 19:25:39.556: INFO: Wait up to 5m0s for pod "hostpath-symlink-prep-provisioning-8087" to be fully deleted
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:25:39.661: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "provisioning-8087" for this suite.
... skipping 6 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support file as subpath [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:230
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: hostPathSymlink] [Testpattern: Inline-volume (default fs)] subPath should support file as subpath [LinuxOnly]","total":-1,"completed":10,"skipped":65,"failed":0}

SSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:25:39.960: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 253 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should be able to unmount after the subpath directory is deleted [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:449
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-bindmounted] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]","total":-1,"completed":3,"skipped":16,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:25:45.136: INFO: Driver hostPath doesn't support PreprovisionedPV -- skipping
[AfterEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 465 lines ...
• [SLOW TEST:72.216 seconds]
[sig-network] Conntrack
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/common/framework.go:23
  should drop INVALID conntrack entries
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/conntrack.go:282
------------------------------
{"msg":"PASSED [sig-network] Conntrack should drop INVALID conntrack entries","total":-1,"completed":3,"skipped":14,"failed":0}
[BeforeEach] [sig-node] Pods
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:25:45.509: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename pods
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 11 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:25:46.675: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "pods-4219" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Pods should delete a collection of pods [Conformance]","total":-1,"completed":4,"skipped":14,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:25:46.954: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 159 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:25:49.052: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "lease-test-5194" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Lease lease API should be available [Conformance]","total":-1,"completed":5,"skipped":36,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
... skipping 131 lines ...
Sep 21 19:25:41.675: INFO: PersistentVolumeClaim pvc-vnrzp found but phase is Pending instead of Bound.
Sep 21 19:25:43.783: INFO: PersistentVolumeClaim pvc-vnrzp found and phase=Bound (10.633709585s)
Sep 21 19:25:43.783: INFO: Waiting up to 3m0s for PersistentVolume local-ql9s5 to have phase Bound
Sep 21 19:25:43.887: INFO: PersistentVolume local-ql9s5 found and phase=Bound (104.105473ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-pzn8
STEP: Creating a pod to test subpath
Sep 21 19:25:44.201: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-pzn8" in namespace "provisioning-2539" to be "Succeeded or Failed"
Sep 21 19:25:44.306: INFO: Pod "pod-subpath-test-preprovisionedpv-pzn8": Phase="Pending", Reason="", readiness=false. Elapsed: 104.873761ms
Sep 21 19:25:46.411: INFO: Pod "pod-subpath-test-preprovisionedpv-pzn8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.209935925s
Sep 21 19:25:48.516: INFO: Pod "pod-subpath-test-preprovisionedpv-pzn8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.315457826s
Sep 21 19:25:50.625: INFO: Pod "pod-subpath-test-preprovisionedpv-pzn8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.423562501s
STEP: Saw pod success
Sep 21 19:25:50.625: INFO: Pod "pod-subpath-test-preprovisionedpv-pzn8" satisfied condition "Succeeded or Failed"
Sep 21 19:25:50.732: INFO: Trying to get logs from node ip-172-20-63-30.eu-west-3.compute.internal pod pod-subpath-test-preprovisionedpv-pzn8 container test-container-subpath-preprovisionedpv-pzn8: <nil>
STEP: delete the pod
Sep 21 19:25:50.950: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-pzn8 to disappear
Sep 21 19:25:51.053: INFO: Pod pod-subpath-test-preprovisionedpv-pzn8 no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-pzn8
Sep 21 19:25:51.053: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-pzn8" in namespace "provisioning-2539"
... skipping 26 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support existing single file [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: blockfs] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing single file [LinuxOnly]","total":-1,"completed":3,"skipped":13,"failed":1,"failures":["[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny attaching pod [Conformance]"]}

SSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:25:55.040: INFO: Driver hostPath doesn't support DynamicPV -- skipping
... skipping 88 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:192
    Two pods mounting a local volume at the same time
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:248
      should be able to write from pod1 and read from pod2
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:249
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: dir-link-bindmounted] Two pods mounting a local volume at the same time should be able to write from pod1 and read from pod2","total":-1,"completed":9,"skipped":47,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:25:55.068: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename security-context
STEP: Waiting for a default service account to be provisioned in namespace
[It] should support seccomp runtime/default [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:176
STEP: Creating a pod to test seccomp.security.alpha.kubernetes.io/pod
Sep 21 19:25:55.701: INFO: Waiting up to 5m0s for pod "security-context-645d60bd-cfbb-4e00-b69f-70f1b4dbb124" in namespace "security-context-5117" to be "Succeeded or Failed"
Sep 21 19:25:55.805: INFO: Pod "security-context-645d60bd-cfbb-4e00-b69f-70f1b4dbb124": Phase="Pending", Reason="", readiness=false. Elapsed: 103.696845ms
Sep 21 19:25:57.909: INFO: Pod "security-context-645d60bd-cfbb-4e00-b69f-70f1b4dbb124": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.207879769s
STEP: Saw pod success
Sep 21 19:25:57.909: INFO: Pod "security-context-645d60bd-cfbb-4e00-b69f-70f1b4dbb124" satisfied condition "Succeeded or Failed"
Sep 21 19:25:58.013: INFO: Trying to get logs from node ip-172-20-35-229.eu-west-3.compute.internal pod security-context-645d60bd-cfbb-4e00-b69f-70f1b4dbb124 container test-container: <nil>
STEP: delete the pod
Sep 21 19:25:58.233: INFO: Waiting for pod security-context-645d60bd-cfbb-4e00-b69f-70f1b4dbb124 to disappear
Sep 21 19:25:58.337: INFO: Pod security-context-645d60bd-cfbb-4e00-b69f-70f1b4dbb124 no longer exists
[AfterEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:25:58.337: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "security-context-5117" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Security Context should support seccomp runtime/default [LinuxOnly]","total":-1,"completed":4,"skipped":20,"failed":1,"failures":["[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny attaching pod [Conformance]"]}

SSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
... skipping 56 lines ...
• [SLOW TEST:161.484 seconds]
[sig-node] Probing container
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should have monotonically increasing restart count [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Probing container should have monotonically increasing restart count [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":3,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:26:03.598: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 242 lines ...
Sep 21 19:25:57.653: INFO: PersistentVolumeClaim pvc-mfjfx found but phase is Pending instead of Bound.
Sep 21 19:25:59.758: INFO: PersistentVolumeClaim pvc-mfjfx found and phase=Bound (8.535178933s)
Sep 21 19:25:59.758: INFO: Waiting up to 3m0s for PersistentVolume local-25h9t to have phase Bound
Sep 21 19:25:59.863: INFO: PersistentVolume local-25h9t found and phase=Bound (104.399655ms)
STEP: Creating pod exec-volume-test-preprovisionedpv-bw5x
STEP: Creating a pod to test exec-volume-test
Sep 21 19:26:00.185: INFO: Waiting up to 5m0s for pod "exec-volume-test-preprovisionedpv-bw5x" in namespace "volume-9794" to be "Succeeded or Failed"
Sep 21 19:26:00.290: INFO: Pod "exec-volume-test-preprovisionedpv-bw5x": Phase="Pending", Reason="", readiness=false. Elapsed: 104.407858ms
Sep 21 19:26:02.395: INFO: Pod "exec-volume-test-preprovisionedpv-bw5x": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.209462519s
STEP: Saw pod success
Sep 21 19:26:02.395: INFO: Pod "exec-volume-test-preprovisionedpv-bw5x" satisfied condition "Succeeded or Failed"
Sep 21 19:26:02.500: INFO: Trying to get logs from node ip-172-20-53-119.eu-west-3.compute.internal pod exec-volume-test-preprovisionedpv-bw5x container exec-container-preprovisionedpv-bw5x: <nil>
STEP: delete the pod
Sep 21 19:26:02.715: INFO: Waiting for pod exec-volume-test-preprovisionedpv-bw5x to disappear
Sep 21 19:26:02.820: INFO: Pod exec-volume-test-preprovisionedpv-bw5x no longer exists
STEP: Deleting pod exec-volume-test-preprovisionedpv-bw5x
Sep 21 19:26:02.820: INFO: Deleting pod "exec-volume-test-preprovisionedpv-bw5x" in namespace "volume-9794"
... skipping 43 lines ...
• [SLOW TEST:6.193 seconds]
[sig-storage] Projected downwardAPI
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should update labels on modification [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-bindmounted] [Testpattern: Pre-provisioned PV (default fs)] volumes should allow exec of files on the volume","total":-1,"completed":4,"skipped":38,"failed":0}

SS
------------------------------
{"msg":"PASSED [sig-storage] Projected downwardAPI should update labels on modification [NodeConformance] [Conformance]","total":-1,"completed":10,"skipped":50,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:26:04.207: INFO: Only supported for providers [gce gke] (not aws)
[AfterEach] [Testpattern: Pre-provisioned PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 80 lines ...
      Driver emptydir doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
S
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: dir] Two pods mounting a local volume at the same time should be able to write from pod1 and read from pod2","total":-1,"completed":7,"skipped":38,"failed":0}
[BeforeEach] [sig-apps] DisruptionController
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:25:52.280: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename disruption
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 33 lines ...
• [SLOW TEST:13.205 seconds]
[sig-apps] DisruptionController
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  should block an eviction until the PDB is updated to allow it
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/disruption.go:318
------------------------------
{"msg":"PASSED [sig-apps] DisruptionController should block an eviction until the PDB is updated to allow it","total":-1,"completed":8,"skipped":38,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:26:05.507: INFO: Driver hostPathSymlink doesn't support PreprovisionedPV -- skipping
[AfterEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 11 lines ...
      Driver hostPathSymlink doesn't support PreprovisionedPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
S
------------------------------
{"msg":"PASSED [sig-storage] PVC Protection Verify that PVC in active use by a pod is not removed immediately","total":-1,"completed":7,"skipped":12,"failed":0}
[BeforeEach] [sig-storage] Subpath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:25:34.535: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename subpath
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] Atomic writer volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:38
STEP: Setting up data
[It] should support subpaths with downward pod [LinuxOnly] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating pod pod-subpath-test-downwardapi-bqqv
STEP: Creating a pod to test atomic-volume-subpath
Sep 21 19:25:35.419: INFO: Waiting up to 5m0s for pod "pod-subpath-test-downwardapi-bqqv" in namespace "subpath-4859" to be "Succeeded or Failed"
Sep 21 19:25:35.522: INFO: Pod "pod-subpath-test-downwardapi-bqqv": Phase="Pending", Reason="", readiness=false. Elapsed: 102.670398ms
Sep 21 19:25:37.626: INFO: Pod "pod-subpath-test-downwardapi-bqqv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.206331868s
Sep 21 19:25:39.730: INFO: Pod "pod-subpath-test-downwardapi-bqqv": Phase="Running", Reason="", readiness=true. Elapsed: 4.310302132s
Sep 21 19:25:41.834: INFO: Pod "pod-subpath-test-downwardapi-bqqv": Phase="Running", Reason="", readiness=true. Elapsed: 6.414851502s
Sep 21 19:25:43.939: INFO: Pod "pod-subpath-test-downwardapi-bqqv": Phase="Running", Reason="", readiness=true. Elapsed: 8.519345861s
Sep 21 19:25:46.042: INFO: Pod "pod-subpath-test-downwardapi-bqqv": Phase="Running", Reason="", readiness=true. Elapsed: 10.622823786s
... skipping 4 lines ...
Sep 21 19:25:56.588: INFO: Pod "pod-subpath-test-downwardapi-bqqv": Phase="Running", Reason="", readiness=true. Elapsed: 21.168570535s
Sep 21 19:25:58.692: INFO: Pod "pod-subpath-test-downwardapi-bqqv": Phase="Running", Reason="", readiness=true. Elapsed: 23.272731759s
Sep 21 19:26:00.799: INFO: Pod "pod-subpath-test-downwardapi-bqqv": Phase="Running", Reason="", readiness=true. Elapsed: 25.379599574s
Sep 21 19:26:02.903: INFO: Pod "pod-subpath-test-downwardapi-bqqv": Phase="Running", Reason="", readiness=true. Elapsed: 27.483467022s
Sep 21 19:26:05.008: INFO: Pod "pod-subpath-test-downwardapi-bqqv": Phase="Succeeded", Reason="", readiness=false. Elapsed: 29.58829668s
STEP: Saw pod success
Sep 21 19:26:05.008: INFO: Pod "pod-subpath-test-downwardapi-bqqv" satisfied condition "Succeeded or Failed"
Sep 21 19:26:05.111: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod pod-subpath-test-downwardapi-bqqv container test-container-subpath-downwardapi-bqqv: <nil>
STEP: delete the pod
Sep 21 19:26:05.327: INFO: Waiting for pod pod-subpath-test-downwardapi-bqqv to disappear
Sep 21 19:26:05.430: INFO: Pod pod-subpath-test-downwardapi-bqqv no longer exists
STEP: Deleting pod pod-subpath-test-downwardapi-bqqv
Sep 21 19:26:05.430: INFO: Deleting pod "pod-subpath-test-downwardapi-bqqv" in namespace "subpath-4859"
... skipping 8 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  Atomic writer volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:34
    should support subpaths with downward pod [LinuxOnly] [Conformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Subpath Atomic writer volumes should support subpaths with downward pod [LinuxOnly] [Conformance]","total":-1,"completed":8,"skipped":12,"failed":0}

SSSS
------------------------------
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 17 lines ...
STEP: Registering the mutating webhook for custom resource e2e-test-webhook-9570-crds.webhook.example.com via the AdmissionRegistration API
Sep 21 19:25:14.234: INFO: Waiting for webhook configuration to be ready...
Sep 21 19:25:24.547: INFO: Waiting for webhook configuration to be ready...
Sep 21 19:25:34.864: INFO: Waiting for webhook configuration to be ready...
Sep 21 19:25:45.150: INFO: Waiting for webhook configuration to be ready...
Sep 21 19:25:55.361: INFO: Waiting for webhook configuration to be ready...
Sep 21 19:25:55.361: FAIL: waiting for webhook configuration to be ready
Unexpected error:
    <*errors.errorString | 0xc000244250>: {
        s: "timed out waiting for the condition",
    }
    timed out waiting for the condition
occurred

... skipping 436 lines ...
[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should mutate custom resource [Conformance] [It]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630

  Sep 21 19:25:55.361: waiting for webhook configuration to be ready
  Unexpected error:
      <*errors.errorString | 0xc000244250>: {
          s: "timed out waiting for the condition",
      }
      timed out waiting for the condition
  occurred

  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:1826
------------------------------
S
------------------------------
{"msg":"FAILED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource [Conformance]","total":-1,"completed":4,"skipped":29,"failed":1,"failures":["[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource [Conformance]"]}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:26:05.801: INFO: Driver emptydir doesn't support DynamicPV -- skipping
... skipping 28 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: local][LocalVolumeType: dir-link-bindmounted]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (immediate binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Driver local doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
... skipping 50 lines ...
STEP: Building a namespace api object, basename projected
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable from pods in volume [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating configMap with name projected-configmap-test-volume-c445f7d0-310d-48ef-b254-28b14ded67a4
STEP: Creating a pod to test consume configMaps
Sep 21 19:26:06.747: INFO: Waiting up to 5m0s for pod "pod-projected-configmaps-34e5e9ba-181d-406e-a1e0-dfa2a5abd834" in namespace "projected-8311" to be "Succeeded or Failed"
Sep 21 19:26:06.853: INFO: Pod "pod-projected-configmaps-34e5e9ba-181d-406e-a1e0-dfa2a5abd834": Phase="Pending", Reason="", readiness=false. Elapsed: 105.200558ms
Sep 21 19:26:08.959: INFO: Pod "pod-projected-configmaps-34e5e9ba-181d-406e-a1e0-dfa2a5abd834": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.212130049s
STEP: Saw pod success
Sep 21 19:26:08.960: INFO: Pod "pod-projected-configmaps-34e5e9ba-181d-406e-a1e0-dfa2a5abd834" satisfied condition "Succeeded or Failed"
Sep 21 19:26:09.066: INFO: Trying to get logs from node ip-172-20-35-229.eu-west-3.compute.internal pod pod-projected-configmaps-34e5e9ba-181d-406e-a1e0-dfa2a5abd834 container agnhost-container: <nil>
STEP: delete the pod
Sep 21 19:26:09.284: INFO: Waiting for pod pod-projected-configmaps-34e5e9ba-181d-406e-a1e0-dfa2a5abd834 to disappear
Sep 21 19:26:09.392: INFO: Pod pod-projected-configmaps-34e5e9ba-181d-406e-a1e0-dfa2a5abd834 no longer exists
[AfterEach] [sig-storage] Projected configMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:26:09.393: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "projected-8311" for this suite.

•
------------------------------
{"msg":"PASSED [sig-storage] Projected configMap should be consumable from pods in volume [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":47,"failed":1,"failures":["[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource [Conformance]"]}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:26:09.620: INFO: Driver hostPath doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 48 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  Container restart
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:130
    should verify that container can restart successfully after configmaps modified
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:131
------------------------------
{"msg":"PASSED [sig-storage] Subpath Container restart should verify that container can restart successfully after configmaps modified","total":-1,"completed":4,"skipped":30,"failed":0}

SSSSS
------------------------------
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
... skipping 40 lines ...
Sep 21 19:25:59.870: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
STEP: creating a test aws volume
Sep 21 19:26:00.587: INFO: Successfully created a new PD: "aws://eu-west-3a/vol-02734cada3bf4b0be".
Sep 21 19:26:00.587: INFO: Creating resource for inline volume
STEP: Creating pod exec-volume-test-inlinevolume-bvnk
STEP: Creating a pod to test exec-volume-test
Sep 21 19:26:00.693: INFO: Waiting up to 5m0s for pod "exec-volume-test-inlinevolume-bvnk" in namespace "volume-4408" to be "Succeeded or Failed"
Sep 21 19:26:00.797: INFO: Pod "exec-volume-test-inlinevolume-bvnk": Phase="Pending", Reason="", readiness=false. Elapsed: 103.760507ms
Sep 21 19:26:02.902: INFO: Pod "exec-volume-test-inlinevolume-bvnk": Phase="Pending", Reason="", readiness=false. Elapsed: 2.208256166s
Sep 21 19:26:05.008: INFO: Pod "exec-volume-test-inlinevolume-bvnk": Phase="Pending", Reason="", readiness=false. Elapsed: 4.314409644s
Sep 21 19:26:07.113: INFO: Pod "exec-volume-test-inlinevolume-bvnk": Phase="Pending", Reason="", readiness=false. Elapsed: 6.419787429s
Sep 21 19:26:09.219: INFO: Pod "exec-volume-test-inlinevolume-bvnk": Phase="Pending", Reason="", readiness=false. Elapsed: 8.52573542s
Sep 21 19:26:11.324: INFO: Pod "exec-volume-test-inlinevolume-bvnk": Phase="Pending", Reason="", readiness=false. Elapsed: 10.630739728s
Sep 21 19:26:13.430: INFO: Pod "exec-volume-test-inlinevolume-bvnk": Phase="Pending", Reason="", readiness=false. Elapsed: 12.736171139s
Sep 21 19:26:15.536: INFO: Pod "exec-volume-test-inlinevolume-bvnk": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.842378431s
STEP: Saw pod success
Sep 21 19:26:15.536: INFO: Pod "exec-volume-test-inlinevolume-bvnk" satisfied condition "Succeeded or Failed"
Sep 21 19:26:15.640: INFO: Trying to get logs from node ip-172-20-35-229.eu-west-3.compute.internal pod exec-volume-test-inlinevolume-bvnk container exec-container-inlinevolume-bvnk: <nil>
STEP: delete the pod
Sep 21 19:26:15.854: INFO: Waiting for pod exec-volume-test-inlinevolume-bvnk to disappear
Sep 21 19:26:15.957: INFO: Pod exec-volume-test-inlinevolume-bvnk no longer exists
STEP: Deleting pod exec-volume-test-inlinevolume-bvnk
Sep 21 19:26:15.957: INFO: Deleting pod "exec-volume-test-inlinevolume-bvnk" in namespace "volume-4408"
Sep 21 19:26:16.272: INFO: Couldn't delete PD "aws://eu-west-3a/vol-02734cada3bf4b0be", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-02734cada3bf4b0be is currently attached to i-0b23ccf9b0c1ad58b
	status code: 400, request id: 5950a250-9ae2-4470-8195-d41b28d72cf9
Sep 21 19:26:21.845: INFO: Couldn't delete PD "aws://eu-west-3a/vol-02734cada3bf4b0be", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-02734cada3bf4b0be is currently attached to i-0b23ccf9b0c1ad58b
	status code: 400, request id: 33dd378e-f0fb-44e9-b27c-36c7373ad713
Sep 21 19:26:27.408: INFO: Successfully deleted PD "aws://eu-west-3a/vol-02734cada3bf4b0be".
[AfterEach] [Testpattern: Inline-volume (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:26:27.408: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-4408" for this suite.
... skipping 6 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (default fs)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should allow exec of files on the volume
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196
------------------------------
{"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should include webhook resources in discovery documents [Conformance]","total":-1,"completed":5,"skipped":41,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:25:47.162: INFO: >>> kubeConfig: /root/.kube/config
... skipping 122 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_volumes.go:40
    [Testpattern: Dynamic PV (block volmode)] volumeMode
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should not mount / map unused volumes in a pod [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:351
------------------------------
{"msg":"PASSED [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":-1,"completed":6,"skipped":41,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
... skipping 130 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_volumes.go:40
    [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      Verify if offline PVC expansion works
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:174
------------------------------
{"msg":"PASSED [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand Verify if offline PVC expansion works","total":-1,"completed":6,"skipped":24,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:26:37.227: INFO: Only supported for providers [azure] (not aws)
... skipping 53 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:26:38.243: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "custom-resource-definition-5141" for this suite.

•
------------------------------
{"msg":"PASSED [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition creating/deleting custom resource definition objects works  [Conformance]","total":-1,"completed":7,"skipped":34,"failed":0}

SS
------------------------------
[BeforeEach] [sig-api-machinery] Watchers
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 18 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:26:39.859: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "watch-2404" for this suite.

•
------------------------------
{"msg":"PASSED [sig-api-machinery] Watchers should be able to restart watching from the last resource version observed by the previous watch [Conformance]","total":-1,"completed":8,"skipped":36,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:26:40.097: INFO: Only supported for providers [gce gke] (not aws)
... skipping 97 lines ...
• [SLOW TEST:14.735 seconds]
[sig-node] KubeletManagedEtcHosts
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should test kubelet managed /etc/hosts file [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] KubeletManagedEtcHosts should test kubelet managed /etc/hosts file [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":45,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:26:40.506: INFO: Only supported for providers [vsphere] (not aws)
... skipping 101 lines ...
Sep 21 19:26:12.210: INFO: PersistentVolumeClaim pvc-5hrdt found but phase is Pending instead of Bound.
Sep 21 19:26:14.314: INFO: PersistentVolumeClaim pvc-5hrdt found and phase=Bound (2.208185708s)
Sep 21 19:26:14.314: INFO: Waiting up to 3m0s for PersistentVolume local-hnhhb to have phase Bound
Sep 21 19:26:14.418: INFO: PersistentVolume local-hnhhb found and phase=Bound (103.933441ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-x8w2
STEP: Creating a pod to test atomic-volume-subpath
Sep 21 19:26:14.737: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-x8w2" in namespace "provisioning-6057" to be "Succeeded or Failed"
Sep 21 19:26:14.843: INFO: Pod "pod-subpath-test-preprovisionedpv-x8w2": Phase="Pending", Reason="", readiness=false. Elapsed: 105.139831ms
Sep 21 19:26:16.948: INFO: Pod "pod-subpath-test-preprovisionedpv-x8w2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.210758331s
Sep 21 19:26:19.053: INFO: Pod "pod-subpath-test-preprovisionedpv-x8w2": Phase="Pending", Reason="", readiness=false. Elapsed: 4.315612507s
Sep 21 19:26:21.158: INFO: Pod "pod-subpath-test-preprovisionedpv-x8w2": Phase="Pending", Reason="", readiness=false. Elapsed: 6.420607155s
Sep 21 19:26:23.263: INFO: Pod "pod-subpath-test-preprovisionedpv-x8w2": Phase="Pending", Reason="", readiness=false. Elapsed: 8.52507849s
Sep 21 19:26:25.368: INFO: Pod "pod-subpath-test-preprovisionedpv-x8w2": Phase="Running", Reason="", readiness=true. Elapsed: 10.630191705s
... skipping 2 lines ...
Sep 21 19:26:31.687: INFO: Pod "pod-subpath-test-preprovisionedpv-x8w2": Phase="Running", Reason="", readiness=true. Elapsed: 16.949410435s
Sep 21 19:26:33.792: INFO: Pod "pod-subpath-test-preprovisionedpv-x8w2": Phase="Running", Reason="", readiness=true. Elapsed: 19.05440895s
Sep 21 19:26:35.897: INFO: Pod "pod-subpath-test-preprovisionedpv-x8w2": Phase="Running", Reason="", readiness=true. Elapsed: 21.159690424s
Sep 21 19:26:38.003: INFO: Pod "pod-subpath-test-preprovisionedpv-x8w2": Phase="Running", Reason="", readiness=true. Elapsed: 23.265951338s
Sep 21 19:26:40.109: INFO: Pod "pod-subpath-test-preprovisionedpv-x8w2": Phase="Succeeded", Reason="", readiness=false. Elapsed: 25.371216558s
STEP: Saw pod success
Sep 21 19:26:40.109: INFO: Pod "pod-subpath-test-preprovisionedpv-x8w2" satisfied condition "Succeeded or Failed"
Sep 21 19:26:40.213: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod pod-subpath-test-preprovisionedpv-x8w2 container test-container-subpath-preprovisionedpv-x8w2: <nil>
STEP: delete the pod
Sep 21 19:26:40.428: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-x8w2 to disappear
Sep 21 19:26:40.532: INFO: Pod pod-subpath-test-preprovisionedpv-x8w2 no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-x8w2
Sep 21 19:26:40.532: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-x8w2" in namespace "provisioning-6057"
... skipping 75 lines ...
Sep 21 19:26:00.867: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-t89vz] to have phase Bound
Sep 21 19:26:00.970: INFO: PersistentVolumeClaim pvc-t89vz found and phase=Bound (103.147356ms)
STEP: Deleting the previously created pod
Sep 21 19:26:07.497: INFO: Deleting pod "pvc-volume-tester-z99bg" in namespace "csi-mock-volumes-9542"
Sep 21 19:26:07.601: INFO: Wait up to 5m0s for pod "pvc-volume-tester-z99bg" to be fully deleted
STEP: Checking CSI driver logs
Sep 21 19:26:23.921: INFO: Found NodeUnpublishVolume: {json: {"Method":"/csi.v1.Node/NodeUnpublishVolume","Request":{"volume_id":"4","target_path":"/var/lib/kubelet/pods/03c45668-36d9-4fd1-ad9a-05cf7cfddcbb/volumes/kubernetes.io~csi/pvc-eda5097e-84ad-4d64-ac5e-544eb7864830/mount"},"Response":{},"Error":"","FullError":null} Method:NodeUnpublishVolume Request:{VolumeContext:map[]} FullError:{Code:OK Message:} Error:}
STEP: Deleting pod pvc-volume-tester-z99bg
Sep 21 19:26:23.921: INFO: Deleting pod "pvc-volume-tester-z99bg" in namespace "csi-mock-volumes-9542"
STEP: Deleting claim pvc-t89vz
Sep 21 19:26:24.240: INFO: Waiting up to 2m0s for PersistentVolume pvc-eda5097e-84ad-4d64-ac5e-544eb7864830 to get deleted
Sep 21 19:26:24.355: INFO: PersistentVolume pvc-eda5097e-84ad-4d64-ac5e-544eb7864830 found and phase=Released (114.538891ms)
Sep 21 19:26:26.460: INFO: PersistentVolume pvc-eda5097e-84ad-4d64-ac5e-544eb7864830 was removed
... skipping 45 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  CSI workload information using mock driver
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:443
    should not be passed when podInfoOnMount=false
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:493
------------------------------
{"msg":"PASSED [sig-storage] CSI mock volume CSI workload information using mock driver should not be passed when podInfoOnMount=false","total":-1,"completed":6,"skipped":54,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-network] Services
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 20 lines ...
STEP: Destroying namespace "services-7416" for this suite.
[AfterEach] [sig-network] Services
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:750

•
------------------------------
{"msg":"PASSED [sig-network] Services should test the lifecycle of an Endpoint [Conformance]","total":-1,"completed":7,"skipped":57,"failed":0}

SSSS
------------------------------
[BeforeEach] [sig-storage] Pod Disks
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 9 lines ...
STEP: Destroying namespace "pod-disks-4007" for this suite.


S [SKIPPING] in Spec Setup (BeforeEach) [0.734 seconds]
[sig-storage] Pod Disks
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  should be able to delete a non-existent PD without error [BeforeEach]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/pd.go:449

  Requires at least 2 nodes (not 0)

  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/pd.go:75
------------------------------
... skipping 8 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: vsphere]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (delayed binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Only supported for providers [vsphere] (not aws)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:1437
------------------------------
... skipping 194 lines ...
Sep 21 19:26:06.047: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-6646n9mlj
STEP: creating a claim
Sep 21 19:26:06.150: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-h5ks
STEP: Creating a pod to test subpath
Sep 21 19:26:06.463: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-h5ks" in namespace "provisioning-6646" to be "Succeeded or Failed"
Sep 21 19:26:06.565: INFO: Pod "pod-subpath-test-dynamicpv-h5ks": Phase="Pending", Reason="", readiness=false. Elapsed: 101.988205ms
Sep 21 19:26:08.668: INFO: Pod "pod-subpath-test-dynamicpv-h5ks": Phase="Pending", Reason="", readiness=false. Elapsed: 2.204831386s
Sep 21 19:26:10.771: INFO: Pod "pod-subpath-test-dynamicpv-h5ks": Phase="Pending", Reason="", readiness=false. Elapsed: 4.307832663s
Sep 21 19:26:12.875: INFO: Pod "pod-subpath-test-dynamicpv-h5ks": Phase="Pending", Reason="", readiness=false. Elapsed: 6.411732596s
Sep 21 19:26:14.979: INFO: Pod "pod-subpath-test-dynamicpv-h5ks": Phase="Pending", Reason="", readiness=false. Elapsed: 8.515730157s
Sep 21 19:26:17.084: INFO: Pod "pod-subpath-test-dynamicpv-h5ks": Phase="Pending", Reason="", readiness=false. Elapsed: 10.620845727s
Sep 21 19:26:19.187: INFO: Pod "pod-subpath-test-dynamicpv-h5ks": Phase="Pending", Reason="", readiness=false. Elapsed: 12.7239999s
Sep 21 19:26:21.290: INFO: Pod "pod-subpath-test-dynamicpv-h5ks": Phase="Pending", Reason="", readiness=false. Elapsed: 14.826844653s
Sep 21 19:26:23.394: INFO: Pod "pod-subpath-test-dynamicpv-h5ks": Phase="Pending", Reason="", readiness=false. Elapsed: 16.930571663s
Sep 21 19:26:25.498: INFO: Pod "pod-subpath-test-dynamicpv-h5ks": Phase="Succeeded", Reason="", readiness=false. Elapsed: 19.035072852s
STEP: Saw pod success
Sep 21 19:26:25.498: INFO: Pod "pod-subpath-test-dynamicpv-h5ks" satisfied condition "Succeeded or Failed"
Sep 21 19:26:25.601: INFO: Trying to get logs from node ip-172-20-63-142.eu-west-3.compute.internal pod pod-subpath-test-dynamicpv-h5ks container test-container-subpath-dynamicpv-h5ks: <nil>
STEP: delete the pod
Sep 21 19:26:25.812: INFO: Waiting for pod pod-subpath-test-dynamicpv-h5ks to disappear
Sep 21 19:26:25.915: INFO: Pod pod-subpath-test-dynamicpv-h5ks no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-h5ks
Sep 21 19:26:25.915: INFO: Deleting pod "pod-subpath-test-dynamicpv-h5ks" in namespace "provisioning-6646"
... skipping 21 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support existing single file [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]","total":-1,"completed":9,"skipped":40,"failed":0}

S
------------------------------
[BeforeEach] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 7 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:26:48.525: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "custom-resource-definition-4424" for this suite.

•
------------------------------
{"msg":"PASSED [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition getting/updating/patching custom resource definition status sub-resource works  [Conformance]","total":-1,"completed":10,"skipped":41,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 21 19:26:48.781: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 47 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: local][LocalVolumeType: tmpfs]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (immediate binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Driver local doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
... skipping 75 lines ...
Sep 21 19:26:32.714: INFO: Waiting for pod aws-client to disappear
Sep 21 19:26:32.821: INFO: Pod aws-client no longer exists
STEP: cleaning the environment after aws
STEP: Deleting pv and pvc
Sep 21 19:26:32.821: INFO: Deleting PersistentVolumeClaim "pvc-zhkpp"
Sep 21 19:26:32.927: INFO: Deleting PersistentVolume "aws-kxj2b"
Sep 21 19:26:33.610: INFO: Couldn't delete PD "aws://eu-west-3a/vol-0498dd89cbb9f0e6e", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0498dd89cbb9f0e6e is currently attached to i-091b483121e935118
	status code: 400, request id: 4a56dd0a-d67a-4356-b535-0d5773bc4c5b
Sep 21 19:26:39.176: INFO: Couldn't delete PD "aws://eu-west-3a/vol-0498dd89cbb9f0e6e", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0498dd89cbb9f0e6e is currently attached to i-091b483121e935118
	status code: 400, request id: 1d01bd0d-f7d5-4c52-a9f9-a85ff1d5f456
Sep 21 19:26:44.738: INFO: Couldn't delete PD "aws://eu-west-3a/vol-0498dd89cbb9f0e6e", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0498dd89cbb9f0e6e is currently attached to i-091b483121e935118
	status code: 400, request id: 12158a29-e1d4-4ed1-a5ac-2cb8159013cd
Sep 21 19:26:50.316: INFO: Successfully deleted PD "aws://eu-west-3a/vol-0498dd89cbb9f0e6e".
[AfterEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:26:50.316: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-2394" for this suite.
... skipping 69 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:192
    One pod requesting one prebound PVC
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:209
      should be able to mount volume and read from pod1
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:232
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: dir] One pod requesting one prebound PVC should be able to mount volume and read from pod1","total":-1,"completed":9,"skipped":41,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
... skipping 37 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should resize volume when PVC is edited while pod is using it
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:246
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it","total":-1,"completed":5,"skipped":48,"failed":0}

S
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (default fs)] volumes should store data","total":-1,"completed":4,"skipped":43,"failed":0}
[BeforeEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 21 19:26:50.552: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename security-context-test
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:46
[It] should run the container with readonly rootfs when readOnlyRootFilesystem=true [LinuxOnly] [NodeConformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:217
Sep 21 19:26:51.187: INFO: Waiting up to 5m0s for pod "busybox-readonly-true-f7173284-5d55-4360-8334-ead855dde550" in namespace "security-context-test-8847" to be "Succeeded or Failed"
Sep 21 19:26:51.292: INFO: Pod "busybox-readonly-true-f7173284-5d55-4360-8334-ead855dde550": Phase="Pending", Reason="", readiness=false. Elapsed: 104.653908ms
Sep 21 19:26:53.399: INFO: Pod "busybox-readonly-true-f7173284-5d55-4360-8334-ead855dde550": Phase="Failed", Reason="", readiness=false. Elapsed: 2.21228282s
Sep 21 19:26:53.399: INFO: Pod "busybox-readonly-true-f7173284-5d55-4360-8334-ead855dde550" satisfied condition "Succeeded or Failed"
[AfterEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 21 19:26:53.399: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "security-context-test-8847" for this suite.

•
... skipping 8 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:241
[It] should check if cluster-info dump succeeds
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1078
STEP: running cluster-info dump
Sep 21 19:26:49.337: INFO: Running '/tmp/kubectl2224172770/kubectl --server=https://api.e2e-0143302838-62691.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-1089 cluster-info dump'
Sep 21 19:26:54.127: INFO: stderr: ""
Sep 21 19:26:54.129: INFO: stdout: "{\n    \"kind\": \"NodeList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"8566\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-35-229.eu-west-3.compute.internal\",\n                \"uid\": \"dfa4ce74-e542-40ac-b12e-3b6358a68cb3\",\n                \"resourceVersion\": \"8470\",\n                \"creationTimestamp\": \"2021-09-21T19:20:15Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"eu-west-3\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"eu-west-3a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-eu-west-3a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-35-229.eu-west-3.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"node\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"topology.kubernetes.io/region\": \"eu-west-3\",\n                    \"topology.kubernetes.io/zone\": \"eu-west-3a\"\n                },\n                \"annotations\": {\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.3.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.3.0/24\"\n                ],\n                \"providerID\": \"aws:///eu-west-3a/i-0b23ccf9b0c1ad58b\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"46343520Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3966256Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"42710187962\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3863856Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:26:46Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:20:15Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:26:46Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:20:15Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:26:46Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:20:15Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:26:46Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:20:25Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.35.229\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"35.180.166.34\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-35-229.eu-west-3.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-35-229.eu-west-3.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-35-180-166-34.eu-west-3.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec22b8a86eb0e120d132ce4b327dabb5\",\n                    \"systemUUID\": \"ec22b8a8-6eb0-e120-d132-ce4b327dabb5\",\n                    \"bootID\": \"a8a4aa48-92e1-4d9d-92eb-63b666d3c967\",\n                    \"kernelVersion\": \"5.10.61-flatcar\",\n                    \"osImage\": \"Flatcar Container Linux by Kinvolk 2905.2.3 (Oklo)\",\n                    \"containerRuntimeVersion\": \"containerd://1.5.4\",\n                    \"kubeletVersion\": \"v1.21.5\",\n                    \"kubeProxyVersion\": \"v1.21.5\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89\",\n                            \"k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4\"\n                        ],\n                        \"sizeBytes\": 112029652\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 105352393\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1\",\n                            \"k8s.gcr.io/e2e-test-images/agnhost:2.32\"\n                        ],\n                        \"sizeBytes\": 50002177\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0\",\n                            \"k8s.gcr.io/e2e-test-images/httpd:2.4.39-1\"\n                        ],\n                        \"sizeBytes\": 41902332\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50\",\n                            \"k8s.gcr.io/e2e-test-images/httpd:2.4.38-1\"\n                        ],\n                        \"sizeBytes\": 40765006\n                    },\n                    {\n                        \"names\": [\n                            \"docker.io/kopeio/networking-agent@sha256:2d16bdbc3257c42cdc59b05b8fad86653033f19cfafa709f263e93c8f7002932\",\n                            \"docker.io/kopeio/networking-agent:1.0.20181028\"\n                        ],\n                        \"sizeBytes\": 25781346\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 21205045\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab\",\n                            \"k8s.gcr.io/sig-storage/csi-attacher:v2.2.0\"\n                        ],\n                        \"sizeBytes\": 18451536\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 9068367\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793\",\n                            \"k8s.gcr.io/sig-storage/mock-driver:v4.1.0\"\n                        ],\n                        \"sizeBytes\": 8223849\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b\",\n                            \"k8s.gcr.io/e2e-test-images/nginx:1.14-1\"\n                        ],\n                        \"sizeBytes\": 6979365\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac\",\n                            \"k8s.gcr.io/e2e-test-images/nonewprivs:1.3\"\n                        ],\n                        \"sizeBytes\": 3263463\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592\",\n                            \"k8s.gcr.io/e2e-test-images/busybox:1.29-1\"\n                        ],\n                        \"sizeBytes\": 732746\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07\",\n                            \"k8s.gcr.io/pause:3.5\"\n                        ],\n                        \"sizeBytes\": 301416\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:6c3835cab3980f11b83277305d0d736051c32b17606f5ec59f1dda67c9ba3810\",\n                            \"k8s.gcr.io/pause:3.4.1\"\n                        ],\n                        \"sizeBytes\": 301268\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-53-119.eu-west-3.compute.internal\",\n                \"uid\": \"39a653bb-7f20-4ce8-a4f7-dc2df949e352\",\n                \"resourceVersion\": \"8445\",\n                \"creationTimestamp\": \"2021-09-21T19:20:14Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"eu-west-3\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"eu-west-3a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-eu-west-3a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-53-119.eu-west-3.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"node\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"topology.hostpath.csi/node\": \"ip-172-20-53-119.eu-west-3.compute.internal\",\n                    \"topology.kubernetes.io/region\": \"eu-west-3\",\n                    \"topology.kubernetes.io/zone\": \"eu-west-3a\"\n                },\n                \"annotations\": {\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.2.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.2.0/24\"\n                ],\n                \"providerID\": \"aws:///eu-west-3a/i-02fa29412e2c73e02\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"46343520Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3966264Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"42710187962\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3863864Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:26:46Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:20:14Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:26:46Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:20:14Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:26:46Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:20:14Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:26:46Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:20:24Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.53.119\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"35.180.193.1\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-53-119.eu-west-3.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-53-119.eu-west-3.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-35-180-193-1.eu-west-3.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec21e111167dce2062573743aad158e7\",\n                    \"systemUUID\": \"ec21e111-167d-ce20-6257-3743aad158e7\",\n                    \"bootID\": \"e8ac24df-63e9-41be-aeae-fef0ea03a0e8\",\n                    \"kernelVersion\": \"5.10.61-flatcar\",\n                    \"osImage\": \"Flatcar Container Linux by Kinvolk 2905.2.3 (Oklo)\",\n                    \"containerRuntimeVersion\": \"containerd://1.5.4\",\n                    \"kubeletVersion\": \"v1.21.5\",\n                    \"kubeProxyVersion\": \"v1.21.5\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 105352393\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/volume/nfs@sha256:124a375b4f930627c65b2f84c0d0f09229a96bc527eec18ad0eeac150b96d1c2\",\n                            \"k8s.gcr.io/e2e-test-images/volume/nfs:1.2\"\n                        ],\n                        \"sizeBytes\": 95843946\n                    },\n                    {\n                        \"names\": [\n                            \"docker.io/library/nginx@sha256:853b221d3341add7aaadf5f81dd088ea943ab9c918766e295321294b035f3f3e\",\n                            \"docker.io/library/nginx:latest\"\n                        ],\n                        \"sizeBytes\": 53799391\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1\",\n                            \"k8s.gcr.io/e2e-test-images/agnhost:2.32\"\n                        ],\n                        \"sizeBytes\": 50002177\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nautilus@sha256:1f36a24cfb5e0c3f725d7565a867c2384282fcbeccc77b07b423c9da95763a9a\",\n                            \"k8s.gcr.io/e2e-test-images/nautilus:1.4\"\n                        ],\n                        \"sizeBytes\": 49230179\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50\",\n                            \"k8s.gcr.io/e2e-test-images/httpd:2.4.38-1\"\n                        ],\n                        \"sizeBytes\": 40765006\n                    },\n                    {\n                        \"names\": [\n                            \"docker.io/kopeio/networking-agent@sha256:2d16bdbc3257c42cdc59b05b8fad86653033f19cfafa709f263e93c8f7002932\",\n                            \"docker.io/kopeio/networking-agent:1.0.20181028\"\n                        ],\n                        \"sizeBytes\": 25781346\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:695505fcfcc69f1cf35665dce487aad447adbb9af69b796d6437f869015d1157\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v2.1.1\"\n                        ],\n                        \"sizeBytes\": 21212251\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter@sha256:51f2dfde5bccac7854b3704689506aeecfb793328427b91115ba253a93e60782\",\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter:v4.0.0\"\n                        ],\n                        \"sizeBytes\": 20194320\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09\",\n                            \"k8s.gcr.io/sig-storage/csi-attacher:v3.1.0\"\n                        ],\n                        \"sizeBytes\": 20103959\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a\",\n                            \"k8s.gcr.io/sig-storage/csi-resizer:v1.1.0\"\n                        ],\n                        \"sizeBytes\": 20096832\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5\",\n                            \"k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0\"\n                        ],\n                        \"sizeBytes\": 13995876\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1\"\n                        ],\n                        \"sizeBytes\": 8415088\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/livenessprobe@sha256:48da0e4ed7238ad461ea05f68c25921783c37b315f21a5c5a2780157a6460994\",\n                            \"k8s.gcr.io/sig-storage/livenessprobe:v2.2.0\"\n                        ],\n                        \"sizeBytes\": 8279778\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b\",\n                            \"k8s.gcr.io/e2e-test-images/nginx:1.14-1\"\n                        ],\n                        \"sizeBytes\": 6979365\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592\",\n                            \"k8s.gcr.io/e2e-test-images/busybox:1.29-1\"\n                        ],\n                        \"sizeBytes\": 732746\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07\",\n                            \"k8s.gcr.io/pause:3.5\"\n                        ],\n                        \"sizeBytes\": 301416\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:6c3835cab3980f11b83277305d0d736051c32b17606f5ec59f1dda67c9ba3810\",\n                            \"k8s.gcr.io/pause:3.4.1\"\n                        ],\n                        \"sizeBytes\": 301268\n                    }\n                ],\n                \"volumesInUse\": [\n                    \"kubernetes.io/aws-ebs/aws://eu-west-3a/vol-0510da07bf21239b8\",\n                    \"kubernetes.io/aws-ebs/aws://eu-west-3a/vol-07ca30d77489cfdae\"\n                ],\n                \"volumesAttached\": [\n                    {\n                        \"name\": \"kubernetes.io/aws-ebs/aws://eu-west-3a/vol-07ca30d77489cfdae\",\n                        \"devicePath\": \"/dev/xvdcp\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"07dcb71a-5c94-4636-82b2-7776773cf542\",\n                \"resourceVersion\": \"4203\",\n                \"creationTimestamp\": \"2021-09-21T19:18:41Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"c5.large\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"eu-west-3\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"eu-west-3a\",\n                    \"kops.k8s.io/instancegroup\": \"master-eu-west-3a\",\n                    \"kops.k8s.io/kops-controller-pki\": \"\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-62-185.eu-west-3.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"master\",\n                    \"node-role.kubernetes.io/control-plane\": \"\",\n                    \"node-role.kubernetes.io/master\": \"\",\n                    \"node.kubernetes.io/exclude-from-external-load-balancers\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"c5.large\",\n                    \"topology.kubernetes.io/region\": \"eu-west-3\",\n                    \"topology.kubernetes.io/zone\": \"eu-west-3a\"\n                },\n                \"annotations\": {\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.0.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.0.0/24\"\n                ],\n                \"providerID\": \"aws:///eu-west-3a/i-0eed6b41e0e97a1c5\",\n                \"taints\": [\n                    {\n                        \"key\": \"node-role.kubernetes.io/master\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ]\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"46343520Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3781948Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"42710187962\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3679548Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:24:32Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:18:33Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:24:32Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:18:33Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:24:32Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:18:33Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:24:32Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:18:54Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.62.185\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"35.180.65.195\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-35-180-65-195.eu-west-3.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec254358d1d553fc2b62f3d33bdd8b18\",\n                    \"systemUUID\": \"ec254358-d1d5-53fc-2b62-f3d33bdd8b18\",\n                    \"bootID\": \"36122a89-4382-40db-9e23-c15098d3485c\",\n                    \"kernelVersion\": \"5.10.61-flatcar\",\n                    \"osImage\": \"Flatcar Container Linux by Kinvolk 2905.2.3 (Oklo)\",\n                    \"containerRuntimeVersion\": \"containerd://1.5.4\",\n                    \"kubeletVersion\": \"v1.21.5\",\n                    \"kubeProxyVersion\": \"v1.21.5\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/etcdadm/etcd-manager@sha256:ebb73d3d4a99da609f9e01c556cd9f9aa7a0aecba8f5bc5588d7c45eb38e3a7e\",\n                            \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\"\n                        ],\n                        \"sizeBytes\": 171082409\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-apiserver-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 127101402\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-controller-manager-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 121137987\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kops/dns-controller:1.21.1\"\n                        ],\n                        \"sizeBytes\": 113860118\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kops/kops-controller:1.21.1\"\n                        ],\n                        \"sizeBytes\": 112068119\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 105352393\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-scheduler-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 52099384\n                    },\n                    {\n                        \"names\": [\n                            \"docker.io/kopeio/networking-agent@sha256:2d16bdbc3257c42cdc59b05b8fad86653033f19cfafa709f263e93c8f7002932\",\n                            \"docker.io/kopeio/networking-agent:1.0.20181028\"\n                        ],\n                        \"sizeBytes\": 25781346\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kops/kube-apiserver-healthcheck:1.21.1\"\n                        ],\n                        \"sizeBytes\": 25622039\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07\",\n                            \"k8s.gcr.io/pause:3.5\"\n                        ],\n                        \"sizeBytes\": 301416\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-63-142.eu-west-3.compute.internal\",\n                \"uid\": \"7a06a2f4-9679-424c-8a1d-da9d651eabfc\",\n                \"resourceVersion\": \"8139\",\n                \"creationTimestamp\": \"2021-09-21T19:20:24Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"eu-west-3\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"eu-west-3a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-eu-west-3a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-63-142.eu-west-3.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"node\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"topology.kubernetes.io/region\": \"eu-west-3\",\n                    \"topology.kubernetes.io/zone\": \"eu-west-3a\"\n                },\n                \"annotations\": {\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.4.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.4.0/24\"\n                ],\n                \"providerID\": \"aws:///eu-west-3a/i-091b483121e935118\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"46343520Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3966264Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"42710187962\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3863864Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:26:35Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:20:24Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:26:35Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:20:24Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:26:35Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:20:24Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:26:35Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:20:34Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.63.142\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"15.237.72.135\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-63-142.eu-west-3.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-63-142.eu-west-3.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-15-237-72-135.eu-west-3.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec248226b57efd3348e1a275a4a8f953\",\n                    \"systemUUID\": \"ec248226-b57e-fd33-48e1-a275a4a8f953\",\n                    \"bootID\": \"45985230-bef4-4c96-b0c7-fb9a15162a35\",\n                    \"kernelVersion\": \"5.10.61-flatcar\",\n                    \"osImage\": \"Flatcar Container Linux by Kinvolk 2905.2.3 (Oklo)\",\n                    \"containerRuntimeVersion\": \"containerd://1.5.4\",\n                    \"kubeletVersion\": \"v1.21.5\",\n                    \"kubeProxyVersion\": \"v1.21.5\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 105352393\n                    },\n                    {\n                        \"names\": [\n                            \"docker.io/library/nginx@sha256:853b221d3341add7aaadf5f81dd088ea943ab9c918766e295321294b035f3f3e\",\n                            \"docker.io/library/nginx:latest\"\n                        ],\n                        \"sizeBytes\": 53799391\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1\",\n                            \"k8s.gcr.io/e2e-test-images/agnhost:2.32\"\n                        ],\n                        \"sizeBytes\": 50002177\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nautilus@sha256:1f36a24cfb5e0c3f725d7565a867c2384282fcbeccc77b07b423c9da95763a9a\",\n                            \"k8s.gcr.io/e2e-test-images/nautilus:1.4\"\n                        ],\n                        \"sizeBytes\": 49230179\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50\",\n                            \"k8s.gcr.io/e2e-test-images/httpd:2.4.38-1\"\n                        ],\n                        \"sizeBytes\": 40765006\n                    },\n                    {\n                        \"names\": [\n                            \"docker.io/kopeio/networking-agent@sha256:2d16bdbc3257c42cdc59b05b8fad86653033f19cfafa709f263e93c8f7002932\",\n                            \"docker.io/kopeio/networking-agent:1.0.20181028\"\n                        ],\n                        \"sizeBytes\": 25781346\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b\",\n                            \"k8s.gcr.io/e2e-test-images/nginx:1.14-1\"\n                        ],\n                        \"sizeBytes\": 6979365\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592\",\n                            \"k8s.gcr.io/e2e-test-images/busybox:1.29-1\"\n                        ],\n                        \"sizeBytes\": 732746\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07\",\n                            \"k8s.gcr.io/pause:3.5\"\n                        ],\n                        \"sizeBytes\": 301416\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:6c3835cab3980f11b83277305d0d736051c32b17606f5ec59f1dda67c9ba3810\",\n                            \"k8s.gcr.io/pause:3.4.1\"\n                        ],\n                        \"sizeBytes\": 301268\n                    }\n                ],\n                \"volumesInUse\": [\n                    \"kubernetes.io/aws-ebs/aws://eu-west-3a/vol-0cbbdde947bbeadf6\"\n                ],\n                \"volumesAttached\": [\n                    {\n                        \"name\": \"kubernetes.io/aws-ebs/aws://eu-west-3a/vol-0cbbdde947bbeadf6\",\n                        \"devicePath\": \"/dev/xvdbv\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-63-30.eu-west-3.compute.internal\",\n                \"uid\": \"21374694-2e93-4ccc-bfef-5868d0d7cc5e\",\n                \"resourceVersion\": \"8148\",\n                \"creationTimestamp\": \"2021-09-21T19:20:04Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"eu-west-3\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"eu-west-3a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-eu-west-3a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-63-30.eu-west-3.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"node\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"topology.hostpath.csi/node\": \"ip-172-20-63-30.eu-west-3.compute.internal\",\n                    \"topology.kubernetes.io/region\": \"eu-west-3\",\n                    \"topology.kubernetes.io/zone\": \"eu-west-3a\"\n                },\n                \"annotations\": {\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.1.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.1.0/24\"\n                ],\n                \"providerID\": \"aws:///eu-west-3a/i-0bfee6db9752003bb\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"46343520Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3966256Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"42710187962\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3863856Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:26:15Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:20:03Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:26:15Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:20:03Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:26:15Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:20:03Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-09-21T19:26:15Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:20:04Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.63.30\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"52.47.131.46\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-52-47-131-46.eu-west-3.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec2725bbf80a295f862b4c5c17dcf344\",\n                    \"systemUUID\": \"ec2725bb-f80a-295f-862b-4c5c17dcf344\",\n                    \"bootID\": \"d6119fcd-5ba3-45e2-a2b6-0146cecb989d\",\n                    \"kernelVersion\": \"5.10.61-flatcar\",\n                    \"osImage\": \"Flatcar Container Linux by Kinvolk 2905.2.3 (Oklo)\",\n                    \"containerRuntimeVersion\": \"containerd://1.5.4\",\n                    \"kubeletVersion\": \"v1.21.5\",\n                    \"kubeProxyVersion\": \"v1.21.5\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 105352393\n                    },\n                    {\n                        \"names\": [\n                            \"docker.io/library/nginx@sha256:853b221d3341add7aaadf5f81dd088ea943ab9c918766e295321294b035f3f3e\",\n                            \"docker.io/library/nginx:latest\"\n                        ],\n                        \"sizeBytes\": 53799391\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1\",\n                            \"k8s.gcr.io/e2e-test-images/agnhost:2.32\"\n                        ],\n                        \"sizeBytes\": 50002177\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50\",\n                            \"k8s.gcr.io/e2e-test-images/httpd:2.4.38-1\"\n                        ],\n                        \"sizeBytes\": 40765006\n                    },\n                    {\n                        \"names\": [\n                            \"docker.io/kopeio/networking-agent@sha256:2d16bdbc3257c42cdc59b05b8fad86653033f19cfafa709f263e93c8f7002932\",\n                            \"docker.io/kopeio/networking-agent:1.0.20181028\"\n                        ],\n                        \"sizeBytes\": 25781346\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:695505fcfcc69f1cf35665dce487aad447adbb9af69b796d6437f869015d1157\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v2.1.1\"\n                        ],\n                        \"sizeBytes\": 21212251\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 21205045\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter@sha256:51f2dfde5bccac7854b3704689506aeecfb793328427b91115ba253a93e60782\",\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter:v4.0.0\"\n                        ],\n                        \"sizeBytes\": 20194320\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09\",\n                            \"k8s.gcr.io/sig-storage/csi-attacher:v3.1.0\"\n                        ],\n                        \"sizeBytes\": 20103959\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a\",\n                            \"k8s.gcr.io/sig-storage/csi-resizer:v1.1.0\"\n                        ],\n                        \"sizeBytes\": 20096832\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf\",\n                            \"k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2\"\n                        ],\n                        \"sizeBytes\": 18651485\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab\",\n                            \"k8s.gcr.io/sig-storage/csi-attacher:v2.2.0\"\n                        ],\n                        \"sizeBytes\": 18451536\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nonroot@sha256:4051e85640c22f8e00c34dbd273576fc9e1e2829992656588062be9c0f69b04b\",\n                            \"k8s.gcr.io/e2e-test-images/nonroot:1.1\"\n                        ],\n                        \"sizeBytes\": 17748448\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def\",\n                            \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\"\n                        ],\n                        \"sizeBytes\": 15209393\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5\",\n                            \"k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0\"\n                        ],\n                        \"sizeBytes\": 13995876\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/coredns/coredns@sha256:6e5a02c21641597998b4be7cb5eb1e7b02c0d8d23cce4dd09f4682d463798890\",\n                            \"k8s.gcr.io/coredns/coredns:v1.8.4\"\n                        ],\n                        \"sizeBytes\": 13707249\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 9068367\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1\"\n                        ],\n                        \"sizeBytes\": 8415088\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/livenessprobe@sha256:48da0e4ed7238ad461ea05f68c25921783c37b315f21a5c5a2780157a6460994\",\n                            \"k8s.gcr.io/sig-storage/livenessprobe:v2.2.0\"\n                        ],\n                        \"sizeBytes\": 8279778\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793\",\n                            \"k8s.gcr.io/sig-storage/mock-driver:v4.1.0\"\n                        ],\n                        \"sizeBytes\": 8223849\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b\",\n                            \"k8s.gcr.io/e2e-test-images/nginx:1.14-1\"\n                        ],\n                        \"sizeBytes\": 6979365\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592\",\n                            \"k8s.gcr.io/e2e-test-images/busybox:1.29-1\"\n                        ],\n                        \"sizeBytes\": 732746\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07\",\n                            \"k8s.gcr.io/pause:3.5\"\n                        ],\n                        \"sizeBytes\": 301416\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:6c3835cab3980f11b83277305d0d736051c32b17606f5ec59f1dda67c9ba3810\",\n                            \"k8s.gcr.io/pause:3.4.1\"\n                        ],\n                        \"sizeBytes\": 301268\n                    }\n                ],\n                \"volumesInUse\": [\n                    \"kubernetes.io/aws-ebs/aws://eu-west-3a/vol-0a0f4be713fc80b94\"\n                ],\n                \"volumesAttached\": [\n                    {\n                        \"name\": \"kubernetes.io/aws-ebs/aws://eu-west-3a/vol-0a0f4be713fc80b94\",\n                        \"devicePath\": \"/dev/xvdbf\"\n                    }\n                ]\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"EventList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"3814\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-klq65.16a6ec7d694e8df3\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8414f377-107c-4cd9-8bcd-47cfbb298d1b\",\n                \"resourceVersion\": \"73\",\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-klq65\",\n                \"uid\": \"b5b3bfe9-520d-4482-bef7-ffb50835171e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"434\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/1 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:02Z\",\n            \"count\": 3,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-klq65.16a6ec8cc56ad1a8\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fb768991-6ace-47dc-95c6-ee1068cefbda\",\n                \"resourceVersion\": \"78\",\n                \"creationTimestamp\": \"2021-09-21T19:20:04Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-klq65\",\n                \"uid\": \"b5b3bfe9-520d-4482-bef7-ffb50835171e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"444\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/2 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate, 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:04Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:04Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-klq65.16a6ec8ea65a1663\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"cbe388e8-8c93-4d07-ab0d-12b4bf8a7462\",\n                \"resourceVersion\": \"105\",\n                \"creationTimestamp\": \"2021-09-21T19:20:12Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-klq65\",\n                \"uid\": \"b5b3bfe9-520d-4482-bef7-ffb50835171e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"622\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/coredns-5dc785954d-klq65 to ip-172-20-63-30.eu-west-3.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:12Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:12Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-klq65.16a6ec8ecf5489e9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"dd41de13-77f2-4b23-b073-207e2a9ac1e7\",\n                \"resourceVersion\": \"121\",\n                \"creationTimestamp\": \"2021-09-21T19:20:14Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-klq65\",\n                \"uid\": \"b5b3bfe9-520d-4482-bef7-ffb50835171e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"654\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/coredns/coredns:v1.8.4\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:13Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:13Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-klq65.16a6ec8f92c82444\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c140ea2f-7faf-4f91-895f-12af5658320b\",\n                \"resourceVersion\": \"131\",\n                \"creationTimestamp\": \"2021-09-21T19:20:16Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-klq65\",\n                \"uid\": \"b5b3bfe9-520d-4482-bef7-ffb50835171e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"654\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/coredns/coredns:v1.8.4\\\" in 3.27912101s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:16Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:16Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-klq65.16a6ec8f99267aa0\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c0ebbc39-5de4-4678-a952-5a74b3ccbad1\",\n                \"resourceVersion\": \"132\",\n                \"creationTimestamp\": \"2021-09-21T19:20:16Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-klq65\",\n                \"uid\": \"b5b3bfe9-520d-4482-bef7-ffb50835171e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"654\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:16Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:16Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-klq65.16a6ec8f9da3d81a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d3b94670-7c1d-44f8-9197-ba8ee7bb2eff\",\n                \"resourceVersion\": \"133\",\n                \"creationTimestamp\": \"2021-09-21T19:20:16Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-klq65\",\n                \"uid\": \"b5b3bfe9-520d-4482-bef7-ffb50835171e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"654\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:16Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:16Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-klq65.16a6ec8fa416ff4c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"02bc60fe-4494-4b00-8da4-c8d97032fa3f\",\n                \"resourceVersion\": \"136\",\n                \"creationTimestamp\": \"2021-09-21T19:20:16Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-klq65\",\n                \"uid\": \"b5b3bfe9-520d-4482-bef7-ffb50835171e\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"654\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Unhealthy\",\n            \"message\": \"Readiness probe failed: HTTP probe failed with statuscode: 503\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:16Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:16Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-kzbt7.16a6ec8f502299a2\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"55582c4c-9bba-4727-9f31-6da7e6818c38\",\n                \"resourceVersion\": \"127\",\n                \"creationTimestamp\": \"2021-09-21T19:20:15Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-kzbt7\",\n                \"uid\": \"4e33cecf-2a67-4400-8bd6-9ecf3a3693b8\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"682\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/coredns-5dc785954d-kzbt7 to ip-172-20-63-30.eu-west-3.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:15Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:15Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-kzbt7.16a6ec8f718ba9d2\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"89785d9d-961c-4d1a-bc28-ecb1050fbf21\",\n                \"resourceVersion\": \"130\",\n                \"creationTimestamp\": \"2021-09-21T19:20:15Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-kzbt7\",\n                \"uid\": \"4e33cecf-2a67-4400-8bd6-9ecf3a3693b8\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"689\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/coredns/coredns:v1.8.4\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:15Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:15Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-kzbt7.16a6ec8f9f2acd36\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"035de5d0-be22-4852-b99f-95edb72d628d\",\n                \"resourceVersion\": \"134\",\n                \"creationTimestamp\": \"2021-09-21T19:20:16Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-kzbt7\",\n                \"uid\": \"4e33cecf-2a67-4400-8bd6-9ecf3a3693b8\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"689\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/coredns/coredns:v1.8.4\\\" in 765.377859ms\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:16Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:16Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-kzbt7.16a6ec8fa1b52665\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c685a1af-7535-4c3b-b4f2-3af620b22df2\",\n                \"resourceVersion\": \"135\",\n                \"creationTimestamp\": \"2021-09-21T19:20:16Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-kzbt7\",\n                \"uid\": \"4e33cecf-2a67-4400-8bd6-9ecf3a3693b8\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"689\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:16Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:16Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-kzbt7.16a6ec8fa7a3bdc1\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"37302f03-4a04-4572-bddb-152c84b94a25\",\n                \"resourceVersion\": \"137\",\n                \"creationTimestamp\": \"2021-09-21T19:20:17Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-kzbt7\",\n                \"uid\": \"4e33cecf-2a67-4400-8bd6-9ecf3a3693b8\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"689\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:16Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:16Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d.16a6ec7d6a016a8f\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5a4c6744-7b42-45e2-aa74-da0639c57379\",\n                \"resourceVersion\": \"57\",\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d\",\n                \"uid\": \"1c9ad417-a5f6-4fcb-8360-a70ee4ebc3d7\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"416\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: coredns-5dc785954d-klq65\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d.16a6ec8f4f412a8a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"466b0cab-36ab-4c0f-aeae-bfa617c09322\",\n                \"resourceVersion\": \"125\",\n                \"creationTimestamp\": \"2021-09-21T19:20:15Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d\",\n                \"uid\": \"1c9ad417-a5f6-4fcb-8360-a70ee4ebc3d7\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"677\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: coredns-5dc785954d-kzbt7\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:15Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:15Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-qxhbx.16a6ec7d6b5e3ba7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4421c389-4baa-4959-b83e-6908fda2c6c0\",\n                \"resourceVersion\": \"74\",\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-qxhbx\",\n                \"uid\": \"125b07b4-d846-4d6f-a627-0f12390f3ee1\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"436\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/1 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:02Z\",\n            \"count\": 3,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-qxhbx.16a6ec8cc6291713\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"88a82e39-0693-4150-9388-10236c9fa5af\",\n                \"resourceVersion\": \"79\",\n                \"creationTimestamp\": \"2021-09-21T19:20:04Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-qxhbx\",\n                \"uid\": \"125b07b4-d846-4d6f-a627-0f12390f3ee1\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"447\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/2 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate, 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:04Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:04Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-qxhbx.16a6ec8ea6b122f5\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9b3ac9f1-bf68-43d1-9a66-ccaef0386db9\",\n                \"resourceVersion\": \"106\",\n                \"creationTimestamp\": \"2021-09-21T19:20:12Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-qxhbx\",\n                \"uid\": \"125b07b4-d846-4d6f-a627-0f12390f3ee1\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"624\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/coredns-autoscaler-84d4cfd89c-qxhbx to ip-172-20-63-30.eu-west-3.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:12Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:12Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-qxhbx.16a6ec8ecf1acd72\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2339f7f0-43a7-4b9e-bc8b-edb55dad45c9\",\n                \"resourceVersion\": \"119\",\n                \"creationTimestamp\": \"2021-09-21T19:20:14Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-qxhbx\",\n                \"uid\": \"125b07b4-d846-4d6f-a627-0f12390f3ee1\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"655\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:13Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:13Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-qxhbx.16a6ec8f329e496d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"0f129657-322b-4e18-95b1-109b3865ef2b\",\n                \"resourceVersion\": \"122\",\n                \"creationTimestamp\": \"2021-09-21T19:20:15Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-qxhbx\",\n                \"uid\": \"125b07b4-d846-4d6f-a627-0f12390f3ee1\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"655\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\\\" in 1.669528577s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:14Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:14Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-qxhbx.16a6ec8f38f11e8b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c29c906e-ae80-47b8-a54a-b846d9bab8c8\",\n                \"resourceVersion\": \"128\",\n                \"creationTimestamp\": \"2021-09-21T19:20:15Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-qxhbx\",\n                \"uid\": \"125b07b4-d846-4d6f-a627-0f12390f3ee1\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"655\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container autoscaler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:14Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:14Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-qxhbx.16a6ec8f3d8e123a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b50ddca8-3967-4481-9b45-22723b1881fe\",\n                \"resourceVersion\": \"129\",\n                \"creationTimestamp\": \"2021-09-21T19:20:15Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-qxhbx\",\n                \"uid\": \"125b07b4-d846-4d6f-a627-0f12390f3ee1\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"655\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container autoscaler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:14Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:14Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c.16a6ec7d6a058cbe\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3bed71b3-f6ae-44c1-87fb-f09ea542b211\",\n                \"resourceVersion\": \"58\",\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c\",\n                \"uid\": \"10d2bdb4-2e85-442a-904b-4d6b013066ee\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"417\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: coredns-autoscaler-84d4cfd89c-qxhbx\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler.16a6ec7d5e70d5e4\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"90acdff7-79a3-4a90-8ae2-b35be43b41db\",\n                \"resourceVersion\": \"50\",\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler\",\n                \"uid\": \"9096fe29-0a44-4c9c-916b-0690235a7c09\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"304\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set coredns-autoscaler-84d4cfd89c to 1\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns.16a6ec7d5e0dde52\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7da12695-b9e4-4b60-b9e8-d327d9a26b07\",\n                \"resourceVersion\": \"48\",\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns\",\n                \"uid\": \"8285b56d-5e5e-4602-970b-2c8b83b4976d\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"295\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set coredns-5dc785954d to 1\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns.16a6ec8f4da35d8c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"458728d5-1659-4847-a81f-06753f7ab86c\",\n                \"resourceVersion\": \"123\",\n                \"creationTimestamp\": \"2021-09-21T19:20:15Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns\",\n                \"uid\": \"8285b56d-5e5e-4602-970b-2c8b83b4976d\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"676\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set coredns-5dc785954d to 2\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:15Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:15Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-56b8dc9b5b-lrmhs.16a6ec7d6c2c6712\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f0a32abb-8292-4c27-a3e9-3d0a60114f62\",\n                \"resourceVersion\": \"60\",\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-56b8dc9b5b-lrmhs\",\n                \"uid\": \"a5f7560c-320a-41fd-9f93-9b886e537195\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"435\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/dns-controller-56b8dc9b5b-lrmhs to ip-172-20-62-185.eu-west-3.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-56b8dc9b5b-lrmhs.16a6ec7dce5ed989\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6b47a75c-d611-41c1-859f-48b8a43ff61c\",\n                \"resourceVersion\": \"63\",\n                \"creationTimestamp\": \"2021-09-21T19:19:00Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-56b8dc9b5b-lrmhs\",\n                \"uid\": \"a5f7560c-320a-41fd-9f93-9b886e537195\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"448\",\n                \"fieldPath\": \"spec.containers{dns-controller}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kops/dns-controller:1.21.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:00Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:00Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-56b8dc9b5b-lrmhs.16a6ec7dd100c81b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e734deaa-52fc-46ba-9cf8-45d717d56cd4\",\n                \"resourceVersion\": \"64\",\n                \"creationTimestamp\": \"2021-09-21T19:19:00Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-56b8dc9b5b-lrmhs\",\n                \"uid\": \"a5f7560c-320a-41fd-9f93-9b886e537195\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"448\",\n                \"fieldPath\": \"spec.containers{dns-controller}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container dns-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:00Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:00Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-56b8dc9b5b-lrmhs.16a6ec7dd9e56554\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"79ad69d8-477c-4c4d-9d9c-97047402150b\",\n                \"resourceVersion\": \"65\",\n                \"creationTimestamp\": \"2021-09-21T19:19:00Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-56b8dc9b5b-lrmhs\",\n                \"uid\": \"a5f7560c-320a-41fd-9f93-9b886e537195\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"448\",\n                \"fieldPath\": \"spec.containers{dns-controller}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container dns-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:00Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:00Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-56b8dc9b5b.16a6ec7d696d7a9a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"02a24195-5885-4cd9-a8f6-8f3de331dda0\",\n                \"resourceVersion\": \"55\",\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-56b8dc9b5b\",\n                \"uid\": \"a7b8686c-82d6-45be-b614-8fd0fe5c4913\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"418\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: dns-controller-56b8dc9b5b-lrmhs\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller.16a6ec7d5e6b424c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"ac29a7ff-7ced-45da-8c33-138330697de3\",\n                \"resourceVersion\": \"49\",\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller\",\n                \"uid\": \"86d3a739-16b7-41c4-a4d8-12bffb3d49cc\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"224\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set dns-controller-56b8dc9b5b to 1\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec70fe645ef0\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7eac2713-11a2-4675-ba5e-c6a291f6cf7d\",\n                \"resourceVersion\": \"21\",\n                \"creationTimestamp\": \"2021-09-21T19:18:46Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"3f39f5a44154c90f6f8fa3fa40c532e4\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec73374ec4a0\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f7effb89-b653-4631-a2e1-9574e9e2adef\",\n                \"resourceVersion\": \"37\",\n                \"creationTimestamp\": \"2021-09-21T19:18:49Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"3f39f5a44154c90f6f8fa3fa40c532e4\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\\\" in 9.544805274s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:14Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:14Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec733ad2508e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"19fcb6cb-cbcb-42fd-a862-a438ab554a3c\",\n                \"resourceVersion\": \"39\",\n                \"creationTimestamp\": \"2021-09-21T19:18:49Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"3f39f5a44154c90f6f8fa3fa40c532e4\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:14Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:14Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec7341d5c2de\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b02c473c-017d-4128-a79c-b9f0c90de1ca\",\n                \"resourceVersion\": \"41\",\n                \"creationTimestamp\": \"2021-09-21T19:18:50Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"3f39f5a44154c90f6f8fa3fa40c532e4\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:14Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:14Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec70f4eca341\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e96a54e8-6c6b-4aba-8ccb-191daae20644\",\n                \"resourceVersion\": \"19\",\n                \"creationTimestamp\": \"2021-09-21T19:18:45Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"704ebadffc72f97ea52452140c5b4be7\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:04Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec7320587dda\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"43e85e69-ac5b-45c3-83c5-9622628feef1\",\n                \"resourceVersion\": \"36\",\n                \"creationTimestamp\": \"2021-09-21T19:18:49Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"704ebadffc72f97ea52452140c5b4be7\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\\\" in 9.318394643s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:14Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:14Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec73375319bc\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a3d056ad-6f05-4d49-b771-17f9b9b9c593\",\n                \"resourceVersion\": \"38\",\n                \"creationTimestamp\": \"2021-09-21T19:18:49Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"704ebadffc72f97ea52452140c5b4be7\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:14Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:14Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec733fd2f8b9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2cc6b86c-fec0-4be4-ab28-561a1cafa63b\",\n                \"resourceVersion\": \"40\",\n                \"creationTimestamp\": \"2021-09-21T19:18:50Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"704ebadffc72f97ea52452140c5b4be7\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:14Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:14Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-4879k.16a6ec8cc787b8f8\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3d54e96e-146f-4896-9087-496d00b0e109\",\n                \"resourceVersion\": \"81\",\n                \"creationTimestamp\": \"2021-09-21T19:20:04Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-4879k\",\n                \"uid\": \"3e2ddb00-2484-4f10-90da-34f33f43d337\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"625\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kopeio-networking-agent-4879k to ip-172-20-63-30.eu-west-3.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:04Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-4879k.16a6ec8d20c9fa41\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e566d677-ad7f-4ed2-b2ac-9a95c0ed2cc0\",\n                \"resourceVersion\": \"114\",\n                \"creationTimestamp\": \"2021-09-21T19:20:13Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-4879k\",\n                \"uid\": \"3e2ddb00-2484-4f10-90da-34f33f43d337\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"627\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"kopeio/networking-agent:1.0.20181028\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:05Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:05Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-4879k.16a6ec8df1701754\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3056da44-34e1-4173-bedb-bd906f38866a\",\n                \"resourceVersion\": \"115\",\n                \"creationTimestamp\": \"2021-09-21T19:20:14Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-4879k\",\n                \"uid\": \"3e2ddb00-2484-4f10-90da-34f33f43d337\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"627\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"kopeio/networking-agent:1.0.20181028\\\" in 3.500524145s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:09Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-4879k.16a6ec8dfbc415f1\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1aae7c7b-585a-4819-9cd5-77597c66a5e0\",\n                \"resourceVersion\": \"116\",\n                \"creationTimestamp\": \"2021-09-21T19:20:14Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-4879k\",\n                \"uid\": \"3e2ddb00-2484-4f10-90da-34f33f43d337\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"627\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container networking-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:09Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-4879k.16a6ec8e00e5cedc\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3e8f19a8-492a-4081-81fd-c4e1bb1856cd\",\n                \"resourceVersion\": \"117\",\n                \"creationTimestamp\": \"2021-09-21T19:20:14Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-4879k\",\n                \"uid\": \"3e2ddb00-2484-4f10-90da-34f33f43d337\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"627\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container networking-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:09Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-8rzgd.16a6ec8f31f49b9c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"70925583-2348-4b8c-8ae3-fe0ed337ed60\",\n                \"resourceVersion\": \"120\",\n                \"creationTimestamp\": \"2021-09-21T19:20:14Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-8rzgd\",\n                \"uid\": \"6cad91c2-349e-454e-a865-521bfbb5165c\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"667\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kopeio-networking-agent-8rzgd to ip-172-20-53-119.eu-west-3.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:14Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:14Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-8rzgd.16a6ec8f55259daf\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"840959d9-609a-4197-bcc8-916999f80704\",\n                \"resourceVersion\": \"173\",\n                \"creationTimestamp\": \"2021-09-21T19:20:28Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-8rzgd\",\n                \"uid\": \"6cad91c2-349e-454e-a865-521bfbb5165c\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"670\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"kopeio/networking-agent:1.0.20181028\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-53-119.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:15Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:15Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-8rzgd.16a6ec90280bbf11\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"15a631c1-adb3-4aff-9136-11d296c4a98e\",\n                \"resourceVersion\": \"174\",\n                \"creationTimestamp\": \"2021-09-21T19:20:28Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-8rzgd\",\n                \"uid\": \"6cad91c2-349e-454e-a865-521bfbb5165c\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"670\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"kopeio/networking-agent:1.0.20181028\\\" in 3.538280768s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-53-119.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:18Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:18Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-8rzgd.16a6ec9034502649\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c5738a31-954f-4b90-aef8-45f620d4deab\",\n                \"resourceVersion\": \"175\",\n                \"creationTimestamp\": \"2021-09-21T19:20:28Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-8rzgd\",\n                \"uid\": \"6cad91c2-349e-454e-a865-521bfbb5165c\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"670\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container networking-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-53-119.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:19Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:19Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-8rzgd.16a6ec903a5d147a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7a9f64d3-6820-4f07-bfbb-213c82a5d4d9\",\n                \"resourceVersion\": \"177\",\n                \"creationTimestamp\": \"2021-09-21T19:20:28Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-8rzgd\",\n                \"uid\": \"6cad91c2-349e-454e-a865-521bfbb5165c\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"670\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container networking-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-53-119.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:19Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:19Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-jnwrv.16a6ec7d66fd1ef0\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"02ddc5be-191e-4ae0-a737-7829ded9d9df\",\n                \"resourceVersion\": \"54\",\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-jnwrv\",\n                \"uid\": \"1cb22fbe-83ec-44c6-8f8a-cdfe2e427621\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"428\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kopeio-networking-agent-jnwrv to ip-172-20-62-185.eu-west-3.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-jnwrv.16a6ec7db0077fd7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"879ca707-1166-4687-945e-587711556a35\",\n                \"resourceVersion\": \"62\",\n                \"creationTimestamp\": \"2021-09-21T19:18:59Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-jnwrv\",\n                \"uid\": \"1cb22fbe-83ec-44c6-8f8a-cdfe2e427621\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"432\"\n            },\n            \"reason\": \"FailedMount\",\n            \"message\": \"MountVolume.SetUp failed for volume \\\"kube-api-access-887p8\\\" : failed to sync configmap cache: timed out waiting for the condition\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:59Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:59Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-jnwrv.16a6ec7dde94dff4\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d17f309f-4eb3-44e1-8565-9d52da1ff86d\",\n                \"resourceVersion\": \"67\",\n                \"creationTimestamp\": \"2021-09-21T19:19:00Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-jnwrv\",\n                \"uid\": \"1cb22fbe-83ec-44c6-8f8a-cdfe2e427621\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"432\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"kopeio/networking-agent:1.0.20181028\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:00Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:00Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-jnwrv.16a6ec7eaedd6c2b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"657d4d45-5274-40c8-ac0c-8e1cb097b976\",\n                \"resourceVersion\": \"75\",\n                \"creationTimestamp\": \"2021-09-21T19:19:03Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-jnwrv\",\n                \"uid\": \"1cb22fbe-83ec-44c6-8f8a-cdfe2e427621\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"432\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"kopeio/networking-agent:1.0.20181028\\\" in 3.49439668s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:03Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:03Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-jnwrv.16a6ec7eba0bc1c0\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3f9970f7-ea71-450a-854f-a6bc70473b98\",\n                \"resourceVersion\": \"76\",\n                \"creationTimestamp\": \"2021-09-21T19:19:04Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-jnwrv\",\n                \"uid\": \"1cb22fbe-83ec-44c6-8f8a-cdfe2e427621\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"432\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container networking-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:03Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:03Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-jnwrv.16a6ec7ebfff0c65\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"145967ef-d271-445d-9bb2-a490719e5587\",\n                \"resourceVersion\": \"77\",\n                \"creationTimestamp\": \"2021-09-21T19:19:04Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-jnwrv\",\n                \"uid\": \"1cb22fbe-83ec-44c6-8f8a-cdfe2e427621\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"432\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container networking-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:04Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-lj8gw.16a6ec8f4ef1a571\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4944f068-309a-46da-8d47-78d24c6ab53c\",\n                \"resourceVersion\": \"126\",\n                \"creationTimestamp\": \"2021-09-21T19:20:15Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-lj8gw\",\n                \"uid\": \"b2d7c049-afc8-419c-a3a7-8ac4445a3513\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"680\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kopeio-networking-agent-lj8gw to ip-172-20-35-229.eu-west-3.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:15Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:15Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-lj8gw.16a6ec8f757f0ac3\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"98449d1c-0ac7-4174-b207-537476a17c32\",\n                \"resourceVersion\": \"206\",\n                \"creationTimestamp\": \"2021-09-21T19:20:34Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-lj8gw\",\n                \"uid\": \"b2d7c049-afc8-419c-a3a7-8ac4445a3513\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"683\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"kopeio/networking-agent:1.0.20181028\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-35-229.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:15Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:15Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-lj8gw.16a6ec90503488fc\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7cfcd9b9-5a00-4330-9383-4b7e5858fd98\",\n                \"resourceVersion\": \"207\",\n                \"creationTimestamp\": \"2021-09-21T19:20:34Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-lj8gw\",\n                \"uid\": \"b2d7c049-afc8-419c-a3a7-8ac4445a3513\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"683\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"kopeio/networking-agent:1.0.20181028\\\" in 3.669305073s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-35-229.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:19Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:19Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-lj8gw.16a6ec905c597ee8\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4df27db9-ce7e-487b-a219-74076fa70f2d\",\n                \"resourceVersion\": \"208\",\n                \"creationTimestamp\": \"2021-09-21T19:20:35Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-lj8gw\",\n                \"uid\": \"b2d7c049-afc8-419c-a3a7-8ac4445a3513\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"683\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container networking-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-35-229.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:19Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:19Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-lj8gw.16a6ec906132cd7c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e3f64603-c782-488e-b007-4fdce2bd2d0b\",\n                \"resourceVersion\": \"209\",\n                \"creationTimestamp\": \"2021-09-21T19:20:35Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-lj8gw\",\n                \"uid\": \"b2d7c049-afc8-419c-a3a7-8ac4445a3513\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"683\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container networking-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-35-229.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:19Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:19Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-nj7df.16a6ec9169e70754\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"66b1db15-a002-4ba7-b29b-cc706a87c59f\",\n                \"resourceVersion\": \"147\",\n                \"creationTimestamp\": \"2021-09-21T19:20:24Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-nj7df\",\n                \"uid\": \"30329bcf-cf25-4870-9a28-95b8b9666344\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"750\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kopeio-networking-agent-nj7df to ip-172-20-63-142.eu-west-3.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:24Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:24Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-nj7df.16a6ec919099e8ba\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9577805c-e13c-497c-9e74-a34e3fafb918\",\n                \"resourceVersion\": \"238\",\n                \"creationTimestamp\": \"2021-09-21T19:20:44Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-nj7df\",\n                \"uid\": \"30329bcf-cf25-4870-9a28-95b8b9666344\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"753\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"kopeio/networking-agent:1.0.20181028\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-142.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:24Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:24Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-nj7df.16a6ec9262cc7dc6\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"71c80455-0be7-46d6-8e30-9bb0db14b225\",\n                \"resourceVersion\": \"239\",\n                \"creationTimestamp\": \"2021-09-21T19:20:45Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-nj7df\",\n                \"uid\": \"30329bcf-cf25-4870-9a28-95b8b9666344\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"753\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"kopeio/networking-agent:1.0.20181028\\\" in 3.52648892s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-142.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:28Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:28Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-nj7df.16a6ec92703e44db\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7274bcc9-4299-4a9f-8ece-7ecef12a2f93\",\n                \"resourceVersion\": \"240\",\n                \"creationTimestamp\": \"2021-09-21T19:20:45Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-nj7df\",\n                \"uid\": \"30329bcf-cf25-4870-9a28-95b8b9666344\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"753\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container networking-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-142.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:28Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:28Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-nj7df.16a6ec92760f14b9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fdb7b5f2-96fa-44e6-b237-16761b754ca0\",\n                \"resourceVersion\": \"241\",\n                \"creationTimestamp\": \"2021-09-21T19:20:45Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent-nj7df\",\n                \"uid\": \"30329bcf-cf25-4870-9a28-95b8b9666344\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"753\",\n                \"fieldPath\": \"spec.containers{networking-agent}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container networking-agent\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-142.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:28Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:28Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent.16a6ec7d649d82b1\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"47bce595-0378-4afd-b700-45d115707aa9\",\n                \"resourceVersion\": \"52\",\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent\",\n                \"uid\": \"1c304cee-97ab-4aeb-8bc2-e00cf8ac8269\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"268\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kopeio-networking-agent-jnwrv\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent.16a6ec8cc7007a1d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"aee5f1c6-8253-4146-b5b2-e51dfbabbd12\",\n                \"resourceVersion\": \"80\",\n                \"creationTimestamp\": \"2021-09-21T19:20:04Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent\",\n                \"uid\": \"1c304cee-97ab-4aeb-8bc2-e00cf8ac8269\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"475\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kopeio-networking-agent-4879k\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:04Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent.16a6ec8f308fecc9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4af92b00-fd31-454f-b89f-e3e796f29c13\",\n                \"resourceVersion\": \"118\",\n                \"creationTimestamp\": \"2021-09-21T19:20:14Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent\",\n                \"uid\": \"1c304cee-97ab-4aeb-8bc2-e00cf8ac8269\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"649\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kopeio-networking-agent-8rzgd\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:14Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:14Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent.16a6ec8f4ebbca47\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"db109189-1ad6-436a-9992-ae26f8e9f674\",\n                \"resourceVersion\": \"124\",\n                \"creationTimestamp\": \"2021-09-21T19:20:15Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent\",\n                \"uid\": \"1c304cee-97ab-4aeb-8bc2-e00cf8ac8269\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"671\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kopeio-networking-agent-lj8gw\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:15Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:15Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent.16a6ec916914d585\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d53b765d-334e-4db3-bf53-e62250168c42\",\n                \"resourceVersion\": \"144\",\n                \"creationTimestamp\": \"2021-09-21T19:20:24Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kopeio-networking-agent\",\n                \"uid\": \"1c304cee-97ab-4aeb-8bc2-e00cf8ac8269\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"732\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kopeio-networking-agent-nj7df\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:20:24Z\",\n            \"lastTimestamp\": \"2021-09-21T19:20:24Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-f9lh9.16a6ec7d648e7d9d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"35dd81f1-92e1-41f9-8cc8-4924cc81207a\",\n                \"resourceVersion\": \"53\",\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-f9lh9\",\n                \"uid\": \"23dc4edb-75f1-421f-920a-bd4ae1be3888\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"427\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kops-controller-f9lh9 to ip-172-20-62-185.eu-west-3.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-f9lh9.16a6ec7daa0b4b26\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f30f5b3a-cfd3-41a4-8d08-9983e4a6d99d\",\n                \"resourceVersion\": \"61\",\n                \"creationTimestamp\": \"2021-09-21T19:18:59Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-f9lh9\",\n                \"uid\": \"23dc4edb-75f1-421f-920a-bd4ae1be3888\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"430\"\n            },\n            \"reason\": \"FailedMount\",\n            \"message\": \"MountVolume.SetUp failed for volume \\\"kube-api-access-xs5nk\\\" : failed to sync configmap cache: timed out waiting for the condition\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:59Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:59Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-f9lh9.16a6ec7dddd193ef\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"63840405-214a-4bcf-94f6-d2b91f16f290\",\n                \"resourceVersion\": \"66\",\n                \"creationTimestamp\": \"2021-09-21T19:19:00Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-f9lh9\",\n                \"uid\": \"23dc4edb-75f1-421f-920a-bd4ae1be3888\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"430\",\n                \"fieldPath\": \"spec.containers{kops-controller}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kops/kops-controller:1.21.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:00Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:00Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-f9lh9.16a6ec7de04cbcbf\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e54fa15e-dba9-4169-ae15-eb704e287c2e\",\n                \"resourceVersion\": \"68\",\n                \"creationTimestamp\": \"2021-09-21T19:19:00Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-f9lh9\",\n                \"uid\": \"23dc4edb-75f1-421f-920a-bd4ae1be3888\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"430\",\n                \"fieldPath\": \"spec.containers{kops-controller}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kops-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:00Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:00Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-f9lh9.16a6ec7de5c69620\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"ab834c6c-fd7d-4ca0-b943-b40e8b752312\",\n                \"resourceVersion\": \"71\",\n                \"creationTimestamp\": \"2021-09-21T19:19:00Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-f9lh9\",\n                \"uid\": \"23dc4edb-75f1-421f-920a-bd4ae1be3888\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"430\",\n                \"fieldPath\": \"spec.containers{kops-controller}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kops-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:00Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:00Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-leader.16a6ec7e1e3adbbf\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4712acc1-bacd-4056-b2f3-7fe6a531a17d\",\n                \"resourceVersion\": \"72\",\n                \"creationTimestamp\": \"2021-09-21T19:19:01Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ConfigMap\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-leader\",\n                \"uid\": \"466a35b4-25b6-4309-bb19-b7fcafd17608\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"462\"\n            },\n            \"reason\": \"LeaderElection\",\n            \"message\": \"ip-172-20-62-185.eu-west-3.compute.internal_a26328b2-e216-49ed-ba54-29d5d1153fbe became leader\",\n            \"source\": {\n                \"component\": \"ip-172-20-62-185.eu-west-3.compute.internal_a26328b2-e216-49ed-ba54-29d5d1153fbe\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:01Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:01Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller.16a6ec7d63cd7c36\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8c299d46-405b-43c3-b6e5-273e871c920d\",\n                \"resourceVersion\": \"51\",\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller\",\n                \"uid\": \"6ea43163-7544-4692-9543-bc294ee29a23\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"276\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kops-controller-f9lh9\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec710201fadc\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6b73a871-47a4-48ea-a8f8-8aada028bbae\",\n                \"resourceVersion\": \"42\",\n                \"creationTimestamp\": \"2021-09-21T19:18:46Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"728226eea4100ed17ee54aaa09f2a901\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-apiserver}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-apiserver-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:26Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec7108894cbf\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9fa1dc5f-733c-4b17-8b9a-649c375643e4\",\n                \"resourceVersion\": \"43\",\n                \"creationTimestamp\": \"2021-09-21T19:18:47Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"728226eea4100ed17ee54aaa09f2a901\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-apiserver}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-apiserver\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:26Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec7113370570\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"0121021f-3d13-439f-9502-53ee1c777755\",\n                \"resourceVersion\": \"44\",\n                \"creationTimestamp\": \"2021-09-21T19:18:48Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"728226eea4100ed17ee54aaa09f2a901\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-apiserver}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-apiserver\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:26Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec71144b2f9e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e7c6773e-6473-443d-a3ae-bd2ddc9746e9\",\n                \"resourceVersion\": \"31\",\n                \"creationTimestamp\": \"2021-09-21T19:18:48Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"728226eea4100ed17ee54aaa09f2a901\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{healthcheck}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kops/kube-apiserver-healthcheck:1.21.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec711767d1a1\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2f1fa3c7-f8d5-492c-a117-a023175f1b51\",\n                \"resourceVersion\": \"34\",\n                \"creationTimestamp\": \"2021-09-21T19:18:48Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"728226eea4100ed17ee54aaa09f2a901\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{healthcheck}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container healthcheck\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec7129b97006\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"46b102ef-6871-4767-99c8-cfbd17757768\",\n                \"resourceVersion\": \"35\",\n                \"creationTimestamp\": \"2021-09-21T19:18:49Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"728226eea4100ed17ee54aaa09f2a901\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{healthcheck}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container healthcheck\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec710259dae5\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b8cfe034-bc31-4bd0-aeec-60a39e40565e\",\n                \"resourceVersion\": \"25\",\n                \"creationTimestamp\": \"2021-09-21T19:18:47Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"75b2cb9eb9f4586f4b7424ff1abfeef2\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-controller-manager-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec7108e89192\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2171aa12-0758-4297-9955-fa180431bf45\",\n                \"resourceVersion\": \"29\",\n                \"creationTimestamp\": \"2021-09-21T19:18:47Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"75b2cb9eb9f4586f4b7424ff1abfeef2\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-controller-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec71150680cc\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3ed554f7-7d8e-44ae-a320-31b5b4d8bdae\",\n                \"resourceVersion\": \"33\",\n                \"creationTimestamp\": \"2021-09-21T19:18:48Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"75b2cb9eb9f4586f4b7424ff1abfeef2\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-controller-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager.16a6ec7a0601379f\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"0321e588-41c6-41ce-8c5d-955ee039922e\",\n                \"resourceVersion\": \"6\",\n                \"creationTimestamp\": \"2021-09-21T19:18:43Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Lease\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager\",\n                \"uid\": \"14e88fd8-3eec-4dbd-a2cb-8e3871b2b8d4\",\n                \"apiVersion\": \"coordination.k8s.io/v1\",\n                \"resourceVersion\": \"218\"\n            },\n            \"reason\": \"LeaderElection\",\n            \"message\": \"ip-172-20-62-185.eu-west-3.compute.internal_8f8f46c6-9c8e-47ef-b04f-aafb9441f2fa became leader\",\n            \"source\": {\n                \"component\": \"kube-controller-manager\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:43Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:43Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-dns.16a6ec7d41dda7db\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"482e5d24-a4e8-4852-aaa1-bcb1a987edb5\",\n                \"resourceVersion\": \"47\",\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"PodDisruptionBudget\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-dns\",\n                \"uid\": \"00569346-9bde-4ad4-a0b9-521046323f1d\",\n                \"apiVersion\": \"policy/v1\",\n                \"resourceVersion\": \"298\"\n            },\n            \"reason\": \"NoPods\",\n            \"message\": \"No matching pods found\",\n            \"source\": {\n                \"component\": \"controllermanager\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:57Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:58Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-35-229.eu-west-3.compute.internal.16a6ec817fe9d13b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8194684a-4b4b-409e-a437-1b31d8b4d349\",\n                \"resourceVersion\": \"193\",\n                \"creationTimestamp\": \"2021-09-21T19:20:32Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-35-229.eu-west-3.compute.internal\",\n                \"uid\": \"6eda7b7c0f0a8c32f9e5a92044f23c87\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-proxy-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-35-229.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:15Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:15Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-35-229.eu-west-3.compute.internal.16a6ec81837f798d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1e20efaf-d878-45e6-aebf-3938ab09a22c\",\n                \"resourceVersion\": \"194\",\n                \"creationTimestamp\": \"2021-09-21T19:20:32Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-35-229.eu-west-3.compute.internal\",\n                \"uid\": \"6eda7b7c0f0a8c32f9e5a92044f23c87\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-35-229.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:15Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:15Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-35-229.eu-west-3.compute.internal.16a6ec818902113c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"80d91352-9492-4816-9752-4c1263e0b915\",\n                \"resourceVersion\": \"195\",\n                \"creationTimestamp\": \"2021-09-21T19:20:32Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-35-229.eu-west-3.compute.internal\",\n                \"uid\": \"6eda7b7c0f0a8c32f9e5a92044f23c87\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-35-229.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:16Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:16Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-53-119.eu-west-3.compute.internal.16a6ec8161bd1d6b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9ad8b683-3c08-4e73-9bb6-6bca98528ddd\",\n                \"resourceVersion\": \"159\",\n                \"creationTimestamp\": \"2021-09-21T19:20:25Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-53-119.eu-west-3.compute.internal\",\n                \"uid\": \"7c4cbd06b2f2e1958f71831c8bedc6e0\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-proxy-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-53-119.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:15Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:15Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-53-119.eu-west-3.compute.internal.16a6ec8164ca1078\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4b5180ca-f028-42c9-9b95-e70036d5c446\",\n                \"resourceVersion\": \"160\",\n                \"creationTimestamp\": \"2021-09-21T19:20:25Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-53-119.eu-west-3.compute.internal\",\n                \"uid\": \"7c4cbd06b2f2e1958f71831c8bedc6e0\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-53-119.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:15Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:15Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-53-119.eu-west-3.compute.internal.16a6ec8169d611b3\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"305fb36a-fb6f-41e1-ba8f-4911d1c9e34b\",\n                \"resourceVersion\": \"161\",\n                \"creationTimestamp\": \"2021-09-21T19:20:25Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-53-119.eu-west-3.compute.internal\",\n                \"uid\": \"7c4cbd06b2f2e1958f71831c8bedc6e0\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-53-119.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:15Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:15Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec710187488d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"85ad4a0d-1f40-4a9e-8683-4736cb182e7e\",\n                \"resourceVersion\": \"23\",\n                \"creationTimestamp\": \"2021-09-21T19:18:46Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"1b0052e7d7cb290a7d6434e19beaada0\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-proxy-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec7107946f21\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7ff40c7e-42fb-4c8c-8573-a88f93127e4b\",\n                \"resourceVersion\": \"26\",\n                \"creationTimestamp\": \"2021-09-21T19:18:47Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"1b0052e7d7cb290a7d6434e19beaada0\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec711504a260\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c589c90c-f7fa-4919-82d8-dc70aafd13e3\",\n                \"resourceVersion\": \"32\",\n                \"creationTimestamp\": \"2021-09-21T19:18:48Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"1b0052e7d7cb290a7d6434e19beaada0\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-63-142.eu-west-3.compute.internal.16a6ec839a3881a4\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"06e2c881-9c08-4903-ac64-3ded98bafb46\",\n                \"resourceVersion\": \"225\",\n                \"creationTimestamp\": \"2021-09-21T19:20:42Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-63-142.eu-west-3.compute.internal\",\n                \"uid\": \"71f2152ee0fbb3739ee565878e515c69\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-proxy-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-142.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:24Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:24Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-63-142.eu-west-3.compute.internal.16a6ec839d15e27c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"16024df8-b56f-4119-8736-2a4b4983c2f9\",\n                \"resourceVersion\": \"226\",\n                \"creationTimestamp\": \"2021-09-21T19:20:42Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-63-142.eu-west-3.compute.internal\",\n                \"uid\": \"71f2152ee0fbb3739ee565878e515c69\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-142.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:24Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:24Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-63-142.eu-west-3.compute.internal.16a6ec83a239853b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"966dd98c-a9fc-457e-9776-cbee7b488774\",\n                \"resourceVersion\": \"227\",\n                \"creationTimestamp\": \"2021-09-21T19:20:42Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-63-142.eu-west-3.compute.internal\",\n                \"uid\": \"71f2152ee0fbb3739ee565878e515c69\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-142.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:25Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:25Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-63-30.eu-west-3.compute.internal.16a6ec85e7b5c588\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"07a21cf4-ef0a-4811-9a2e-d5c9e76b945c\",\n                \"resourceVersion\": \"99\",\n                \"creationTimestamp\": \"2021-09-21T19:20:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-63-30.eu-west-3.compute.internal\",\n                \"uid\": \"5d9b5f87a09b018070f79be4170122e9\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-proxy-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:34Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:34Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-63-30.eu-west-3.compute.internal.16a6ec85ea7cdc85\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7f61f95e-48e4-4cd1-8908-aa7c630977ae\",\n                \"resourceVersion\": \"100\",\n                \"creationTimestamp\": \"2021-09-21T19:20:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-63-30.eu-west-3.compute.internal\",\n                \"uid\": \"5d9b5f87a09b018070f79be4170122e9\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:34Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:34Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-63-30.eu-west-3.compute.internal.16a6ec85ef87f83b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"abbda837-834e-4f3d-a918-e32a8bc2db61\",\n                \"resourceVersion\": \"101\",\n                \"creationTimestamp\": \"2021-09-21T19:20:11Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-63-30.eu-west-3.compute.internal\",\n                \"uid\": \"5d9b5f87a09b018070f79be4170122e9\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-30.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:19:34Z\",\n            \"lastTimestamp\": \"2021-09-21T19:19:34Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec70fab5a228\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"36fcc6e5-f216-4241-9738-7abfac22d2a0\",\n                \"resourceVersion\": \"20\",\n                \"creationTimestamp\": \"2021-09-21T19:18:46Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"68cec326f2ffb274c7e25dda5007bb91\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-scheduler}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-scheduler-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:04Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:04Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec70ff40a864\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a748b2fc-37d5-488d-a386-bec0efdb4a4d\",\n                \"resourceVersion\": \"22\",\n                \"creationTimestamp\": \"2021-09-21T19:18:46Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"68cec326f2ffb274c7e25dda5007bb91\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-scheduler}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-scheduler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-ip-172-20-62-185.eu-west-3.compute.internal.16a6ec7107d0489a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a5b4470e-cdcc-4d94-ae3d-bdf289d3f8b5\",\n                \"resourceVersion\": \"27\",\n                \"creationTimestamp\": \"2021-09-21T19:18:47Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"uid\": \"68cec326f2ffb274c7e25dda5007bb91\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-scheduler}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-scheduler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-62-185.eu-west-3.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:05Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler.16a6ec7a25e4d8cd\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d0a6226b-937e-4467-a3db-37196283a1d5\",\n                \"resourceVersion\": \"10\",\n                \"creationTimestamp\": \"2021-09-21T19:18:44Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Lease\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler\",\n                \"uid\": \"60c0ba5e-99ff-4d0a-a8dd-494af5aee098\",\n                \"apiVersion\": \"coordination.k8s.io/v1\",\n                \"resourceVersion\": \"222\"\n            },\n            \"reason\": \"LeaderElection\",\n            \"message\": \"ip-172-20-62-185.eu-west-3.compute.internal_72329126-a122-4bb0-bf6b-c972db573092 became leader\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-21T19:18:44Z\",\n            \"lastTimestamp\": \"2021-09-21T19:18:44Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        }\n    ]\n}\n{\n    \"kind\": \"ReplicationControllerList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"8576\"\n    },\n    \"items\": []\n}\n{\n    \"kind\": \"ServiceList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"8576\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"kube-dns\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"53fc35e2-ca0e-48ce-91f2-68801f969e06\",\n                \"resourceVersion\": \"297\",\n                \"creationTimestamp\": \"2021-09-21T19:18:47Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"coredns.addons.k8s.io\",\n                    \"addon.kops.k8s.io/version\": \"1.8.3-kops.3\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"coredns.addons.k8s.io\",\n                    \"k8s-app\": \"kube-dns\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"kubernetes.io/name\": \"CoreDNS\"\n                },\n                \"annotations\": {\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"v1\\\",\\\"kind\\\":\\\"Service\\\",\\\"metadata\\\":{\\\"annotations\\\":{\\\"prometheus.io/port\\\":\\\"9153\\\",\\\"prometheus.io/scrape\\\":\\\"true\\\"},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"coredns.addons.k8s.io\\\",\\\"addon.kops.k8s.io/version\\\":\\\"1.8.3-kops.3\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"coredns.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"kube-dns\\\",\\\"kubernetes.io/cluster-service\\\":\\\"true\\\",\\\"kubernetes.io/name\\\":\\\"CoreDNS\\\"},\\\"name\\\":\\\"kube-dns\\\",\\\"namespace\\\":\\\"kube-system\\\",\\\"resourceVersion\\\":\\\"0\\\"},\\\"spec\\\":{\\\"clusterIP\\\":\\\"100.64.0.10\\\",\\\"ports\\\":[{\\\"name\\\":\\\"dns\\\",\\\"port\\\":53,\\\"protocol\\\":\\\"UDP\\\"},{\\\"name\\\":\\\"dns-tcp\\\",\\\"port\\\":53,\\\"protocol\\\":\\\"TCP\\\"},{\\\"name\\\":\\\"metrics\\\",\\\"port\\\":9153,\\\"protocol\\\":\\\"TCP\\\"}],\\\"selector\\\":{\\\"k8s-app\\\":\\\"kube-dns\\\"}}}\\n\",\n                    \"prometheus.io/port\": \"9153\",\n                    \"prometheus.io/scrape\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"ports\": [\n                    {\n                        \"name\": \"dns\",\n                        \"protocol\": \"UDP\",\n                        \"port\": 53,\n                        \"targetPort\": 53\n                    },\n                    {\n                        \"name\": \"dns-tcp\",\n                        \"protocol\": \"TCP\",\n                        \"port\": 53,\n                        \"targetPort\": 53\n                    },\n                    {\n                        \"name\": \"metrics\",\n                        \"protocol\": \"TCP\",\n                        \"port\": 9153,\n                        \"targetPort\": 9153\n                    }\n                ],\n                \"selector\": {\n                    \"k8s-app\": \"kube-dns\"\n                },\n                \"clusterIP\": \"100.64.0.10\",\n                \"clusterIPs\": [\n                    \"100.64.0.10\"\n                ],\n                \"type\": \"ClusterIP\",\n                \"sessionAffinity\": \"None\",\n                \"ipFamilies\": [\n                    \"IPv4\"\n                ],\n                \"ipFamilyPolicy\": \"SingleStack\"\n            },\n            \"status\": {\n                \"loadBalancer\": {}\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"DaemonSetList\",\n    \"apiVersion\": \"apps/v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"8581\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1c304cee-97ab-4aeb-8bc2-e00cf8ac8269\",\n                \"resourceVersion\": \"779\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-09-21T19:18:45Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"networking.kope.io\",\n                    \"addon.kops.k8s.io/version\": \"1.0.20181028-kops.2\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"networking.kope.io\",\n                    \"role.kubernetes.io/networking\": \"1\"\n                },\n                \"annotations\": {\n                    \"deprecated.daemonset.template.generation\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"DaemonSet\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"networking.kope.io\\\",\\\"addon.kops.k8s.io/version\\\":\\\"1.0.20181028-kops.2\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"networking.kope.io\\\",\\\"role.kubernetes.io/networking\\\":\\\"1\\\"},\\\"name\\\":\\\"kopeio-networking-agent\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"selector\\\":{\\\"matchLabels\\\":{\\\"name\\\":\\\"kopeio-networking-agent\\\"}},\\\"template\\\":{\\\"metadata\\\":{\\\"annotations\\\":{\\\"scheduler.alpha.kubernetes.io/critical-pod\\\":\\\"\\\",\\\"scheduler.alpha.kubernetes.io/tolerations\\\":\\\"[{\\\\\\\"key\\\\\\\":\\\\\\\"CriticalAddonsOnly\\\\\\\", \\\\\\\"operator\\\\\\\":\\\\\\\"Exists\\\\\\\"}]\\\"},\\\"labels\\\":{\\\"name\\\":\\\"kopeio-networking-agent\\\"}},\\\"spec\\\":{\\\"containers\\\":[{\\\"env\\\":[{\\\"name\\\":\\\"NODE_NAME\\\",\\\"valueFrom\\\":{\\\"fieldRef\\\":{\\\"fieldPath\\\":\\\"spec.nodeName\\\"}}}],\\\"image\\\":\\\"kopeio/networking-agent:1.0.20181028\\\",\\\"name\\\":\\\"networking-agent\\\",\\\"resources\\\":{\\\"limits\\\":{\\\"memory\\\":\\\"100Mi\\\"},\\\"requests\\\":{\\\"cpu\\\":\\\"50m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"securityContext\\\":{\\\"privileged\\\":true},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/lib/modules\\\",\\\"name\\\":\\\"lib-modules\\\",\\\"readOnly\\\":true}]}],\\\"hostIPC\\\":true,\\\"hostNetwork\\\":true,\\\"hostPID\\\":true,\\\"priorityClassName\\\":\\\"system-node-critical\\\",\\\"serviceAccountName\\\":\\\"kopeio-networking-agent\\\",\\\"tolerations\\\":[{\\\"effect\\\":\\\"NoSchedule\\\",\\\"operator\\\":\\\"Exists\\\"},{\\\"effect\\\":\\\"NoExecute\\\",\\\"operator\\\":\\\"Exists\\\"}],\\\"volumes\\\":[{\\\"hostPath\\\":{\\\"path\\\":\\\"/lib/modules\\\"},\\\"name\\\":\\\"lib-modules\\\"}]}}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"name\": \"kopeio-networking-agent\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"name\": \"kopeio-networking-agent\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\",\n                            \"scheduler.alpha.kubernetes.io/tolerations\": \"[{\\\"key\\\":\\\"CriticalAddonsOnly\\\", \\\"operator\\\":\\\"Exists\\\"}]\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"lib-modules\",\n                                \"hostPath\": {\n                                    \"path\": \"/lib/modules\",\n                                    \"type\": \"\"\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"networking-agent\",\n                                \"image\": \"kopeio/networking-agent:1.0.20181028\",\n                                \"env\": [\n                                    {\n                                        \"name\": \"NODE_NAME\",\n                                        \"valueFrom\": {\n                                            \"fieldRef\": {\n                                                \"apiVersion\": \"v1\",\n                                                \"fieldPath\": \"spec.nodeName\"\n                                            }\n                                        }\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"limits\": {\n                                        \"memory\": \"100Mi\"\n                                    },\n                                    \"requests\": {\n                                        \"cpu\": \"50m\",\n                                        \"memory\": \"100Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"lib-modules\",\n                                        \"readOnly\": true,\n                                        \"mountPath\": \"/lib/modules\"\n                                    }\n                                ],\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"privileged\": true\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"ClusterFirst\",\n                        \"serviceAccountName\": \"kopeio-networking-agent\",\n                        \"serviceAccount\": \"kopeio-networking-agent\",\n                        \"hostNetwork\": true,\n                        \"hostPID\": true,\n                        \"hostIPC\": true,\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"operator\": \"Exists\",\n                                \"effect\": \"NoSchedule\"\n                            },\n                            {\n                                \"operator\": \"Exists\",\n                                \"effect\": \"NoExecute\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-node-critical\"\n                    }\n                },\n                \"updateStrategy\": {\n                    \"type\": \"RollingUpdate\",\n                    \"rollingUpdate\": {\n                        \"maxUnavailable\": 1,\n                        \"maxSurge\": 0\n                    }\n                },\n                \"revisionHistoryLimit\": 10\n            },\n            \"status\": {\n                \"currentNumberScheduled\": 5,\n                \"numberMisscheduled\": 0,\n                \"desiredNumberScheduled\": 5,\n                \"numberReady\": 5,\n                \"observedGeneration\": 1,\n                \"updatedNumberScheduled\": 5,\n                \"numberAvailable\": 5\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6ea43163-7544-4692-9543-bc294ee29a23\",\n                \"resourceVersion\": \"461\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-09-21T19:18:45Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"kops-controller.addons.k8s.io\",\n                    \"addon.kops.k8s.io/version\": \"1.21.1\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"kops-controller.addons.k8s.io\",\n                    \"k8s-app\": \"kops-controller\",\n                    \"version\": \"v1.21.1\"\n                },\n                \"annotations\": {\n                    \"deprecated.daemonset.template.generation\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"DaemonSet\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"kops-controller.addons.k8s.io\\\",\\\"addon.kops.k8s.io/version\\\":\\\"1.21.1\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"kops-controller.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"kops-controller\\\",\\\"version\\\":\\\"v1.21.1\\\"},\\\"name\\\":\\\"kops-controller\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"selector\\\":{\\\"matchLabels\\\":{\\\"k8s-app\\\":\\\"kops-controller\\\"}},\\\"template\\\":{\\\"metadata\\\":{\\\"annotations\\\":{\\\"dns.alpha.kubernetes.io/internal\\\":\\\"kops-controller.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io\\\"},\\\"labels\\\":{\\\"k8s-addon\\\":\\\"kops-controller.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"kops-controller\\\",\\\"version\\\":\\\"v1.21.1\\\"}},\\\"spec\\\":{\\\"containers\\\":[{\\\"command\\\":[\\\"/kops-controller\\\",\\\"--v=2\\\",\\\"--conf=/etc/kubernetes/kops-controller/config/config.yaml\\\"],\\\"env\\\":[{\\\"name\\\":\\\"KUBERNETES_SERVICE_HOST\\\",\\\"value\\\":\\\"127.0.0.1\\\"}],\\\"image\\\":\\\"k8s.gcr.io/kops/kops-controller:1.21.1\\\",\\\"name\\\":\\\"kops-controller\\\",\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"50m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"securityContext\\\":{\\\"runAsNonRoot\\\":true},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/kops-controller/config/\\\",\\\"name\\\":\\\"kops-controller-config\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/kops-controller/pki/\\\",\\\"name\\\":\\\"kops-controller-pki\\\"}]}],\\\"dnsPolicy\\\":\\\"Default\\\",\\\"hostNetwork\\\":true,\\\"nodeSelector\\\":{\\\"kops.k8s.io/kops-controller-pki\\\":\\\"\\\",\\\"node-role.kubernetes.io/master\\\":\\\"\\\"},\\\"priorityClassName\\\":\\\"system-node-critical\\\",\\\"serviceAccount\\\":\\\"kops-controller\\\",\\\"tolerations\\\":[{\\\"key\\\":\\\"node-role.kubernetes.io/master\\\",\\\"operator\\\":\\\"Exists\\\"}],\\\"volumes\\\":[{\\\"configMap\\\":{\\\"name\\\":\\\"kops-controller\\\"},\\\"name\\\":\\\"kops-controller-config\\\"},{\\\"hostPath\\\":{\\\"path\\\":\\\"/etc/kubernetes/kops-controller/\\\",\\\"type\\\":\\\"Directory\\\"},\\\"name\\\":\\\"kops-controller-pki\\\"}]}},\\\"updateStrategy\\\":{\\\"type\\\":\\\"OnDelete\\\"}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"kops-controller\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-addon\": \"kops-controller.addons.k8s.io\",\n                            \"k8s-app\": \"kops-controller\",\n                            \"version\": \"v1.21.1\"\n                        },\n                        \"annotations\": {\n                            \"dns.alpha.kubernetes.io/internal\": \"kops-controller.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"kops-controller-config\",\n                                \"configMap\": {\n                                    \"name\": \"kops-controller\",\n                                    \"defaultMode\": 420\n                                }\n                            },\n                            {\n                                \"name\": \"kops-controller-pki\",\n                                \"hostPath\": {\n                                    \"path\": \"/etc/kubernetes/kops-controller/\",\n                                    \"type\": \"Directory\"\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"kops-controller\",\n                                \"image\": \"k8s.gcr.io/kops/kops-controller:1.21.1\",\n                                \"command\": [\n                                    \"/kops-controller\",\n                                    \"--v=2\",\n                                    \"--conf=/etc/kubernetes/kops-controller/config/config.yaml\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                        \"value\": \"127.0.0.1\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"50m\",\n                                        \"memory\": \"50Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"kops-controller-config\",\n                                        \"mountPath\": \"/etc/kubernetes/kops-controller/config/\"\n                                    },\n                                    {\n                                        \"name\": \"kops-controller-pki\",\n                                        \"mountPath\": \"/etc/kubernetes/kops-controller/pki/\"\n                                    }\n                                ],\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"runAsNonRoot\": true\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"kops.k8s.io/kops-controller-pki\": \"\",\n                            \"node-role.kubernetes.io/master\": \"\"\n                        },\n                        \"serviceAccountName\": \"kops-controller\",\n                        \"serviceAccount\": \"kops-controller\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"node-role.kubernetes.io/master\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-node-critical\"\n                    }\n                },\n                \"updateStrategy\": {\n                    \"type\": \"OnDelete\"\n                },\n                \"revisionHistoryLimit\": 10\n            },\n            \"status\": {\n                \"currentNumberScheduled\": 1,\n                \"numberMisscheduled\": 0,\n                \"desiredNumberScheduled\": 1,\n                \"numberReady\": 1,\n                \"observedGeneration\": 1,\n                \"updatedNumberScheduled\": 1,\n                \"numberAvailable\": 1\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"DeploymentList\",\n    \"apiVersion\": \"apps/v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"8584\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"coredns\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8285b56d-5e5e-4602-970b-2c8b83b4976d\",\n                \"resourceVersion\": \"743\",\n                \"generation\": 2,\n                \"creationTimestamp\": \"2021-09-21T19:18:47Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"coredns.addons.k8s.io\",\n                    \"addon.kops.k8s.io/version\": \"1.8.3-kops.3\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"coredns.addons.k8s.io\",\n                    \"k8s-app\": \"kube-dns\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"kubernetes.io/name\": \"CoreDNS\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/revision\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"Deployment\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"coredns.addons.k8s.io\\\",\\\"addon.kops.k8s.io/version\\\":\\\"1.8.3-kops.3\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"coredns.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"kube-dns\\\",\\\"kubernetes.io/cluster-service\\\":\\\"true\\\",\\\"kubernetes.io/name\\\":\\\"CoreDNS\\\"},\\\"name\\\":\\\"coredns\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"selector\\\":{\\\"matchLabels\\\":{\\\"k8s-app\\\":\\\"kube-dns\\\"}},\\\"strategy\\\":{\\\"rollingUpdate\\\":{\\\"maxSurge\\\":\\\"10%\\\",\\\"maxUnavailable\\\":1},\\\"type\\\":\\\"RollingUpdate\\\"},\\\"template\\\":{\\\"metadata\\\":{\\\"labels\\\":{\\\"k8s-app\\\":\\\"kube-dns\\\"}},\\\"spec\\\":{\\\"affinity\\\":{\\\"podAntiAffinity\\\":{\\\"preferredDuringSchedulingIgnoredDuringExecution\\\":[{\\\"podAffinityTerm\\\":{\\\"labelSelector\\\":{\\\"matchExpressions\\\":[{\\\"key\\\":\\\"k8s-app\\\",\\\"operator\\\":\\\"In\\\",\\\"values\\\":[\\\"kube-dns\\\"]}]},\\\"topologyKey\\\":\\\"kubernetes.io/hostname\\\"},\\\"weight\\\":100}]}},\\\"containers\\\":[{\\\"args\\\":[\\\"-conf\\\",\\\"/etc/coredns/Corefile\\\"],\\\"image\\\":\\\"k8s.gcr.io/coredns/coredns:v1.8.4\\\",\\\"imagePullPolicy\\\":\\\"IfNotPresent\\\",\\\"livenessProbe\\\":{\\\"failureThreshold\\\":5,\\\"httpGet\\\":{\\\"path\\\":\\\"/health\\\",\\\"port\\\":8080,\\\"scheme\\\":\\\"HTTP\\\"},\\\"initialDelaySeconds\\\":60,\\\"successThreshold\\\":1,\\\"timeoutSeconds\\\":5},\\\"name\\\":\\\"coredns\\\",\\\"ports\\\":[{\\\"containerPort\\\":53,\\\"name\\\":\\\"dns\\\",\\\"protocol\\\":\\\"UDP\\\"},{\\\"containerPort\\\":53,\\\"name\\\":\\\"dns-tcp\\\",\\\"protocol\\\":\\\"TCP\\\"},{\\\"containerPort\\\":9153,\\\"name\\\":\\\"metrics\\\",\\\"protocol\\\":\\\"TCP\\\"}],\\\"readinessProbe\\\":{\\\"httpGet\\\":{\\\"path\\\":\\\"/ready\\\",\\\"port\\\":8181,\\\"scheme\\\":\\\"HTTP\\\"}},\\\"resources\\\":{\\\"limits\\\":{\\\"memory\\\":\\\"170Mi\\\"},\\\"requests\\\":{\\\"cpu\\\":\\\"100m\\\",\\\"memory\\\":\\\"70Mi\\\"}},\\\"securityContext\\\":{\\\"allowPrivilegeEscalation\\\":false,\\\"capabilities\\\":{\\\"add\\\":[\\\"NET_BIND_SERVICE\\\"],\\\"drop\\\":[\\\"all\\\"]},\\\"readOnlyRootFilesystem\\\":true},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/coredns\\\",\\\"name\\\":\\\"config-volume\\\",\\\"readOnly\\\":true}]}],\\\"dnsPolicy\\\":\\\"Default\\\",\\\"nodeSelector\\\":{\\\"kubernetes.io/os\\\":\\\"linux\\\"},\\\"priorityClassName\\\":\\\"system-cluster-critical\\\",\\\"serviceAccountName\\\":\\\"coredns\\\",\\\"tolerations\\\":[{\\\"key\\\":\\\"CriticalAddonsOnly\\\",\\\"operator\\\":\\\"Exists\\\"}],\\\"volumes\\\":[{\\\"configMap\\\":{\\\"items\\\":[{\\\"key\\\":\\\"Corefile\\\",\\\"path\\\":\\\"Corefile\\\"}],\\\"name\\\":\\\"coredns\\\"},\\\"name\\\":\\\"config-volume\\\"}]}}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"replicas\": 2,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"kube-dns\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"kube-dns\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"configMap\": {\n                                    \"name\": \"coredns\",\n                                    \"items\": [\n                                        {\n                                            \"key\": \"Corefile\",\n                                            \"path\": \"Corefile\"\n                                        }\n                                    ],\n                                    \"defaultMode\": 420\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"coredns\",\n                                \"image\": \"k8s.gcr.io/coredns/coredns:v1.8.4\",\n                                \"args\": [\n                                    \"-conf\",\n                                    \"/etc/coredns/Corefile\"\n                                ],\n                                \"ports\": [\n                                    {\n                                        \"name\": \"dns\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"UDP\"\n                                    },\n                                    {\n                                        \"name\": \"dns-tcp\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"TCP\"\n                                    },\n                                    {\n                                        \"name\": \"metrics\",\n                                        \"containerPort\": 9153,\n                                        \"protocol\": \"TCP\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"limits\": {\n                                        \"memory\": \"170Mi\"\n                                    },\n                                    \"requests\": {\n                                        \"cpu\": \"100m\",\n                                        \"memory\": \"70Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"config-volume\",\n                                        \"readOnly\": true,\n                                        \"mountPath\": \"/etc/coredns\"\n                                    }\n                                ],\n                                \"livenessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/health\",\n                                        \"port\": 8080,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"initialDelaySeconds\": 60,\n                                    \"timeoutSeconds\": 5,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 5\n                                },\n                                \"readinessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/ready\",\n                                        \"port\": 8181,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"timeoutSeconds\": 1,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 3\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"capabilities\": {\n                                        \"add\": [\n                                            \"NET_BIND_SERVICE\"\n                                        ],\n                                        \"drop\": [\n                                            \"all\"\n                                        ]\n                                    },\n                                    \"readOnlyRootFilesystem\": true,\n                                    \"allowPrivilegeEscalation\": false\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"kubernetes.io/os\": \"linux\"\n                        },\n                        \"serviceAccountName\": \"coredns\",\n                        \"serviceAccount\": \"coredns\",\n                        \"securityContext\": {},\n                        \"affinity\": {\n                            \"podAntiAffinity\": {\n                                \"preferredDuringSchedulingIgnoredDuringExecution\": [\n                                    {\n                                        \"weight\": 100,\n                                        \"podAffinityTerm\": {\n                                            \"labelSelector\": {\n                                                \"matchExpressions\": [\n                                                    {\n                                                        \"key\": \"k8s-app\",\n                                                        \"operator\": \"In\",\n                                                        \"values\": [\n                                                            \"kube-dns\"\n                                                        ]\n                                                    }\n                                                ]\n                                            },\n                                            \"topologyKey\": \"kubernetes.io/hostname\"\n                                        }\n                                    }\n                                ]\n                            }\n                        },\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                },\n                \"strategy\": {\n                    \"type\": \"RollingUpdate\",\n                    \"rollingUpdate\": {\n                        \"maxUnavailable\": 1,\n                        \"maxSurge\": \"10%\"\n                    }\n                },\n                \"revisionHistoryLimit\": 10,\n                \"progressDeadlineSeconds\": 600\n            },\n            \"status\": {\n                \"observedGeneration\": 2,\n                \"replicas\": 2,\n                \"updatedReplicas\": 2,\n                \"readyReplicas\": 2,\n                \"availableReplicas\": 2,\n                \"conditions\": [\n                    {\n                        \"type\": \"Available\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-09-21T19:20:18Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:20:18Z\",\n                        \"reason\": \"MinimumReplicasAvailable\",\n                        \"message\": \"Deployment has minimum availability.\"\n                    },\n                    {\n                        \"type\": \"Progressing\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-09-21T19:20:22Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:18:58Z\",\n                        \"reason\": \"NewReplicaSetAvailable\",\n                        \"message\": \"ReplicaSet \\\"coredns-5dc785954d\\\" has successfully progressed.\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9096fe29-0a44-4c9c-916b-0690235a7c09\",\n                \"resourceVersion\": \"700\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-09-21T19:18:47Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"coredns.addons.k8s.io\",\n                    \"addon.kops.k8s.io/version\": \"1.8.3-kops.3\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"coredns.addons.k8s.io\",\n                    \"k8s-app\": \"coredns-autoscaler\",\n                    \"kubernetes.io/cluster-service\": \"true\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/revision\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"Deployment\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"coredns.addons.k8s.io\\\",\\\"addon.kops.k8s.io/version\\\":\\\"1.8.3-kops.3\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"coredns.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"coredns-autoscaler\\\",\\\"kubernetes.io/cluster-service\\\":\\\"true\\\"},\\\"name\\\":\\\"coredns-autoscaler\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"selector\\\":{\\\"matchLabels\\\":{\\\"k8s-app\\\":\\\"coredns-autoscaler\\\"}},\\\"template\\\":{\\\"metadata\\\":{\\\"annotations\\\":{\\\"scheduler.alpha.kubernetes.io/critical-pod\\\":\\\"\\\"},\\\"labels\\\":{\\\"k8s-app\\\":\\\"coredns-autoscaler\\\"}},\\\"spec\\\":{\\\"containers\\\":[{\\\"command\\\":[\\\"/cluster-proportional-autoscaler\\\",\\\"--namespace=kube-system\\\",\\\"--configmap=coredns-autoscaler\\\",\\\"--target=Deployment/coredns\\\",\\\"--default-params={\\\\\\\"linear\\\\\\\":{\\\\\\\"coresPerReplica\\\\\\\":256,\\\\\\\"nodesPerReplica\\\\\\\":16,\\\\\\\"preventSinglePointFailure\\\\\\\":true}}\\\",\\\"--logtostderr=true\\\",\\\"--v=2\\\"],\\\"image\\\":\\\"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\\\",\\\"name\\\":\\\"autoscaler\\\",\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"10Mi\\\"}}}],\\\"nodeSelector\\\":{\\\"kubernetes.io/os\\\":\\\"linux\\\"},\\\"priorityClassName\\\":\\\"system-cluster-critical\\\",\\\"serviceAccountName\\\":\\\"coredns-autoscaler\\\",\\\"tolerations\\\":[{\\\"key\\\":\\\"CriticalAddonsOnly\\\",\\\"operator\\\":\\\"Exists\\\"}]}}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"coredns-autoscaler\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"coredns-autoscaler\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"autoscaler\",\n                                \"image\": \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\",\n                                \"command\": [\n                                    \"/cluster-proportional-autoscaler\",\n                                    \"--namespace=kube-system\",\n                                    \"--configmap=coredns-autoscaler\",\n                                    \"--target=Deployment/coredns\",\n                                    \"--default-params={\\\"linear\\\":{\\\"coresPerReplica\\\":256,\\\"nodesPerReplica\\\":16,\\\"preventSinglePointFailure\\\":true}}\",\n                                    \"--logtostderr=true\",\n                                    \"--v=2\"\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"20m\",\n                                        \"memory\": \"10Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\"\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"ClusterFirst\",\n                        \"nodeSelector\": {\n                            \"kubernetes.io/os\": \"linux\"\n                        },\n                        \"serviceAccountName\": \"coredns-autoscaler\",\n                        \"serviceAccount\": \"coredns-autoscaler\",\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                },\n                \"strategy\": {\n                    \"type\": \"RollingUpdate\",\n                    \"rollingUpdate\": {\n                        \"maxUnavailable\": \"25%\",\n                        \"maxSurge\": \"25%\"\n                    }\n                },\n                \"revisionHistoryLimit\": 10,\n                \"progressDeadlineSeconds\": 600\n            },\n            \"status\": {\n                \"observedGeneration\": 1,\n                \"replicas\": 1,\n                \"updatedReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"conditions\": [\n                    {\n                        \"type\": \"Available\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-09-21T19:20:15Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:20:15Z\",\n                        \"reason\": \"MinimumReplicasAvailable\",\n                        \"message\": \"Deployment has minimum availability.\"\n                    },\n                    {\n                        \"type\": \"Progressing\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-09-21T19:20:15Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:18:58Z\",\n                        \"reason\": \"NewReplicaSetAvailable\",\n                        \"message\": \"ReplicaSet \\\"coredns-autoscaler-84d4cfd89c\\\" has successfully progressed.\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"86d3a739-16b7-41c4-a4d8-12bffb3d49cc\",\n                \"resourceVersion\": \"459\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-09-21T19:18:44Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"dns-controller.addons.k8s.io\",\n                    \"addon.kops.k8s.io/version\": \"1.21.1\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                    \"k8s-app\": \"dns-controller\",\n                    \"version\": \"v1.21.1\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/revision\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"Deployment\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"dns-controller.addons.k8s.io\\\",\\\"addon.kops.k8s.io/version\\\":\\\"1.21.1\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"dns-controller.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"dns-controller\\\",\\\"version\\\":\\\"v1.21.1\\\"},\\\"name\\\":\\\"dns-controller\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"replicas\\\":1,\\\"selector\\\":{\\\"matchLabels\\\":{\\\"k8s-app\\\":\\\"dns-controller\\\"}},\\\"strategy\\\":{\\\"type\\\":\\\"Recreate\\\"},\\\"template\\\":{\\\"metadata\\\":{\\\"annotations\\\":{\\\"scheduler.alpha.kubernetes.io/critical-pod\\\":\\\"\\\"},\\\"labels\\\":{\\\"k8s-addon\\\":\\\"dns-controller.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"dns-controller\\\",\\\"version\\\":\\\"v1.21.1\\\"}},\\\"spec\\\":{\\\"containers\\\":[{\\\"command\\\":[\\\"/dns-controller\\\",\\\"--watch-ingress=false\\\",\\\"--dns=aws-route53\\\",\\\"--zone=*/ZEMLNXIIWQ0RV\\\",\\\"--zone=*/*\\\",\\\"-v=2\\\"],\\\"env\\\":[{\\\"name\\\":\\\"KUBERNETES_SERVICE_HOST\\\",\\\"value\\\":\\\"127.0.0.1\\\"}],\\\"image\\\":\\\"k8s.gcr.io/kops/dns-controller:1.21.1\\\",\\\"name\\\":\\\"dns-controller\\\",\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"50m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"securityContext\\\":{\\\"runAsNonRoot\\\":true}}],\\\"dnsPolicy\\\":\\\"Default\\\",\\\"hostNetwork\\\":true,\\\"nodeSelector\\\":{\\\"node-role.kubernetes.io/master\\\":\\\"\\\"},\\\"priorityClassName\\\":\\\"system-cluster-critical\\\",\\\"serviceAccount\\\":\\\"dns-controller\\\",\\\"tolerations\\\":[{\\\"operator\\\":\\\"Exists\\\"}]}}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"dns-controller\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                            \"k8s-app\": \"dns-controller\",\n                            \"version\": \"v1.21.1\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"dns-controller\",\n                                \"image\": \"k8s.gcr.io/kops/dns-controller:1.21.1\",\n                                \"command\": [\n                                    \"/dns-controller\",\n                                    \"--watch-ingress=false\",\n                                    \"--dns=aws-route53\",\n                                    \"--zone=*/ZEMLNXIIWQ0RV\",\n                                    \"--zone=*/*\",\n                                    \"-v=2\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                        \"value\": \"127.0.0.1\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"50m\",\n                                        \"memory\": \"50Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"runAsNonRoot\": true\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"node-role.kubernetes.io/master\": \"\"\n                        },\n                        \"serviceAccountName\": \"dns-controller\",\n                        \"serviceAccount\": \"dns-controller\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                },\n                \"strategy\": {\n                    \"type\": \"Recreate\"\n                },\n                \"revisionHistoryLimit\": 10,\n                \"progressDeadlineSeconds\": 600\n            },\n            \"status\": {\n                \"observedGeneration\": 1,\n                \"replicas\": 1,\n                \"updatedReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"conditions\": [\n                    {\n                        \"type\": \"Available\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-09-21T19:19:00Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:19:00Z\",\n                        \"reason\": \"MinimumReplicasAvailable\",\n                        \"message\": \"Deployment has minimum availability.\"\n                    },\n                    {\n                        \"type\": \"Progressing\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-09-21T19:19:00Z\",\n                        \"lastTransitionTime\": \"2021-09-21T19:18:58Z\",\n                        \"reason\": \"NewReplicaSetAvailable\",\n                        \"message\": \"ReplicaSet \\\"dns-controller-56b8dc9b5b\\\" has successfully progressed.\"\n                    }\n                ]\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"ReplicaSetList\",\n    \"apiVersion\": \"apps/v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"8590\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1c9ad417-a5f6-4fcb-8360-a70ee4ebc3d7\",\n                \"resourceVersion\": \"742\",\n                \"generation\": 2,\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-dns\",\n                    \"pod-template-hash\": \"5dc785954d\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/desired-replicas\": \"2\",\n                    \"deployment.kubernetes.io/max-replicas\": \"3\",\n                    \"deployment.kubernetes.io/revision\": \"1\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"Deployment\",\n                        \"name\": \"coredns\",\n                        \"uid\": \"8285b56d-5e5e-4602-970b-2c8b83b4976d\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"replicas\": 2,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"kube-dns\",\n                        \"pod-template-hash\": \"5dc785954d\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"kube-dns\",\n                            \"pod-template-hash\": \"5dc785954d\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"configMap\": {\n                                    \"name\": \"coredns\",\n                                    \"items\": [\n                                        {\n                                            \"key\": \"Corefile\",\n                                            \"path\": \"Corefile\"\n                                        }\n                                    ],\n                                    \"defaultMode\": 420\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"coredns\",\n                                \"image\": \"k8s.gcr.io/coredns/coredns:v1.8.4\",\n                                \"args\": [\n                                    \"-conf\",\n                                    \"/etc/coredns/Corefile\"\n                                ],\n                                \"ports\": [\n                                    {\n                                        \"name\": \"dns\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"UDP\"\n                                    },\n                                    {\n                                        \"name\": \"dns-tcp\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"TCP\"\n                                    },\n                                    {\n                                        \"name\": \"metrics\",\n                                        \"containerPort\": 9153,\n                                        \"protocol\": \"TCP\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"limits\": {\n                                        \"memory\": \"170Mi\"\n                                    },\n                                    \"requests\": {\n                                        \"cpu\": \"100m\",\n                                        \"memory\": \"70Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"config-volume\",\n                                        \"readOnly\": true,\n                                        \"mountPath\": \"/etc/coredns\"\n                                    }\n                                ],\n                                \"livenessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/health\",\n                                        \"port\": 8080,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"initialDelaySeconds\": 60,\n                                    \"timeoutSeconds\": 5,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 5\n                                },\n                                \"readinessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/ready\",\n                                        \"port\": 8181,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"timeoutSeconds\": 1,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 3\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"capabilities\": {\n                                        \"add\": [\n                                            \"NET_BIND_SERVICE\"\n                                        ],\n                                        \"drop\": [\n                                            \"all\"\n                                        ]\n                                    },\n                                    \"readOnlyRootFilesystem\": true,\n                                    \"allowPrivilegeEscalation\": false\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"kubernetes.io/os\": \"linux\"\n                        },\n                        \"serviceAccountName\": \"coredns\",\n                        \"serviceAccount\": \"coredns\",\n                        \"securityContext\": {},\n                        \"affinity\": {\n                            \"podAntiAffinity\": {\n                                \"preferredDuringSchedulingIgnoredDuringExecution\": [\n                                    {\n                                        \"weight\": 100,\n                                        \"podAffinityTerm\": {\n                                            \"labelSelector\": {\n                                                \"matchExpressions\": [\n                                                    {\n                                                        \"key\": \"k8s-app\",\n                                                        \"operator\": \"In\",\n                                                        \"values\": [\n                                                            \"kube-dns\"\n                                                        ]\n                                                    }\n                                                ]\n                                            },\n                                            \"topologyKey\": \"kubernetes.io/hostname\"\n                                        }\n                                    }\n                                ]\n                            }\n                        },\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                }\n            },\n            \"status\": {\n                \"replicas\": 2,\n                \"fullyLabeledReplicas\": 2,\n                \"readyReplicas\": 2,\n                \"availableReplicas\": 2,\n                \"observedGeneration\": 2\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"10d2bdb4-2e85-442a-904b-4d6b013066ee\",\n                \"resourceVersion\": \"699\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\",\n                \"labels\": {\n                    \"k8s-app\": \"coredns-autoscaler\",\n                    \"pod-template-hash\": \"84d4cfd89c\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/desired-replicas\": \"1\",\n                    \"deployment.kubernetes.io/max-replicas\": \"2\",\n                    \"deployment.kubernetes.io/revision\": \"1\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"Deployment\",\n                        \"name\": \"coredns-autoscaler\",\n                        \"uid\": \"9096fe29-0a44-4c9c-916b-0690235a7c09\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"coredns-autoscaler\",\n                        \"pod-template-hash\": \"84d4cfd89c\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"coredns-autoscaler\",\n                            \"pod-template-hash\": \"84d4cfd89c\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"autoscaler\",\n                                \"image\": \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\",\n                                \"command\": [\n                                    \"/cluster-proportional-autoscaler\",\n                                    \"--namespace=kube-system\",\n                                    \"--configmap=coredns-autoscaler\",\n                                    \"--target=Deployment/coredns\",\n                                    \"--default-params={\\\"linear\\\":{\\\"coresPerReplica\\\":256,\\\"nodesPerReplica\\\":16,\\\"preventSinglePointFailure\\\":true}}\",\n                                    \"--logtostderr=true\",\n                                    \"--v=2\"\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"20m\",\n                                        \"memory\": \"10Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\"\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"ClusterFirst\",\n                        \"nodeSelector\": {\n                            \"kubernetes.io/os\": \"linux\"\n                        },\n                        \"serviceAccountName\": \"coredns-autoscaler\",\n                        \"serviceAccount\": \"coredns-autoscaler\",\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                }\n            },\n            \"status\": {\n                \"replicas\": 1,\n                \"fullyLabeledReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"observedGeneration\": 1\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-56b8dc9b5b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a7b8686c-82d6-45be-b614-8fd0fe5c4913\",\n                \"resourceVersion\": \"458\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\",\n                \"labels\": {\n                    \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                    \"k8s-app\": \"dns-controller\",\n                    \"pod-template-hash\": \"56b8dc9b5b\",\n                    \"version\": \"v1.21.1\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/desired-replicas\": \"1\",\n                    \"deployment.kubernetes.io/max-replicas\": \"1\",\n                    \"deployment.kubernetes.io/revision\": \"1\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"Deployment\",\n                        \"name\": \"dns-controller\",\n                        \"uid\": \"86d3a739-16b7-41c4-a4d8-12bffb3d49cc\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"dns-controller\",\n                        \"pod-template-hash\": \"56b8dc9b5b\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                            \"k8s-app\": \"dns-controller\",\n                            \"pod-template-hash\": \"56b8dc9b5b\",\n                            \"version\": \"v1.21.1\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"dns-controller\",\n                                \"image\": \"k8s.gcr.io/kops/dns-controller:1.21.1\",\n                                \"command\": [\n                                    \"/dns-controller\",\n                                    \"--watch-ingress=false\",\n                                    \"--dns=aws-route53\",\n                                    \"--zone=*/ZEMLNXIIWQ0RV\",\n                                    \"--zone=*/*\",\n                                    \"-v=2\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                        \"value\": \"127.0.0.1\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"50m\",\n                                        \"memory\": \"50Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"runAsNonRoot\": true\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"node-role.kubernetes.io/master\": \"\"\n                        },\n                        \"serviceAccountName\": \"dns-controller\",\n                        \"serviceAccount\": \"dns-controller\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                }\n            },\n            \"status\": {\n                \"replicas\": 1,\n                \"fullyLabeledReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"observedGeneration\": 1\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"PodList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"8596\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-klq65\",\n                \"generateName\": \"coredns-5dc785954d-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b5b3bfe9-520d-4482-bef7-ffb50835171e\",\n                \"resourceVersion\": \"737\",\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-dns\",\n                    \"pod-template-hash\": \"5dc785954d\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"coredns-5dc785954d\",\n                        \"uid\": \"1c9ad417-a5f6-4fcb-8360-a70ee4ebc3d7\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"config-volume\",\n                        \"configMap\": {\n                            \"name\": \"coredns\",\n                            \"items\": [\n                                {\n                                    \"key\": \"Corefile\",\n                                    \"path\": \"Corefile\"\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-v6cxq\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"image\": \"k8s.gcr.io/coredns/coredns:v1.8.4\",\n                        \"args\": [\n                            \"-conf\",\n                            \"/etc/coredns/Corefile\"\n                        ],\n                        \"ports\": [\n                            {\n                                \"name\": \"dns\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"UDP\"\n                            },\n                            {\n                                \"name\": \"dns-tcp\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"TCP\"\n                            },\n                            {\n                                \"name\": \"metrics\",\n                                \"containerPort\": 9153,\n                                \"protocol\": \"TCP\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"170Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"70Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/coredns\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-v6cxq\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/health\",\n                                \"port\": 8080,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 60,\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 5\n                        },\n                        \"readinessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/ready\",\n                                \"port\": 8181,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"timeoutSeconds\": 1,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_BIND_SERVICE\"\n                                ],\n                                \"drop\": [\n                                    \"all\"\n                                ]\n                            },\n                            \"readOnlyRootFilesystem\": true,\n                            \"allowPrivilegeEscalation\": false\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"kubernetes.io/os\": \"linux\"\n                },\n                \"serviceAccountName\": \"coredns\",\n                \"serviceAccount\": \"coredns\",\n                \"nodeName\": \"ip-172-20-63-30.eu-west-3.compute.internal\",\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"podAntiAffinity\": {\n                        \"preferredDuringSchedulingIgnoredDuringExecution\": [\n                            {\n                                \"weight\": 100,\n                                \"podAffinityTerm\": {\n                                    \"labelSelector\": {\n                                        \"matchExpressions\": [\n                                            {\n                                                \"key\": \"k8s-app\",\n                                                \"operator\": \"In\",\n                                                \"values\": [\n                                                    \"kube-dns\"\n                                                ]\n                                            }\n                                        ]\n                                    },\n                                    \"topologyKey\": \"kubernetes.io/hostname\"\n                                }\n                            }\n                        ]\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:12Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:22Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:22Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:12Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.63.30\",\n                \"podIP\": \"100.96.1.2\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"100.96.1.2\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:20:12Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:20:16Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/coredns/coredns:v1.8.4\",\n                        \"imageID\": \"k8s.gcr.io/coredns/coredns@sha256:6e5a02c21641597998b4be7cb5eb1e7b02c0d8d23cce4dd09f4682d463798890\",\n                        \"containerID\": \"containerd://8f8f480d5d0d20725d039fbe8ee4f2bebed28f353bcbaf4e06d612f7f03aaa6b\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-kzbt7\",\n                \"generateName\": \"coredns-5dc785954d-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4e33cecf-2a67-4400-8bd6-9ecf3a3693b8\",\n                \"resourceVersion\": \"719\",\n                \"creationTimestamp\": \"2021-09-21T19:20:15Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-dns\",\n                    \"pod-template-hash\": \"5dc785954d\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"coredns-5dc785954d\",\n                        \"uid\": \"1c9ad417-a5f6-4fcb-8360-a70ee4ebc3d7\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"config-volume\",\n                        \"configMap\": {\n                            \"name\": \"coredns\",\n                            \"items\": [\n                                {\n                                    \"key\": \"Corefile\",\n                                    \"path\": \"Corefile\"\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-25ncb\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"image\": \"k8s.gcr.io/coredns/coredns:v1.8.4\",\n                        \"args\": [\n                            \"-conf\",\n                            \"/etc/coredns/Corefile\"\n                        ],\n                        \"ports\": [\n                            {\n                                \"name\": \"dns\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"UDP\"\n                            },\n                            {\n                                \"name\": \"dns-tcp\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"TCP\"\n                            },\n                            {\n                                \"name\": \"metrics\",\n                                \"containerPort\": 9153,\n                                \"protocol\": \"TCP\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"170Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"70Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/coredns\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-25ncb\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/health\",\n                                \"port\": 8080,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 60,\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 5\n                        },\n                        \"readinessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/ready\",\n                                \"port\": 8181,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"timeoutSeconds\": 1,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_BIND_SERVICE\"\n                                ],\n                                \"drop\": [\n                                    \"all\"\n                                ]\n                            },\n                            \"readOnlyRootFilesystem\": true,\n                            \"allowPrivilegeEscalation\": false\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"kubernetes.io/os\": \"linux\"\n                },\n                \"serviceAccountName\": \"coredns\",\n                \"serviceAccount\": \"coredns\",\n                \"nodeName\": \"ip-172-20-63-30.eu-west-3.compute.internal\",\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"podAntiAffinity\": {\n                        \"preferredDuringSchedulingIgnoredDuringExecution\": [\n                            {\n                                \"weight\": 100,\n                                \"podAffinityTerm\": {\n                                    \"labelSelector\": {\n                                        \"matchExpressions\": [\n                                            {\n                                                \"key\": \"k8s-app\",\n                                                \"operator\": \"In\",\n                                                \"values\": [\n                                                    \"kube-dns\"\n                                                ]\n                                            }\n                                        ]\n                                    },\n                                    \"topologyKey\": \"kubernetes.io/hostname\"\n                                }\n                            }\n                        ]\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:15Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:18Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:18Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:15Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.63.30\",\n                \"podIP\": \"100.96.1.4\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"100.96.1.4\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:20:15Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:20:16Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/coredns/coredns:v1.8.4\",\n                        \"imageID\": \"k8s.gcr.io/coredns/coredns@sha256:6e5a02c21641597998b4be7cb5eb1e7b02c0d8d23cce4dd09f4682d463798890\",\n                        \"containerID\": \"containerd://b3b0c939e011390c3767b1dabeab330484dd4ab8f41ee8720eddf91bb4a6f3a9\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-qxhbx\",\n                \"generateName\": \"coredns-autoscaler-84d4cfd89c-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"125b07b4-d846-4d6f-a627-0f12390f3ee1\",\n                \"resourceVersion\": \"698\",\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\",\n                \"labels\": {\n                    \"k8s-app\": \"coredns-autoscaler\",\n                    \"pod-template-hash\": \"84d4cfd89c\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"coredns-autoscaler-84d4cfd89c\",\n                        \"uid\": \"10d2bdb4-2e85-442a-904b-4d6b013066ee\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"kube-api-access-q5bdm\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"autoscaler\",\n                        \"image\": \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\",\n                        \"command\": [\n                            \"/cluster-proportional-autoscaler\",\n                            \"--namespace=kube-system\",\n                            \"--configmap=coredns-autoscaler\",\n                            \"--target=Deployment/coredns\",\n                            \"--default-params={\\\"linear\\\":{\\\"coresPerReplica\\\":256,\\\"nodesPerReplica\\\":16,\\\"preventSinglePointFailure\\\":true}}\",\n                            \"--logtostderr=true\",\n                            \"--v=2\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"20m\",\n                                \"memory\": \"10Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kube-api-access-q5bdm\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeSelector\": {\n                    \"kubernetes.io/os\": \"linux\"\n                },\n                \"serviceAccountName\": \"coredns-autoscaler\",\n                \"serviceAccount\": \"coredns-autoscaler\",\n                \"nodeName\": \"ip-172-20-63-30.eu-west-3.compute.internal\",\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:12Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:15Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:15Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:12Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.63.30\",\n                \"podIP\": \"100.96.1.3\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"100.96.1.3\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:20:12Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"autoscaler\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:20:14Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\",\n                        \"imageID\": \"k8s.gcr.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def\",\n                        \"containerID\": \"containerd://acbd9c7ff042d22c902ca60f111e04f7d8cf01f91582df4b27c4b22705a76b60\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-56b8dc9b5b-lrmhs\",\n                \"generateName\": \"dns-controller-56b8dc9b5b-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a5f7560c-320a-41fd-9f93-9b886e537195\",\n                \"resourceVersion\": \"457\",\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\",\n                \"labels\": {\n                    \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                    \"k8s-app\": \"dns-controller\",\n                    \"pod-template-hash\": \"56b8dc9b5b\",\n                    \"version\": \"v1.21.1\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"dns-controller-56b8dc9b5b\",\n                        \"uid\": \"a7b8686c-82d6-45be-b614-8fd0fe5c4913\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"kube-api-access-jnnc8\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"dns-controller\",\n                        \"image\": \"k8s.gcr.io/kops/dns-controller:1.21.1\",\n                        \"command\": [\n                            \"/dns-controller\",\n                            \"--watch-ingress=false\",\n                            \"--dns=aws-route53\",\n                            \"--zone=*/ZEMLNXIIWQ0RV\",\n                            \"--zone=*/*\",\n                            \"-v=2\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                \"value\": \"127.0.0.1\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"50m\",\n                                \"memory\": \"50Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kube-api-access-jnnc8\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"runAsNonRoot\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"node-role.kubernetes.io/master\": \"\"\n                },\n                \"serviceAccountName\": \"dns-controller\",\n                \"serviceAccount\": \"dns-controller\",\n                \"nodeName\": \"ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:18:58Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:00Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:00Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:18:58Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.62.185\",\n                \"podIP\": \"172.20.62.185\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.62.185\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:18:58Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"dns-controller\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:19:00Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kops/dns-controller:1.21.1\",\n                        \"imageID\": \"sha256:139e2fb6632308bea5fe08a80df1d7ad896b21481d84b93625bdb23fc9ab0245\",\n                        \"containerID\": \"containerd://daad65b4c7bc6320be3a8079c77615e89da2da58253a3f3f802b5f4440adc81f\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"474d4623-2346-47c6-8628-02b6ffef499e\",\n                \"resourceVersion\": \"548\",\n                \"creationTimestamp\": \"2021-09-21T19:19:33Z\",\n                \"labels\": {\n                    \"k8s-app\": \"etcd-manager-events\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"3f39f5a44154c90f6f8fa3fa40c532e4\",\n                    \"kubernetes.io/config.mirror\": \"3f39f5a44154c90f6f8fa3fa40c532e4\",\n                    \"kubernetes.io/config.seen\": \"2021-09-21T19:17:53.915021123Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-62-185.eu-west-3.compute.internal\",\n                        \"uid\": \"07dcb71a-5c94-4636-82b2-7776773cf542\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"rootfs\",\n                        \"hostPath\": {\n                            \"path\": \"/\",\n                            \"type\": \"Directory\"\n                        }\n                    },\n                    {\n                        \"name\": \"run\",\n                        \"hostPath\": {\n                            \"path\": \"/run\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"pki\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/pki/etcd-manager-events\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"varlogetcd\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/etcd-events.log\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"image\": \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\",\n                        \"command\": [\n                            \"/bin/sh\",\n                            \"-c\",\n                            \"mkfifo /tmp/pipe; (tee -a /var/log/etcd.log \\u003c /tmp/pipe \\u0026 ) ; exec /etcd-manager --backup-store=s3://k8s-kops-prow/e2e-0143302838-62691.test-cncf-aws.k8s.io/backups/etcd/events --client-urls=https://__name__:4002 --cluster-name=etcd-events --containerized=true --dns-suffix=.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io --etcd-insecure=false --grpc-port=3997 --insecure=false --peer-urls=https://__name__:2381 --quarantine-client-urls=https://__name__:3995 --v=6 --volume-name-tag=k8s.io/etcd/events --volume-provider=aws --volume-tag=k8s.io/etcd/events --volume-tag=k8s.io/role/master=1 --volume-tag=kubernetes.io/cluster/e2e-0143302838-62691.test-cncf-aws.k8s.io=owned \\u003e /tmp/pipe 2\\u003e\\u00261\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"rootfs\",\n                                \"mountPath\": \"/rootfs\"\n                            },\n                            {\n                                \"name\": \"run\",\n                                \"mountPath\": \"/run\"\n                            },\n                            {\n                                \"name\": \"pki\",\n                                \"mountPath\": \"/etc/kubernetes/pki/etcd-manager\"\n                            },\n                            {\n                                \"name\": \"varlogetcd\",\n                                \"mountPath\": \"/var/log/etcd.log\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"hostNetwork\": true,\n                \"hostPID\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:17:54Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:18:14Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:18:14Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:17:54Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.62.185\",\n                \"podIP\": \"172.20.62.185\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.62.185\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:17:54Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:18:14Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\",\n                        \"imageID\": \"k8s.gcr.io/etcdadm/etcd-manager@sha256:ebb73d3d4a99da609f9e01c556cd9f9aa7a0aecba8f5bc5588d7c45eb38e3a7e\",\n                        \"containerID\": \"containerd://b4cc97fcd663174b7bc5c48ef3c4ffa9c98b99c1302b1de79511c4338b46daf9\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9dde62fa-4178-4901-aa3a-bd8e395bd181\",\n                \"resourceVersion\": \"520\",\n                \"creationTimestamp\": \"2021-09-21T19:19:20Z\",\n                \"labels\": {\n                    \"k8s-app\": \"etcd-manager-main\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"704ebadffc72f97ea52452140c5b4be7\",\n                    \"kubernetes.io/config.mirror\": \"704ebadffc72f97ea52452140c5b4be7\",\n                    \"kubernetes.io/config.seen\": \"2021-09-21T19:17:53.915009113Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-62-185.eu-west-3.compute.internal\",\n                        \"uid\": \"07dcb71a-5c94-4636-82b2-7776773cf542\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"rootfs\",\n                        \"hostPath\": {\n                            \"path\": \"/\",\n                            \"type\": \"Directory\"\n                        }\n                    },\n                    {\n                        \"name\": \"run\",\n                        \"hostPath\": {\n                            \"path\": \"/run\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"pki\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/pki/etcd-manager-main\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"varlogetcd\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/etcd.log\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"image\": \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\",\n                        \"command\": [\n                            \"/bin/sh\",\n                            \"-c\",\n                            \"mkfifo /tmp/pipe; (tee -a /var/log/etcd.log \\u003c /tmp/pipe \\u0026 ) ; exec /etcd-manager --backup-store=s3://k8s-kops-prow/e2e-0143302838-62691.test-cncf-aws.k8s.io/backups/etcd/main --client-urls=https://__name__:4001 --cluster-name=etcd --containerized=true --dns-suffix=.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io --etcd-insecure=false --grpc-port=3996 --insecure=false --peer-urls=https://__name__:2380 --quarantine-client-urls=https://__name__:3994 --v=6 --volume-name-tag=k8s.io/etcd/main --volume-provider=aws --volume-tag=k8s.io/etcd/main --volume-tag=k8s.io/role/master=1 --volume-tag=kubernetes.io/cluster/e2e-0143302838-62691.test-cncf-aws.k8s.io=owned \\u003e /tmp/pipe 2\\u003e\\u00261\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"200m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"rootfs\",\n                                \"mountPath\": \"/rootfs\"\n                            },\n                            {\n                                \"name\": \"run\",\n                                \"mountPath\": \"/run\"\n                            },\n                            {\n                                \"name\": \"pki\",\n                                \"mountPath\": \"/etc/kubernetes/pki/etcd-manager\"\n                            },\n                            {\n                                \"name\": \"varlogetcd\",\n                                \"mountPath\": \"/var/log/etcd.log\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"hostNetwork\": true,\n                \"hostPID\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:17:54Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:18:14Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:18:14Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:17:54Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.62.185\",\n                \"podIP\": \"172.20.62.185\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.62.185\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:17:54Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:18:14Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\",\n                        \"imageID\": \"k8s.gcr.io/etcdadm/etcd-manager@sha256:ebb73d3d4a99da609f9e01c556cd9f9aa7a0aecba8f5bc5588d7c45eb38e3a7e\",\n                        \"containerID\": \"containerd://616bb9d42e10f01cff4fb7bf6e6d3992a6747485bdc34d80b4eb05ec8108e66a\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-4879k\",\n                \"generateName\": \"kopeio-networking-agent-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3e2ddb00-2484-4f10-90da-34f33f43d337\",\n                \"resourceVersion\": \"648\",\n                \"creationTimestamp\": \"2021-09-21T19:20:04Z\",\n                \"labels\": {\n                    \"controller-revision-hash\": \"5566b449dc\",\n                    \"name\": \"kopeio-networking-agent\",\n                    \"pod-template-generation\": \"1\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\",\n                    \"scheduler.alpha.kubernetes.io/tolerations\": \"[{\\\"key\\\":\\\"CriticalAddonsOnly\\\", \\\"operator\\\":\\\"Exists\\\"}]\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"kopeio-networking-agent\",\n                        \"uid\": \"1c304cee-97ab-4aeb-8bc2-e00cf8ac8269\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"lib-modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-bc7bv\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"networking-agent\",\n                        \"image\": \"kopeio/networking-agent:1.0.20181028\",\n                        \"env\": [\n                            {\n                                \"name\": \"NODE_NAME\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"spec.nodeName\"\n                                    }\n                                }\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"100Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"50m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"lib-modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-bc7bv\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"serviceAccountName\": \"kopeio-networking-agent\",\n                \"serviceAccount\": \"kopeio-networking-agent\",\n                \"nodeName\": \"ip-172-20-63-30.eu-west-3.compute.internal\",\n                \"hostNetwork\": true,\n                \"hostPID\": true,\n                \"hostIPC\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"ip-172-20-63-30.eu-west-3.compute.internal\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:05Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:10Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:10Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:04Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.63.30\",\n                \"podIP\": \"172.20.63.30\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.63.30\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:20:05Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"networking-agent\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:20:09Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"docker.io/kopeio/networking-agent:1.0.20181028\",\n                        \"imageID\": \"docker.io/kopeio/networking-agent@sha256:2d16bdbc3257c42cdc59b05b8fad86653033f19cfafa709f263e93c8f7002932\",\n                        \"containerID\": \"containerd://3de60b5d096bde536b2093d4cfb223e783c156e9e911ff444c80bd2e3d705d7c\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-8rzgd\",\n                \"generateName\": \"kopeio-networking-agent-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6cad91c2-349e-454e-a865-521bfbb5165c\",\n                \"resourceVersion\": \"729\",\n                \"creationTimestamp\": \"2021-09-21T19:20:14Z\",\n                \"labels\": {\n                    \"controller-revision-hash\": \"5566b449dc\",\n                    \"name\": \"kopeio-networking-agent\",\n                    \"pod-template-generation\": \"1\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\",\n                    \"scheduler.alpha.kubernetes.io/tolerations\": \"[{\\\"key\\\":\\\"CriticalAddonsOnly\\\", \\\"operator\\\":\\\"Exists\\\"}]\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"kopeio-networking-agent\",\n                        \"uid\": \"1c304cee-97ab-4aeb-8bc2-e00cf8ac8269\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"lib-modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-bqggp\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"networking-agent\",\n                        \"image\": \"kopeio/networking-agent:1.0.20181028\",\n                        \"env\": [\n                            {\n                                \"name\": \"NODE_NAME\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"spec.nodeName\"\n                                    }\n                                }\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"100Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"50m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"lib-modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-bqggp\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"serviceAccountName\": \"kopeio-networking-agent\",\n                \"serviceAccount\": \"kopeio-networking-agent\",\n                \"nodeName\": \"ip-172-20-53-119.eu-west-3.compute.internal\",\n                \"hostNetwork\": true,\n                \"hostPID\": true,\n                \"hostIPC\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"ip-172-20-53-119.eu-west-3.compute.internal\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:14Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:20Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:20Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:14Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.53.119\",\n                \"podIP\": \"172.20.53.119\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.53.119\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:20:14Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"networking-agent\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:20:19Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"docker.io/kopeio/networking-agent:1.0.20181028\",\n                        \"imageID\": \"docker.io/kopeio/networking-agent@sha256:2d16bdbc3257c42cdc59b05b8fad86653033f19cfafa709f263e93c8f7002932\",\n                        \"containerID\": \"containerd://0f5ebd4fc373d64cbb03a85afb57f8b04cf743dcf6aad8ff2ec4356098f4e9e3\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-jnwrv\",\n                \"generateName\": \"kopeio-networking-agent-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1cb22fbe-83ec-44c6-8f8a-cdfe2e427621\",\n                \"resourceVersion\": \"474\",\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\",\n                \"labels\": {\n                    \"controller-revision-hash\": \"5566b449dc\",\n                    \"name\": \"kopeio-networking-agent\",\n                    \"pod-template-generation\": \"1\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\",\n                    \"scheduler.alpha.kubernetes.io/tolerations\": \"[{\\\"key\\\":\\\"CriticalAddonsOnly\\\", \\\"operator\\\":\\\"Exists\\\"}]\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"kopeio-networking-agent\",\n                        \"uid\": \"1c304cee-97ab-4aeb-8bc2-e00cf8ac8269\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"lib-modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-887p8\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"networking-agent\",\n                        \"image\": \"kopeio/networking-agent:1.0.20181028\",\n                        \"env\": [\n                            {\n                                \"name\": \"NODE_NAME\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"spec.nodeName\"\n                                    }\n                                }\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"100Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"50m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"lib-modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-887p8\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"serviceAccountName\": \"kopeio-networking-agent\",\n                \"serviceAccount\": \"kopeio-networking-agent\",\n                \"nodeName\": \"ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"hostNetwork\": true,\n                \"hostPID\": true,\n                \"hostIPC\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"ip-172-20-62-185.eu-west-3.compute.internal\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:18:58Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:04Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:04Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:18:58Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.62.185\",\n                \"podIP\": \"172.20.62.185\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.62.185\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:18:58Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"networking-agent\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:19:04Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"docker.io/kopeio/networking-agent:1.0.20181028\",\n                        \"imageID\": \"docker.io/kopeio/networking-agent@sha256:2d16bdbc3257c42cdc59b05b8fad86653033f19cfafa709f263e93c8f7002932\",\n                        \"containerID\": \"containerd://e1957d895f918d05facd8a48f64bb2c77a8e3621f2de56d5e54a8ad2c1c87173\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-lj8gw\",\n                \"generateName\": \"kopeio-networking-agent-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b2d7c049-afc8-419c-a3a7-8ac4445a3513\",\n                \"resourceVersion\": \"731\",\n                \"creationTimestamp\": \"2021-09-21T19:20:15Z\",\n                \"labels\": {\n                    \"controller-revision-hash\": \"5566b449dc\",\n                    \"name\": \"kopeio-networking-agent\",\n                    \"pod-template-generation\": \"1\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\",\n                    \"scheduler.alpha.kubernetes.io/tolerations\": \"[{\\\"key\\\":\\\"CriticalAddonsOnly\\\", \\\"operator\\\":\\\"Exists\\\"}]\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"kopeio-networking-agent\",\n                        \"uid\": \"1c304cee-97ab-4aeb-8bc2-e00cf8ac8269\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"lib-modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-54l8g\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"networking-agent\",\n                        \"image\": \"kopeio/networking-agent:1.0.20181028\",\n                        \"env\": [\n                            {\n                                \"name\": \"NODE_NAME\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"spec.nodeName\"\n                                    }\n                                }\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"100Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"50m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"lib-modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-54l8g\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"serviceAccountName\": \"kopeio-networking-agent\",\n                \"serviceAccount\": \"kopeio-networking-agent\",\n                \"nodeName\": \"ip-172-20-35-229.eu-west-3.compute.internal\",\n                \"hostNetwork\": true,\n                \"hostPID\": true,\n                \"hostIPC\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"ip-172-20-35-229.eu-west-3.compute.internal\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:15Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:20Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:20Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:15Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.35.229\",\n                \"podIP\": \"172.20.35.229\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.35.229\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:20:15Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"networking-agent\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:20:19Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"docker.io/kopeio/networking-agent:1.0.20181028\",\n                        \"imageID\": \"docker.io/kopeio/networking-agent@sha256:2d16bdbc3257c42cdc59b05b8fad86653033f19cfafa709f263e93c8f7002932\",\n                        \"containerID\": \"containerd://373fe3a4f3f3f2f09d80019010d176be7655402f951c013f2ab8065152788c83\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kopeio-networking-agent-nj7df\",\n                \"generateName\": \"kopeio-networking-agent-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"30329bcf-cf25-4870-9a28-95b8b9666344\",\n                \"resourceVersion\": \"778\",\n                \"creationTimestamp\": \"2021-09-21T19:20:24Z\",\n                \"labels\": {\n                    \"controller-revision-hash\": \"5566b449dc\",\n                    \"name\": \"kopeio-networking-agent\",\n                    \"pod-template-generation\": \"1\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\",\n                    \"scheduler.alpha.kubernetes.io/tolerations\": \"[{\\\"key\\\":\\\"CriticalAddonsOnly\\\", \\\"operator\\\":\\\"Exists\\\"}]\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"kopeio-networking-agent\",\n                        \"uid\": \"1c304cee-97ab-4aeb-8bc2-e00cf8ac8269\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"lib-modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-pq8hx\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"networking-agent\",\n                        \"image\": \"kopeio/networking-agent:1.0.20181028\",\n                        \"env\": [\n                            {\n                                \"name\": \"NODE_NAME\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"spec.nodeName\"\n                                    }\n                                }\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"100Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"50m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"lib-modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-pq8hx\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"serviceAccountName\": \"kopeio-networking-agent\",\n                \"serviceAccount\": \"kopeio-networking-agent\",\n                \"nodeName\": \"ip-172-20-63-142.eu-west-3.compute.internal\",\n                \"hostNetwork\": true,\n                \"hostPID\": true,\n                \"hostIPC\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"ip-172-20-63-142.eu-west-3.compute.internal\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:24Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:29Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:29Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:20:24Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.63.142\",\n                \"podIP\": \"172.20.63.142\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.63.142\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:20:24Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"networking-agent\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:20:28Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"docker.io/kopeio/networking-agent:1.0.20181028\",\n                        \"imageID\": \"docker.io/kopeio/networking-agent@sha256:2d16bdbc3257c42cdc59b05b8fad86653033f19cfafa709f263e93c8f7002932\",\n                        \"containerID\": \"containerd://e67b60bf04080e4781ff137abfab3b6c894d080bf9aa7e5539a85ee35e249e8e\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-f9lh9\",\n                \"generateName\": \"kops-controller-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"23dc4edb-75f1-421f-920a-bd4ae1be3888\",\n                \"resourceVersion\": \"460\",\n                \"creationTimestamp\": \"2021-09-21T19:18:58Z\",\n                \"labels\": {\n                    \"controller-revision-hash\": \"7f7bf76c46\",\n                    \"k8s-addon\": \"kops-controller.addons.k8s.io\",\n                    \"k8s-app\": \"kops-controller\",\n                    \"pod-template-generation\": \"1\",\n                    \"version\": \"v1.21.1\"\n                },\n                \"annotations\": {\n                    \"dns.alpha.kubernetes.io/internal\": \"kops-controller.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"kops-controller\",\n                        \"uid\": \"6ea43163-7544-4692-9543-bc294ee29a23\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"kops-controller-config\",\n                        \"configMap\": {\n                            \"name\": \"kops-controller\",\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kops-controller-pki\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/kops-controller/\",\n                            \"type\": \"Directory\"\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-xs5nk\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kops-controller\",\n                        \"image\": \"k8s.gcr.io/kops/kops-controller:1.21.1\",\n                        \"command\": [\n                            \"/kops-controller\",\n                            \"--v=2\",\n                            \"--conf=/etc/kubernetes/kops-controller/config/config.yaml\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                \"value\": \"127.0.0.1\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"50m\",\n                                \"memory\": \"50Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kops-controller-config\",\n                                \"mountPath\": \"/etc/kubernetes/kops-controller/config/\"\n                            },\n                            {\n                                \"name\": \"kops-controller-pki\",\n                                \"mountPath\": \"/etc/kubernetes/kops-controller/pki/\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-xs5nk\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"runAsNonRoot\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"kops.k8s.io/kops-controller-pki\": \"\",\n                    \"node-role.kubernetes.io/master\": \"\"\n                },\n                \"serviceAccountName\": \"kops-controller\",\n                \"serviceAccount\": \"kops-controller\",\n                \"nodeName\": \"ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"ip-172-20-62-185.eu-west-3.compute.internal\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"node-role.kubernetes.io/master\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:18:58Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:00Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:00Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:18:58Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.62.185\",\n                \"podIP\": \"172.20.62.185\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.62.185\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:18:58Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kops-controller\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:19:00Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kops/kops-controller:1.21.1\",\n                        \"imageID\": \"sha256:5ee3d8547af7fe2ecb52ab9dae555c04eaf568a7de825a83735f6805735d8494\",\n                        \"containerID\": \"containerd://d129ea607a9bf0b6cb16e089445e761d4d4bd45324076daffd68baba77ad1d71\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2f14f1e0-c9d6-4ded-b252-33967fdc8577\",\n                \"resourceVersion\": \"574\",\n                \"creationTimestamp\": \"2021-09-21T19:19:42Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-apiserver\"\n                },\n                \"annotations\": {\n                    \"dns.alpha.kubernetes.io/external\": \"api.e2e-0143302838-62691.test-cncf-aws.k8s.io\",\n                    \"dns.alpha.kubernetes.io/internal\": \"api.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io\",\n                    \"kubernetes.io/config.hash\": \"728226eea4100ed17ee54aaa09f2a901\",\n                    \"kubernetes.io/config.mirror\": \"728226eea4100ed17ee54aaa09f2a901\",\n                    \"kubernetes.io/config.seen\": \"2021-09-21T19:17:53.915014838Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-62-185.eu-west-3.compute.internal\",\n                        \"uid\": \"07dcb71a-5c94-4636-82b2-7776773cf542\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-apiserver.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcssl\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcpkitls\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/pki/tls\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcpkica-trust\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/pki/ca-trust\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrshareca-certificates\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ca-certificates\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"pki\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/pki/kube-apiserver\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"cloudconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/cloud.config\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"srvkube\",\n                        \"hostPath\": {\n                            \"path\": \"/srv/kubernetes\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"srvsshproxy\",\n                        \"hostPath\": {\n                            \"path\": \"/srv/sshproxy\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"healthcheck-secrets\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/kube-apiserver-healthcheck/secrets\",\n                            \"type\": \"Directory\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-apiserver\",\n                        \"image\": \"k8s.gcr.io/kube-apiserver-amd64:v1.21.5\",\n                        \"command\": [\n                            \"/usr/local/bin/kube-apiserver\"\n                        ],\n                        \"args\": [\n                            \"--allow-privileged=true\",\n                            \"--anonymous-auth=false\",\n                            \"--api-audiences=kubernetes.svc.default\",\n                            \"--apiserver-count=1\",\n                            \"--authorization-mode=Node,RBAC\",\n                            \"--bind-address=0.0.0.0\",\n                            \"--client-ca-file=/srv/kubernetes/ca.crt\",\n                            \"--cloud-config=/etc/kubernetes/cloud.config\",\n                            \"--cloud-provider=aws\",\n                            \"--enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,PersistentVolumeLabel,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,NodeRestriction,ResourceQuota\",\n                            \"--etcd-cafile=/etc/kubernetes/pki/kube-apiserver/etcd-ca.crt\",\n                            \"--etcd-certfile=/etc/kubernetes/pki/kube-apiserver/etcd-client.crt\",\n                            \"--etcd-keyfile=/etc/kubernetes/pki/kube-apiserver/etcd-client.key\",\n                            \"--etcd-servers-overrides=/events#https://127.0.0.1:4002\",\n                            \"--etcd-servers=https://127.0.0.1:4001\",\n                            \"--insecure-port=0\",\n                            \"--kubelet-client-certificate=/srv/kubernetes/kubelet-api.crt\",\n                            \"--kubelet-client-key=/srv/kubernetes/kubelet-api.key\",\n                            \"--kubelet-preferred-address-types=InternalIP,Hostname,ExternalIP\",\n                            \"--proxy-client-cert-file=/srv/kubernetes/apiserver-aggregator.crt\",\n                            \"--proxy-client-key-file=/srv/kubernetes/apiserver-aggregator.key\",\n                            \"--requestheader-allowed-names=aggregator\",\n                            \"--requestheader-client-ca-file=/srv/kubernetes/apiserver-aggregator-ca.crt\",\n                            \"--requestheader-extra-headers-prefix=X-Remote-Extra-\",\n                            \"--requestheader-group-headers=X-Remote-Group\",\n                            \"--requestheader-username-headers=X-Remote-User\",\n                            \"--secure-port=443\",\n                            \"--service-account-issuer=https://api.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io\",\n                            \"--service-account-jwks-uri=https://api.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io/openid/v1/jwks\",\n                            \"--service-account-key-file=/srv/kubernetes/service-account.key\",\n                            \"--service-account-signing-key-file=/srv/kubernetes/service-account.key\",\n                            \"--service-cluster-ip-range=100.64.0.0/13\",\n                            \"--storage-backend=etcd3\",\n                            \"--tls-cert-file=/srv/kubernetes/server.crt\",\n                            \"--tls-private-key-file=/srv/kubernetes/server.key\",\n                            \"--v=2\",\n                            \"--logtostderr=false\",\n                            \"--alsologtostderr\",\n                            \"--log-file=/var/log/kube-apiserver.log\"\n                        ],\n                        \"ports\": [\n                            {\n                                \"name\": \"https\",\n                                \"hostPort\": 443,\n                                \"containerPort\": 443,\n                                \"protocol\": \"TCP\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"150m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-apiserver.log\"\n                            },\n                            {\n                                \"name\": \"etcssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl\"\n                            },\n                            {\n                                \"name\": \"etcpkitls\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/pki/tls\"\n                            },\n                            {\n                                \"name\": \"etcpkica-trust\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/pki/ca-trust\"\n                            },\n                            {\n                                \"name\": \"usrshareca-certificates\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/share/ca-certificates\"\n                            },\n                            {\n                                \"name\": \"pki\",\n                                \"mountPath\": \"/etc/kubernetes/pki/kube-apiserver\"\n                            },\n                            {\n                                \"name\": \"cloudconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/kubernetes/cloud.config\"\n                            },\n                            {\n                                \"name\": \"srvkube\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/srv/kubernetes\"\n                            },\n                            {\n                                \"name\": \"srvsshproxy\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/srv/sshproxy\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 3990,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 45,\n                            \"timeoutSeconds\": 15,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    },\n                    {\n                        \"name\": \"healthcheck\",\n                        \"image\": \"k8s.gcr.io/kops/kube-apiserver-healthcheck:1.21.1\",\n                        \"command\": [\n                            \"/kube-apiserver-healthcheck\"\n                        ],\n                        \"args\": [\n                            \"--ca-cert=/secrets/ca.crt\",\n                            \"--client-cert=/secrets/client.crt\",\n                            \"--client-key=/secrets/client.key\"\n                        ],\n                        \"resources\": {},\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"healthcheck-secrets\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/secrets\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/.kube-apiserver-healthcheck/healthz\",\n                                \"port\": 3990,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 5,\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:17:54Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:18:27Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:18:27Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:17:54Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.62.185\",\n                \"podIP\": \"172.20.62.185\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.62.185\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:17:54Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"healthcheck\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:18:05Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kops/kube-apiserver-healthcheck:1.21.1\",\n                        \"imageID\": \"sha256:c2059b363d16db00edcad94fa99a358bd8869d1f47520ac9c9b33f83574d8b47\",\n                        \"containerID\": \"containerd://c1616aa567d1e67767fab853e2ace16e5e352d69f2cc096442244e4500ec7a31\",\n                        \"started\": true\n                    },\n                    {\n                        \"name\": \"kube-apiserver\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:18:26Z\"\n                            }\n                        },\n                        \"lastState\": {\n                            \"terminated\": {\n                                \"exitCode\": 1,\n                                \"reason\": \"Error\",\n                                \"startedAt\": \"2021-09-21T19:18:05Z\",\n                                \"finishedAt\": \"2021-09-21T19:18:26Z\",\n                                \"containerID\": \"containerd://054a06a3ec7687902953ad185a3d361927bd679cf3e47b8f1cb730e9e64f4e95\"\n                            }\n                        },\n                        \"ready\": true,\n                        \"restartCount\": 1,\n                        \"image\": \"k8s.gcr.io/kube-apiserver-amd64:v1.21.5\",\n                        \"imageID\": \"sha256:7b2ac941d4c3053c5d5b9ccaf9de1eb50c2f086b7f0461ff37d22d26c7ab14e4\",\n                        \"containerID\": \"containerd://5fff0c9930835b6a792294a2d943f7e9dc3964f5df784a0638565d7e4ce88060\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7a095bed-26e5-40d2-8c71-a97b1b222036\",\n                \"resourceVersion\": \"549\",\n                \"creationTimestamp\": \"2021-09-21T19:19:33Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-controller-manager\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"75b2cb9eb9f4586f4b7424ff1abfeef2\",\n                    \"kubernetes.io/config.mirror\": \"75b2cb9eb9f4586f4b7424ff1abfeef2\",\n                    \"kubernetes.io/config.seen\": \"2021-09-21T19:17:53.915016784Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-62-185.eu-west-3.compute.internal\",\n                        \"uid\": \"07dcb71a-5c94-4636-82b2-7776773cf542\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-controller-manager.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcssl\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcpkitls\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/pki/tls\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcpkica-trust\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/pki/ca-trust\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrshareca-certificates\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ca-certificates\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"cloudconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/cloud.config\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"srvkube\",\n                        \"hostPath\": {\n                            \"path\": \"/srv/kubernetes\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"varlibkcm\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-controller-manager\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"volplugins\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kubelet/volumeplugins/\",\n                            \"type\": \"\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-controller-manager\",\n                        \"image\": \"k8s.gcr.io/kube-controller-manager-amd64:v1.21.5\",\n                        \"command\": [\n                            \"/usr/local/bin/kube-controller-manager\"\n                        ],\n                        \"args\": [\n                            \"--allocate-node-cidrs=true\",\n                            \"--attach-detach-reconcile-sync-period=1m0s\",\n                            \"--cloud-config=/etc/kubernetes/cloud.config\",\n                            \"--cloud-provider=aws\",\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--cluster-name=e2e-0143302838-62691.test-cncf-aws.k8s.io\",\n                            \"--cluster-signing-cert-file=/srv/kubernetes/ca.crt\",\n                            \"--cluster-signing-key-file=/srv/kubernetes/ca.key\",\n                            \"--configure-cloud-routes=false\",\n                            \"--flex-volume-plugin-dir=/var/lib/kubelet/volumeplugins/\",\n                            \"--kubeconfig=/var/lib/kube-controller-manager/kubeconfig\",\n                            \"--leader-elect=true\",\n                            \"--root-ca-file=/srv/kubernetes/ca.crt\",\n                            \"--service-account-private-key-file=/srv/kubernetes/service-account.key\",\n                            \"--use-service-account-credentials=true\",\n                            \"--v=2\",\n                            \"--logtostderr=false\",\n                            \"--alsologtostderr\",\n                            \"--log-file=/var/log/kube-controller-manager.log\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-controller-manager.log\"\n                            },\n                            {\n                                \"name\": \"etcssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl\"\n                            },\n                            {\n                                \"name\": \"etcpkitls\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/pki/tls\"\n                            },\n                            {\n                                \"name\": \"etcpkica-trust\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/pki/ca-trust\"\n                            },\n                            {\n                                \"name\": \"usrshareca-certificates\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/share/ca-certificates\"\n                            },\n                            {\n                                \"name\": \"cloudconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/kubernetes/cloud.config\"\n                            },\n                            {\n                                \"name\": \"srvkube\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/srv/kubernetes\"\n                            },\n                            {\n                                \"name\": \"varlibkcm\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-controller-manager\"\n                            },\n                            {\n                                \"name\": \"volplugins\",\n                                \"mountPath\": \"/var/lib/kubelet/volumeplugins/\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 10252,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 15,\n                            \"timeoutSeconds\": 15,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:17:54Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:18:07Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:18:07Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:17:54Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.62.185\",\n                \"podIP\": \"172.20.62.185\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.62.185\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:17:54Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-controller-manager\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:18:05Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kube-controller-manager-amd64:v1.21.5\",\n                        \"imageID\": \"sha256:184ef4d127b40e20fe2fee7bc542de289e083a62e929d07346fc6a643c583659\",\n                        \"containerID\": \"containerd://98d12b309b715ee6be9d84d66ac0089229aa9dea830d8b0095675f6c312deac7\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-35-229.eu-west-3.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"86650b4c-8776-4f4d-85f5-96ea532a7bbc\",\n                \"resourceVersion\": \"828\",\n                \"creationTimestamp\": \"2021-09-21T19:20:39Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-proxy\",\n                    \"tier\": \"node\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"6eda7b7c0f0a8c32f9e5a92044f23c87\",\n                    \"kubernetes.io/config.mirror\": \"6eda7b7c0f0a8c32f9e5a92044f23c87\",\n                    \"kubernetes.io/config.seen\": \"2021-09-21T19:19:14.405437845Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-35-229.eu-west-3.compute.internal\",\n                        \"uid\": \"dfa4ce74-e542-40ac-b12e-3b6358a68cb3\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-proxy.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kubeconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-proxy/kubeconfig\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"ssl-certs-hosts\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ca-certificates\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"iptableslock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"command\": [\n                            \"/usr/local/bin/kube-proxy\"\n                        ],\n                        \"args\": [\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--conntrack-max-per-core=131072\",\n                            \"--hostname-override=ip-172-20-35-229.eu-west-3.compute.internal\",\n                            \"--kubeconfig=/var/lib/kube-proxy/kubeconfig\",\n                            \"--master=https://api.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io\",\n                            \"--oom-score-adj=-998\",\n                            \"--v=2\",\n                            \"--logtostderr=false\",\n                            \"--alsologtostderr\",\n                            \"--log-file=/var/log/kube-proxy.log\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-proxy.log\"\n                            },\n                            {\n                                \"name\": \"kubeconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-proxy/kubeconfig\"\n                            },\n                            {\n                                \"name\": \"modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"ssl-certs-hosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl/certs\"\n                            },\n                            {\n                                \"name\": \"iptableslock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-35-229.eu-west-3.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:14Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:16Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:16Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:14Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.35.229\",\n                \"podIP\": \"172.20.35.229\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.35.229\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:19:14Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:19:16Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"imageID\": \"sha256:e08abd2be7302b7de4cc9d06bc6045be005c870f93065814da1d761980f7218d\",\n                        \"containerID\": \"containerd://45c95e2d8d198d50f91cae1a02da6ff900ab4fef074e07a3777850fdec9e4506\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-53-119.eu-west-3.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3529c230-0f8b-459f-9de9-88ee97320e7c\",\n                \"resourceVersion\": \"793\",\n                \"creationTimestamp\": \"2021-09-21T19:20:33Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-proxy\",\n                    \"tier\": \"node\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"7c4cbd06b2f2e1958f71831c8bedc6e0\",\n                    \"kubernetes.io/config.mirror\": \"7c4cbd06b2f2e1958f71831c8bedc6e0\",\n                    \"kubernetes.io/config.seen\": \"2021-09-21T19:19:13.900303610Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-53-119.eu-west-3.compute.internal\",\n                        \"uid\": \"39a653bb-7f20-4ce8-a4f7-dc2df949e352\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-proxy.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kubeconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-proxy/kubeconfig\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"ssl-certs-hosts\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ca-certificates\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"iptableslock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"command\": [\n                            \"/usr/local/bin/kube-proxy\"\n                        ],\n                        \"args\": [\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--conntrack-max-per-core=131072\",\n                            \"--hostname-override=ip-172-20-53-119.eu-west-3.compute.internal\",\n                            \"--kubeconfig=/var/lib/kube-proxy/kubeconfig\",\n                            \"--master=https://api.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io\",\n                            \"--oom-score-adj=-998\",\n                            \"--v=2\",\n                            \"--logtostderr=false\",\n                            \"--alsologtostderr\",\n                            \"--log-file=/var/log/kube-proxy.log\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-proxy.log\"\n                            },\n                            {\n                                \"name\": \"kubeconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-proxy/kubeconfig\"\n                            },\n                            {\n                                \"name\": \"modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"ssl-certs-hosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl/certs\"\n                            },\n                            {\n                                \"name\": \"iptableslock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-53-119.eu-west-3.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:14Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:16Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:16Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:14Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.53.119\",\n                \"podIP\": \"172.20.53.119\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.53.119\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:19:14Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:19:15Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"imageID\": \"sha256:e08abd2be7302b7de4cc9d06bc6045be005c870f93065814da1d761980f7218d\",\n                        \"containerID\": \"containerd://5ed380205324b6a0380ed80262540c44ab57df7d2f81ff8684520d1aac44e3dc\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"638c987a-2466-495f-947f-7fb0a84e45ae\",\n                \"resourceVersion\": \"575\",\n                \"creationTimestamp\": \"2021-09-21T19:19:38Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-proxy\",\n                    \"tier\": \"node\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"1b0052e7d7cb290a7d6434e19beaada0\",\n                    \"kubernetes.io/config.mirror\": \"1b0052e7d7cb290a7d6434e19beaada0\",\n                    \"kubernetes.io/config.seen\": \"2021-09-21T19:17:53.915018289Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-62-185.eu-west-3.compute.internal\",\n                        \"uid\": \"07dcb71a-5c94-4636-82b2-7776773cf542\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-proxy.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kubeconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-proxy/kubeconfig\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"ssl-certs-hosts\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ca-certificates\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"iptableslock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"command\": [\n                            \"/usr/local/bin/kube-proxy\"\n                        ],\n                        \"args\": [\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--conntrack-max-per-core=131072\",\n                            \"--hostname-override=ip-172-20-62-185.eu-west-3.compute.internal\",\n                            \"--kubeconfig=/var/lib/kube-proxy/kubeconfig\",\n                            \"--master=https://127.0.0.1\",\n                            \"--oom-score-adj=-998\",\n                            \"--v=2\",\n                            \"--logtostderr=false\",\n                            \"--alsologtostderr\",\n                            \"--log-file=/var/log/kube-proxy.log\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-proxy.log\"\n                            },\n                            {\n                                \"name\": \"kubeconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-proxy/kubeconfig\"\n                            },\n                            {\n                                \"name\": \"modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"ssl-certs-hosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl/certs\"\n                            },\n                            {\n                                \"name\": \"iptableslock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:17:54Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:18:07Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:18:07Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:17:54Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.62.185\",\n                \"podIP\": \"172.20.62.185\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.62.185\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:17:54Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:18:05Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"imageID\": \"sha256:e08abd2be7302b7de4cc9d06bc6045be005c870f93065814da1d761980f7218d\",\n                        \"containerID\": \"containerd://a9b9312c46af65f126637846ee4851a60b0b309657023ca02e08b7a5c19f3879\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-63-142.eu-west-3.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8d631f15-d3e6-492c-8a30-01bd40e4e69d\",\n                \"resourceVersion\": \"854\",\n                \"creationTimestamp\": \"2021-09-21T19:20:44Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-proxy\",\n                    \"tier\": \"node\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"71f2152ee0fbb3739ee565878e515c69\",\n                    \"kubernetes.io/config.mirror\": \"71f2152ee0fbb3739ee565878e515c69\",\n                    \"kubernetes.io/config.seen\": \"2021-09-21T19:19:23.443670955Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-63-142.eu-west-3.compute.internal\",\n                        \"uid\": \"7a06a2f4-9679-424c-8a1d-da9d651eabfc\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-proxy.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kubeconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-proxy/kubeconfig\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"ssl-certs-hosts\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ca-certificates\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"iptableslock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"command\": [\n                            \"/usr/local/bin/kube-proxy\"\n                        ],\n                        \"args\": [\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--conntrack-max-per-core=131072\",\n                            \"--hostname-override=ip-172-20-63-142.eu-west-3.compute.internal\",\n                            \"--kubeconfig=/var/lib/kube-proxy/kubeconfig\",\n                            \"--master=https://api.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io\",\n                            \"--oom-score-adj=-998\",\n                            \"--v=2\",\n                            \"--logtostderr=false\",\n                            \"--alsologtostderr\",\n                            \"--log-file=/var/log/kube-proxy.log\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-proxy.log\"\n                            },\n                            {\n                                \"name\": \"kubeconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-proxy/kubeconfig\"\n                            },\n                            {\n                                \"name\": \"modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"ssl-certs-hosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl/certs\"\n                            },\n                            {\n                                \"name\": \"iptableslock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-63-142.eu-west-3.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:23Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:25Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:25Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:23Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.63.142\",\n                \"podIP\": \"172.20.63.142\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.63.142\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:19:23Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:19:25Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"imageID\": \"sha256:e08abd2be7302b7de4cc9d06bc6045be005c870f93065814da1d761980f7218d\",\n                        \"containerID\": \"containerd://736d4e8436fbee7cc6c30a7eaa157f92b4e8126d99dbb37f1760db81d94819d0\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-63-30.eu-west-3.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"42143806-2417-4129-affd-beed8814b281\",\n                \"resourceVersion\": \"823\",\n                \"creationTimestamp\": \"2021-09-21T19:20:40Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-proxy\",\n                    \"tier\": \"node\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"5d9b5f87a09b018070f79be4170122e9\",\n                    \"kubernetes.io/config.mirror\": \"5d9b5f87a09b018070f79be4170122e9\",\n                    \"kubernetes.io/config.seen\": \"2021-09-21T19:19:33.403613450Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-63-30.eu-west-3.compute.internal\",\n                        \"uid\": \"21374694-2e93-4ccc-bfef-5868d0d7cc5e\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-proxy.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kubeconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-proxy/kubeconfig\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"ssl-certs-hosts\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ca-certificates\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"iptableslock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"command\": [\n                            \"/usr/local/bin/kube-proxy\"\n                        ],\n                        \"args\": [\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--conntrack-max-per-core=131072\",\n                            \"--hostname-override=ip-172-20-63-30.eu-west-3.compute.internal\",\n                            \"--kubeconfig=/var/lib/kube-proxy/kubeconfig\",\n                            \"--master=https://api.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io\",\n                            \"--oom-score-adj=-998\",\n                            \"--v=2\",\n                            \"--logtostderr=false\",\n                            \"--alsologtostderr\",\n                            \"--log-file=/var/log/kube-proxy.log\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-proxy.log\"\n                            },\n                            {\n                                \"name\": \"kubeconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-proxy/kubeconfig\"\n                            },\n                            {\n                                \"name\": \"modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"ssl-certs-hosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl/certs\"\n                            },\n                            {\n                                \"name\": \"iptableslock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-63-30.eu-west-3.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:33Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:35Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:35Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:19:33Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.63.30\",\n                \"podIP\": \"172.20.63.30\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.63.30\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:19:33Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:19:34Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"imageID\": \"sha256:e08abd2be7302b7de4cc9d06bc6045be005c870f93065814da1d761980f7218d\",\n                        \"containerID\": \"containerd://35b698c56d634d2e0e48a1a2c1c6e0d081838798fbe9d079d0b3fbd470197ab7\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"bdbf9ccc-543e-4977-9944-46e54fceff31\",\n                \"resourceVersion\": \"547\",\n                \"creationTimestamp\": \"2021-09-21T19:19:31Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-scheduler\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"68cec326f2ffb274c7e25dda5007bb91\",\n                    \"kubernetes.io/config.mirror\": \"68cec326f2ffb274c7e25dda5007bb91\",\n                    \"kubernetes.io/config.seen\": \"2021-09-21T19:17:53.915019473Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-62-185.eu-west-3.compute.internal\",\n                        \"uid\": \"07dcb71a-5c94-4636-82b2-7776773cf542\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"varlibkubescheduler\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-scheduler\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-scheduler.log\",\n                            \"type\": \"\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-scheduler\",\n                        \"image\": \"k8s.gcr.io/kube-scheduler-amd64:v1.21.5\",\n                        \"command\": [\n                            \"/usr/local/bin/kube-scheduler\"\n                        ],\n                        \"args\": [\n                            \"--config=/var/lib/kube-scheduler/config.yaml\",\n                            \"--leader-elect=true\",\n                            \"--v=2\",\n                            \"--logtostderr=false\",\n                            \"--alsologtostderr\",\n                            \"--log-file=/var/log/kube-scheduler.log\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"varlibkubescheduler\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-scheduler\"\n                            },\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-scheduler.log\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 10251,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 15,\n                            \"timeoutSeconds\": 15,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-62-185.eu-west-3.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:17:54Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:18:07Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:18:07Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-21T19:17:54Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.62.185\",\n                \"podIP\": \"172.20.62.185\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.62.185\"\n                    }\n                ],\n                \"startTime\": \"2021-09-21T19:17:54Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-scheduler\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-21T19:18:05Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kube-scheduler-amd64:v1.21.5\",\n                        \"imageID\": \"sha256:8e60ea3644d6dd6c1ed564f36ab9ef7bf19bfde909a5dcc4d974ac21ea1b3b3e\",\n                        \"containerID\": \"containerd://2285e0a8259b70bc2dab140021614e0f315279620a64e198db21e3337da59e20\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        }\n    ]\n}\n==== START logs for container coredns of pod kube-system/coredns-5dc785954d-klq65 ====\n[INFO] plugin/ready: Still waiting on: \"kubernetes\"\n.:53\n[INFO] plugin/reload: Running configuration MD5 = 9e3e34ac93d9bb69126337d32f1195e3\nCoreDNS-1.8.4\nlinux/amd64, go1.16.4, 053c4d5\n==== END logs for container coredns of pod kube-system/coredns-5dc785954d-klq65 ====\n==== START logs for container coredns of pod kube-system/coredns-5dc785954d-kzbt7 ====\n.:53\n[INFO] plugin/reload: Running configuration MD5 = 9e3e34ac93d9bb69126337d32f1195e3\nCoreDNS-1.8.4\nlinux/amd64, go1.16.4, 053c4d5\n==== END logs for container coredns of pod kube-system/coredns-5dc785954d-kzbt7 ====\n==== START logs for container autoscaler of pod kube-system/coredns-autoscaler-84d4cfd89c-qxhbx ====\nI0921 19:20:14.927817       1 autoscaler.go:49] Scaling Namespace: kube-system, Target: deployment/coredns\nI0921 19:20:15.182160       1 autoscaler_server.go:157] ConfigMap not found: configmaps \"coredns-autoscaler\" not found, will create one with default params\nI0921 19:20:15.184065       1 k8sclient.go:147] Created ConfigMap coredns-autoscaler in namespace kube-system\nI0921 19:20:15.184132       1 plugin.go:50] Set control mode to linear\nI0921 19:20:15.184154       1 linear_controller.go:60] ConfigMap version change (old:  new: 675) - rebuilding params\nI0921 19:20:15.184170       1 linear_controller.go:61] Params from apiserver: \n{\"coresPerReplica\":256,\"nodesPerReplica\":16,\"preventSinglePointFailure\":true}\nI0921 19:20:15.184251       1 linear_controller.go:80] Defaulting min replicas count to 1 for linear controller\nI0921 19:20:15.186500       1 k8sclient.go:272] Cluster status: SchedulableNodes[3], SchedulableCores[6]\nI0921 19:20:15.186517       1 k8sclient.go:273] Replicas are not as expected : updating replicas from 1 to 2\n==== END logs for container autoscaler of pod kube-system/coredns-autoscaler-84d4cfd89c-qxhbx ====\n==== START logs for container dns-controller of pod kube-system/dns-controller-56b8dc9b5b-lrmhs ====\ndns-controller version 0.1\nI0921 19:19:00.527047       1 main.go:199] initializing the watch controllers, namespace: \"\"\nI0921 19:19:00.527238       1 main.go:223] Ingress controller disabled\nI0921 19:19:00.527992       1 node.go:60] starting node controller\nI0921 19:19:00.528059       1 dnscontroller.go:108] starting DNS controller\nI0921 19:19:00.530297       1 pod.go:60] starting pod controller\nI0921 19:19:00.533233       1 service.go:60] starting service controller\nI0921 19:19:00.533234       1 dnscontroller.go:170] scope not yet ready: service\nI0921 19:19:00.567628       1 dnscontroller.go:625] Update desired state: node/ip-172-20-62-185.eu-west-3.compute.internal: [{A node/ip-172-20-62-185.eu-west-3.compute.internal/internal 172.20.62.185 true} {A node/ip-172-20-62-185.eu-west-3.compute.internal/external 35.180.65.195 true} {A node/role=master/internal 172.20.62.185 true} {A node/role=master/external 35.180.65.195 true} {A node/role=master/ ip-172-20-62-185.eu-west-3.compute.internal true} {A node/role=master/ ip-172-20-62-185.eu-west-3.compute.internal true} {A node/role=master/ ec2-35-180-65-195.eu-west-3.compute.amazonaws.com true}]\nI0921 19:19:00.573066       1 dnscontroller.go:625] Update desired state: pod/kube-system/kops-controller-f9lh9: [{A kops-controller.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io. 172.20.62.185 false}]\nI0921 19:19:05.534199       1 dnscache.go:74] querying all DNS zones (no cached results)\nI0921 19:19:05.994135       1 dnscontroller.go:274] Using default TTL of 1m0s\nI0921 19:19:05.994162       1 dnscontroller.go:482] Querying all dnsprovider records for zone \"test-cncf-aws.k8s.io.\"\nI0921 19:19:07.707993       1 dnscontroller.go:585] Adding DNS changes to batch {A kops-controller.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io.} [172.20.62.185]\nI0921 19:19:07.708030       1 dnscontroller.go:323] Applying DNS changeset for zone test-cncf-aws.k8s.io.::ZEMLNXIIWQ0RV\nI0921 19:19:42.043777       1 dnscontroller.go:625] Update desired state: pod/kube-system/kube-apiserver-ip-172-20-62-185.eu-west-3.compute.internal: [{_alias api.e2e-0143302838-62691.test-cncf-aws.k8s.io. node/ip-172-20-62-185.eu-west-3.compute.internal/external false}]\nI0921 19:19:42.930510       1 dnscontroller.go:274] Using default TTL of 1m0s\nI0921 19:19:42.930562       1 dnscontroller.go:482] Querying all dnsprovider records for zone \"test-cncf-aws.k8s.io.\"\nI0921 19:19:44.048794       1 dnscontroller.go:625] Update desired state: pod/kube-system/kube-apiserver-ip-172-20-62-185.eu-west-3.compute.internal: [{_alias api.e2e-0143302838-62691.test-cncf-aws.k8s.io. node/ip-172-20-62-185.eu-west-3.compute.internal/external false} {A api.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io. 172.20.62.185 false}]\nI0921 19:19:44.916281       1 dnscontroller.go:585] Adding DNS changes to batch {A api.e2e-0143302838-62691.test-cncf-aws.k8s.io.} [35.180.65.195]\nI0921 19:19:44.916314       1 dnscontroller.go:323] Applying DNS changeset for zone test-cncf-aws.k8s.io.::ZEMLNXIIWQ0RV\nI0921 19:19:50.076782       1 dnscontroller.go:274] Using default TTL of 1m0s\nI0921 19:19:50.076833       1 dnscontroller.go:482] Querying all dnsprovider records for zone \"test-cncf-aws.k8s.io.\"\nI0921 19:19:52.149795       1 dnscontroller.go:585] Adding DNS changes to batch {A api.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io.} [172.20.62.185]\nI0921 19:19:52.149830       1 dnscontroller.go:323] Applying DNS changeset for zone test-cncf-aws.k8s.io.::ZEMLNXIIWQ0RV\nI0921 19:20:04.313117       1 dnscontroller.go:625] Update desired state: node/ip-172-20-63-30.eu-west-3.compute.internal: [{A node/ip-172-20-63-30.eu-west-3.compute.internal/internal 172.20.63.30 true} {A node/ip-172-20-63-30.eu-west-3.compute.internal/external 52.47.131.46 true} {A node/role=node/internal 172.20.63.30 true} {A node/role=node/external 52.47.131.46 true} {A node/role=node/ ip-172-20-63-30.eu-west-3.compute.internal true} {A node/role=node/ ip-172-20-63-30.eu-west-3.compute.internal true} {A node/role=node/ ec2-52-47-131-46.eu-west-3.compute.amazonaws.com true}]\nI0921 19:20:14.696049       1 dnscontroller.go:625] Update desired state: node/ip-172-20-53-119.eu-west-3.compute.internal: [{A node/ip-172-20-53-119.eu-west-3.compute.internal/internal 172.20.53.119 true} {A node/ip-172-20-53-119.eu-west-3.compute.internal/external 35.180.193.1 true} {A node/role=node/internal 172.20.53.119 true} {A node/role=node/external 35.180.193.1 true} {A node/role=node/ ip-172-20-53-119.eu-west-3.compute.internal true} {A node/role=node/ ip-172-20-53-119.eu-west-3.compute.internal true} {A node/role=node/ ec2-35-180-193-1.eu-west-3.compute.amazonaws.com true}]\nI0921 19:20:15.204645       1 dnscontroller.go:625] Update desired state: node/ip-172-20-35-229.eu-west-3.compute.internal: [{A node/ip-172-20-35-229.eu-west-3.compute.internal/internal 172.20.35.229 true} {A node/ip-172-20-35-229.eu-west-3.compute.internal/external 35.180.166.34 true} {A node/role=node/internal 172.20.35.229 true} {A node/role=node/external 35.180.166.34 true} {A node/role=node/ ip-172-20-35-229.eu-west-3.compute.internal true} {A node/role=node/ ip-172-20-35-229.eu-west-3.compute.internal true} {A node/role=node/ ec2-35-180-166-34.eu-west-3.compute.amazonaws.com true}]\nI0921 19:20:24.238869       1 dnscontroller.go:625] Update desired state: node/ip-172-20-63-142.eu-west-3.compute.internal: [{A node/ip-172-20-63-142.eu-west-3.compute.internal/internal 172.20.63.142 true} {A node/ip-172-20-63-142.eu-west-3.compute.internal/external 15.237.72.135 true} {A node/role=node/internal 172.20.63.142 true} {A node/role=node/external 15.237.72.135 true} {A node/role=node/ ip-172-20-63-142.eu-west-3.compute.internal true} {A node/role=node/ ip-172-20-63-142.eu-west-3.compute.internal true} {A node/role=node/ ec2-15-237-72-135.eu-west-3.compute.amazonaws.com true}]\n==== END logs for container dns-controller of pod kube-system/dns-controller-56b8dc9b5b-lrmhs ====\n==== START logs for container etcd-manager of pod kube-system/etcd-manager-events-ip-172-20-62-185.eu-west-3.compute.internal ====\netcd-manager\nI0921 19:18:14.759581    4024 volumes.go:86] AWS API Request: ec2metadata/GetToken\nI0921 19:18:14.761490    4024 volumes.go:86] AWS API Request: ec2metadata/GetDynamicData\nI0921 19:18:14.762126    4024 volumes.go:86] AWS API Request: ec2metadata/GetMetadata\nI0921 19:18:14.762764    4024 volumes.go:86] AWS API Request: ec2metadata/GetMetadata\nI0921 19:18:14.763533    4024 volumes.go:86] AWS API Request: ec2metadata/GetMetadata\nI0921 19:18:14.764058    4024 main.go:305] Mounting available etcd volumes matching tags [k8s.io/etcd/events k8s.io/role/master=1 kubernetes.io/cluster/e2e-0143302838-62691.test-cncf-aws.k8s.io=owned]; nameTag=k8s.io/etcd/events\nI0921 19:18:14.766156    4024 volumes.go:86] AWS API Request: ec2/DescribeVolumes\nI0921 19:18:14.892033    4024 mounter.go:304] Trying to mount master volume: \"vol-04e970008c9a0f2be\"\nI0921 19:18:14.892049    4024 volumes.go:331] Trying to attach volume \"vol-04e970008c9a0f2be\" at \"/dev/xvdu\"\nI0921 19:18:14.892167    4024 volumes.go:86] AWS API Request: ec2/AttachVolume\nW0921 19:18:15.145659    4024 volumes.go:343] Invalid value '/dev/xvdu' for unixDevice. Attachment point /dev/xvdu is already in use\nI0921 19:18:15.145698    4024 volumes.go:331] Trying to attach volume \"vol-04e970008c9a0f2be\" at \"/dev/xvdv\"\nI0921 19:18:15.145831    4024 volumes.go:86] AWS API Request: ec2/AttachVolume\nI0921 19:18:15.532387    4024 volumes.go:349] AttachVolume request returned {\n  AttachTime: 2021-09-21 19:18:15.526 +0000 UTC,\n  Device: \"/dev/xvdv\",\n  InstanceId: \"i-0eed6b41e0e97a1c5\",\n  State: \"attaching\",\n  VolumeId: \"vol-04e970008c9a0f2be\"\n}\nI0921 19:18:15.532548    4024 volumes.go:86] AWS API Request: ec2/DescribeVolumes\nI0921 19:18:15.657544    4024 mounter.go:318] Currently attached volumes: [0xc0002f2080]\nI0921 19:18:15.657561    4024 mounter.go:72] Master volume \"vol-04e970008c9a0f2be\" is attached at \"/dev/xvdv\"\nI0921 19:18:15.657578    4024 mounter.go:86] Doing safe-format-and-mount of /dev/xvdv to /mnt/master-vol-04e970008c9a0f2be\nI0921 19:18:15.657595    4024 volumes.go:234] volume vol-04e970008c9a0f2be not mounted at /rootfs/dev/xvdv\nI0921 19:18:15.657621    4024 volumes.go:263] nvme path not found \"/rootfs/dev/disk/by-id/nvme-Amazon_Elastic_Block_Store_vol04e970008c9a0f2be\"\nI0921 19:18:15.657634    4024 volumes.go:251] volume vol-04e970008c9a0f2be not mounted at nvme-Amazon_Elastic_Block_Store_vol04e970008c9a0f2be\nI0921 19:18:15.657639    4024 mounter.go:121] Waiting for volume \"vol-04e970008c9a0f2be\" to be mounted\nI0921 19:18:16.657737    4024 volumes.go:234] volume vol-04e970008c9a0f2be not mounted at /rootfs/dev/xvdv\nI0921 19:18:16.657785    4024 volumes.go:263] nvme path not found \"/rootfs/dev/disk/by-id/nvme-Amazon_Elastic_Block_Store_vol04e970008c9a0f2be\"\nI0921 19:18:16.657795    4024 volumes.go:251] volume vol-04e970008c9a0f2be not mounted at nvme-Amazon_Elastic_Block_Store_vol04e970008c9a0f2be\nI0921 19:18:16.657801    4024 mounter.go:121] Waiting for volume \"vol-04e970008c9a0f2be\" to be mounted\nI0921 19:18:17.658314    4024 mounter.go:125] Found volume \"vol-04e970008c9a0f2be\" mounted at device \"/dev/xvdv\"\nI0921 19:18:17.660050    4024 mounter.go:171] Creating mount directory \"/rootfs/mnt/master-vol-04e970008c9a0f2be\"\nI0921 19:18:17.660264    4024 mounter.go:176] Mounting device \"/dev/xvdv\" on \"/mnt/master-vol-04e970008c9a0f2be\"\nI0921 19:18:17.660293    4024 mount_linux.go:446] Attempting to determine if disk \"/dev/xvdv\" is formatted using blkid with args: ([-p -s TYPE -s PTTYPE -o export /dev/xvdv])\nI0921 19:18:17.660336    4024 nsenter.go:132] Running nsenter command: nsenter [--mount=/rootfs/proc/1/ns/mnt -- blkid -p -s TYPE -s PTTYPE -o export /dev/xvdv]\nI0921 19:18:17.688229    4024 mount_linux.go:449] Output: \"\"\nI0921 19:18:17.688249    4024 mount_linux.go:408] Disk \"/dev/xvdv\" appears to be unformatted, attempting to format as type: \"ext4\" with options: [-F -m0 /dev/xvdv]\nI0921 19:18:17.688263    4024 nsenter.go:132] Running nsenter command: nsenter [--mount=/rootfs/proc/1/ns/mnt -- mkfs.ext4 -F -m0 /dev/xvdv]\nI0921 19:18:17.959987    4024 mount_linux.go:418] Disk successfully formatted (mkfs): ext4 - /dev/xvdv /mnt/master-vol-04e970008c9a0f2be\nI0921 19:18:17.960003    4024 mount_linux.go:436] Attempting to mount disk /dev/xvdv in ext4 format at /mnt/master-vol-04e970008c9a0f2be\nI0921 19:18:17.960017    4024 nsenter.go:80] nsenter mount /dev/xvdv /mnt/master-vol-04e970008c9a0f2be ext4 [defaults]\nI0921 19:18:17.960047    4024 nsenter.go:132] Running nsenter command: nsenter [--mount=/rootfs/proc/1/ns/mnt -- /bin/systemd-run --description=Kubernetes transient mount for /mnt/master-vol-04e970008c9a0f2be --scope -- /bin/mount -t ext4 -o defaults /dev/xvdv /mnt/master-vol-04e970008c9a0f2be]\nI0921 19:18:17.990283    4024 nsenter.go:84] Output of mounting /dev/xvdv to /mnt/master-vol-04e970008c9a0f2be: Running scope as unit: run-r351c63bac8de4d2584020455b1559170.scope\nI0921 19:18:17.990304    4024 mount_linux.go:446] Attempting to determine if disk \"/dev/xvdv\" is formatted using blkid with args: ([-p -s TYPE -s PTTYPE -o export /dev/xvdv])\nI0921 19:18:17.990335    4024 nsenter.go:132] Running nsenter command: nsenter [--mount=/rootfs/proc/1/ns/mnt -- blkid -p -s TYPE -s PTTYPE -o export /dev/xvdv]\nI0921 19:18:18.002024    4024 mount_linux.go:449] Output: \"DEVNAME=/dev/xvdv\\nTYPE=ext4\\n\"\nI0921 19:18:18.002043    4024 resizefs_linux.go:53] ResizeFS.Resize - Expanding mounted volume /dev/xvdv\nI0921 19:18:18.002058    4024 nsenter.go:132] Running nsenter command: nsenter [--mount=/rootfs/proc/1/ns/mnt -- resize2fs /dev/xvdv]\nI0921 19:18:18.013636    4024 resizefs_linux.go:68] Device /dev/xvdv resized successfully\nI0921 19:18:18.036317    4024 mount_linux.go:206] Detected OS with systemd\nI0921 19:18:18.038527    4024 mounter.go:224] mounting inside container: /rootfs/dev/xvdv -> /rootfs/mnt/master-vol-04e970008c9a0f2be\nI0921 19:18:18.038611    4024 mount_linux.go:175] Mounting cmd (systemd-run) with arguments (--description=Kubernetes transient mount for /rootfs/mnt/master-vol-04e970008c9a0f2be --scope -- mount  /rootfs/dev/xvdv /rootfs/mnt/master-vol-04e970008c9a0f2be)\nI0921 19:18:18.061861    4024 mounter.go:94] mounted master volume \"vol-04e970008c9a0f2be\" on /mnt/master-vol-04e970008c9a0f2be\nI0921 19:18:18.061882    4024 main.go:320] discovered IP address: 172.20.62.185\nI0921 19:18:18.061888    4024 main.go:325] Setting data dir to /rootfs/mnt/master-vol-04e970008c9a0f2be\nI0921 19:18:18.151623    4024 certs.go:183] generating certificate for \"etcd-manager-server-etcd-events-a\"\nI0921 19:18:18.344506    4024 certs.go:183] generating certificate for \"etcd-manager-client-etcd-events-a\"\nI0921 19:18:18.349706    4024 server.go:87] starting GRPC server using TLS, ServerName=\"etcd-manager-server-etcd-events-a\"\nI0921 19:18:18.350120    4024 main.go:474] peerClientIPs: [172.20.62.185]\nI0921 19:18:18.583912    4024 certs.go:183] generating certificate for \"etcd-manager-etcd-events-a\"\nI0921 19:18:18.585841    4024 server.go:105] GRPC server listening on \"172.20.62.185:3997\"\nI0921 19:18:18.586278    4024 volumes.go:86] AWS API Request: ec2/DescribeVolumes\nI0921 19:18:18.670467    4024 volumes.go:86] AWS API Request: ec2/DescribeInstances\nI0921 19:18:18.709464    4024 peers.go:115] found new candidate peer from discovery: etcd-events-a [{172.20.62.185 0} {172.20.62.185 0}]\nI0921 19:18:18.709498    4024 hosts.go:84] hosts update: primary=map[], fallbacks=map[etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:[172.20.62.185 172.20.62.185]], final=map[172.20.62.185:[etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io]]\nI0921 19:18:18.709655    4024 peers.go:295] connecting to peer \"etcd-events-a\" with TLS policy, servername=\"etcd-manager-server-etcd-events-a\"\nI0921 19:18:20.585959    4024 controller.go:189] starting controller iteration\nI0921 19:18:20.586338    4024 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.62.185:3997\" > leadership_token:\"lnnEnocc4uxu9iAVHN7svg\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.62.185:3997\" > > \nI0921 19:18:20.586516    4024 commands.go:41] refreshing commands\nI0921 19:18:20.586605    4024 s3context.go:334] product_uuid is \"ec254358-d1d5-53fc-2b62-f3d33bdd8b18\", assuming running on EC2\nI0921 19:18:20.587806    4024 s3context.go:166] got region from metadata: \"eu-west-3\"\nI0921 19:18:20.620431    4024 s3context.go:213] found bucket in region \"us-west-1\"\nI0921 19:18:21.290444    4024 vfs.go:120] listed commands in s3://k8s-kops-prow/e2e-0143302838-62691.test-cncf-aws.k8s.io/backups/etcd/events/control: 0 commands\nI0921 19:18:21.290467    4024 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-0143302838-62691.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-spec\"\nI0921 19:18:31.451336    4024 controller.go:189] starting controller iteration\nI0921 19:18:31.451364    4024 controller.go:266] Broadcasting leadership assertion with token \"lnnEnocc4uxu9iAVHN7svg\"\nI0921 19:18:31.451681    4024 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.62.185:3997\" > leadership_token:\"lnnEnocc4uxu9iAVHN7svg\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.62.185:3997\" > > \nI0921 19:18:31.451927    4024 controller.go:295] I am leader with token \"lnnEnocc4uxu9iAVHN7svg\"\nI0921 19:18:31.452314    4024 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.62.185:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:3995\" > }\nI0921 19:18:31.452374    4024 controller.go:303] etcd cluster members: map[]\nI0921 19:18:31.452384    4024 controller.go:641] sending member map to all peers: \nI0921 19:18:31.452621    4024 commands.go:38] not refreshing commands - TTL not hit\nI0921 19:18:31.452638    4024 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-0143302838-62691.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0921 19:18:32.046548    4024 controller.go:359] detected that there is no existing cluster\nI0921 19:18:32.046562    4024 commands.go:41] refreshing commands\nI0921 19:18:32.276832    4024 vfs.go:120] listed commands in s3://k8s-kops-prow/e2e-0143302838-62691.test-cncf-aws.k8s.io/backups/etcd/events/control: 0 commands\nI0921 19:18:32.276855    4024 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-0143302838-62691.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-spec\"\nI0921 19:18:32.432895    4024 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io\" addresses:\"172.20.62.185\" > \nI0921 19:18:32.433145    4024 etcdserver.go:248] updating hosts: map[172.20.62.185:[etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io]]\nI0921 19:18:32.433203    4024 hosts.go:84] hosts update: primary=map[172.20.62.185:[etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:[172.20.62.185 172.20.62.185]], final=map[172.20.62.185:[etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io]]\nI0921 19:18:32.433304    4024 hosts.go:181] skipping update of unchanged /etc/hosts\nI0921 19:18:32.433409    4024 newcluster.go:136] starting new etcd cluster with [etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.62.185:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:3995\" > }]\nI0921 19:18:32.433867    4024 newcluster.go:153] JoinClusterResponse: \nI0921 19:18:32.435247    4024 etcdserver.go:556] starting etcd with state new_cluster:true cluster:<cluster_token:\"IO_6F6VuETQaQeCb5D4SbA\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" quarantined:true \nI0921 19:18:32.435331    4024 etcdserver.go:565] starting etcd with datadir /rootfs/mnt/master-vol-04e970008c9a0f2be/data/IO_6F6VuETQaQeCb5D4SbA\nI0921 19:18:32.436129    4024 pki.go:59] adding peerClientIPs [172.20.62.185]\nI0921 19:18:32.436165    4024 pki.go:67] generating peer keypair for etcd: {CommonName:etcd-events-a Organization:[] AltNames:{DNSNames:[etcd-events-a etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io] IPs:[172.20.62.185 127.0.0.1]} Usages:[2 1]}\nI0921 19:18:32.658547    4024 certs.go:183] generating certificate for \"etcd-events-a\"\nI0921 19:18:32.661746    4024 pki.go:110] building client-serving certificate: {CommonName:etcd-events-a Organization:[] AltNames:{DNSNames:[etcd-events-a etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io] IPs:[127.0.0.1]} Usages:[1 2]}\nI0921 19:18:32.989569    4024 certs.go:183] generating certificate for \"etcd-events-a\"\nI0921 19:18:33.085642    4024 certs.go:183] generating certificate for \"etcd-events-a\"\nI0921 19:18:33.087581    4024 etcdprocess.go:203] executing command /opt/etcd-v3.4.13-linux-amd64/etcd [/opt/etcd-v3.4.13-linux-amd64/etcd]\nI0921 19:18:33.088127    4024 newcluster.go:171] JoinClusterResponse: \nI0921 19:18:33.088205    4024 s3fs.go:199] Writing file \"s3://k8s-kops-prow/e2e-0143302838-62691.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-spec\"\nI0921 19:18:33.088220    4024 s3context.go:241] Checking default bucket encryption for \"k8s-kops-prow\"\n2021-09-21 19:18:33.094605 I | pkg/flags: recognized and used environment variable ETCD_ADVERTISE_CLIENT_URLS=https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:3995\n2021-09-21 19:18:33.094636 I | pkg/flags: recognized and used environment variable ETCD_CERT_FILE=/rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/clients/server.crt\n2021-09-21 19:18:33.094643 I | pkg/flags: recognized and used environment variable ETCD_CLIENT_CERT_AUTH=true\n2021-09-21 19:18:33.094658 I | pkg/flags: recognized and used environment variable ETCD_DATA_DIR=/rootfs/mnt/master-vol-04e970008c9a0f2be/data/IO_6F6VuETQaQeCb5D4SbA\n2021-09-21 19:18:33.094668 I | pkg/flags: recognized and used environment variable ETCD_ENABLE_V2=false\n2021-09-21 19:18:33.094689 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_ADVERTISE_PEER_URLS=https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\n2021-09-21 19:18:33.094694 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER=etcd-events-a=https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\n2021-09-21 19:18:33.094699 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER_STATE=new\n2021-09-21 19:18:33.094710 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER_TOKEN=IO_6F6VuETQaQeCb5D4SbA\n2021-09-21 19:18:33.094715 I | pkg/flags: recognized and used environment variable ETCD_KEY_FILE=/rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/clients/server.key\n2021-09-21 19:18:33.094723 I | pkg/flags: recognized and used environment variable ETCD_LISTEN_CLIENT_URLS=https://0.0.0.0:3995\n2021-09-21 19:18:33.094731 I | pkg/flags: recognized and used environment variable ETCD_LISTEN_PEER_URLS=https://0.0.0.0:2381\n2021-09-21 19:18:33.094738 I | pkg/flags: recognized and used environment variable ETCD_LOG_OUTPUTS=stdout\n2021-09-21 19:18:33.094746 I | pkg/flags: recognized and used environment variable ETCD_LOGGER=zap\n2021-09-21 19:18:33.094755 I | pkg/flags: recognized and used environment variable ETCD_NAME=etcd-events-a\n2021-09-21 19:18:33.094769 I | pkg/flags: recognized and used environment variable ETCD_PEER_CERT_FILE=/rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/peers/me.crt\n2021-09-21 19:18:33.094774 I | pkg/flags: recognized and used environment variable ETCD_PEER_CLIENT_CERT_AUTH=true\n2021-09-21 19:18:33.094784 I | pkg/flags: recognized and used environment variable ETCD_PEER_KEY_FILE=/rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/peers/me.key\n2021-09-21 19:18:33.094789 I | pkg/flags: recognized and used environment variable ETCD_PEER_TRUSTED_CA_FILE=/rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/peers/ca.crt\n2021-09-21 19:18:33.094804 I | pkg/flags: recognized and used environment variable ETCD_TRUSTED_CA_FILE=/rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/clients/ca.crt\n2021-09-21 19:18:33.094817 W | pkg/flags: unrecognized environment variable ETCD_LISTEN_METRICS_URLS=\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.094Z\",\"caller\":\"embed/etcd.go:117\",\"msg\":\"configuring peer listeners\",\"listen-peer-urls\":[\"https://0.0.0.0:2381\"]}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.095Z\",\"caller\":\"embed/etcd.go:468\",\"msg\":\"starting with peer TLS\",\"tls-info\":\"cert = /rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/peers/me.crt, key = /rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/peers/me.key, trusted-ca = /rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/peers/ca.crt, client-cert-auth = true, crl-file = \",\"cipher-suites\":[]}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.095Z\",\"caller\":\"embed/etcd.go:127\",\"msg\":\"configuring client listeners\",\"listen-client-urls\":[\"https://0.0.0.0:3995\"]}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.095Z\",\"caller\":\"embed/etcd.go:302\",\"msg\":\"starting an etcd server\",\"etcd-version\":\"3.4.13\",\"git-sha\":\"ae9734ed2\",\"go-version\":\"go1.12.17\",\"go-os\":\"linux\",\"go-arch\":\"amd64\",\"max-cpu-set\":2,\"max-cpu-available\":2,\"member-initialized\":false,\"name\":\"etcd-events-a\",\"data-dir\":\"/rootfs/mnt/master-vol-04e970008c9a0f2be/data/IO_6F6VuETQaQeCb5D4SbA\",\"wal-dir\":\"\",\"wal-dir-dedicated\":\"\",\"member-dir\":\"/rootfs/mnt/master-vol-04e970008c9a0f2be/data/IO_6F6VuETQaQeCb5D4SbA/member\",\"force-new-cluster\":false,\"heartbeat-interval\":\"100ms\",\"election-timeout\":\"1s\",\"initial-election-tick-advance\":true,\"snapshot-count\":100000,\"snapshot-catchup-entries\":5000,\"initial-advertise-peer-urls\":[\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\"],\"listen-peer-urls\":[\"https://0.0.0.0:2381\"],\"advertise-client-urls\":[\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:3995\"],\"listen-client-urls\":[\"https://0.0.0.0:3995\"],\"listen-metrics-urls\":[],\"cors\":[\"*\"],\"host-whitelist\":[\"*\"],\"initial-cluster\":\"etcd-events-a=https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\",\"initial-cluster-state\":\"new\",\"initial-cluster-token\":\"IO_6F6VuETQaQeCb5D4SbA\",\"quota-size-bytes\":2147483648,\"pre-vote\":false,\"initial-corrupt-check\":false,\"corrupt-check-time-interval\":\"0s\",\"auto-compaction-mode\":\"periodic\",\"auto-compaction-retention\":\"0s\",\"auto-compaction-interval\":\"0s\",\"discovery-url\":\"\",\"discovery-proxy\":\"\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.099Z\",\"caller\":\"etcdserver/backend.go:80\",\"msg\":\"opened backend db\",\"path\":\"/rootfs/mnt/master-vol-04e970008c9a0f2be/data/IO_6F6VuETQaQeCb5D4SbA/member/snap/db\",\"took\":\"2.661854ms\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.099Z\",\"caller\":\"netutil/netutil.go:112\",\"msg\":\"resolved URL Host\",\"url\":\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\",\"host\":\"etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\",\"resolved-addr\":\"172.20.62.185:2381\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.099Z\",\"caller\":\"netutil/netutil.go:112\",\"msg\":\"resolved URL Host\",\"url\":\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\",\"host\":\"etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\",\"resolved-addr\":\"172.20.62.185:2381\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.104Z\",\"caller\":\"etcdserver/raft.go:486\",\"msg\":\"starting local member\",\"local-member-id\":\"774cc3e2fcb28274\",\"cluster-id\":\"485be81d56be297d\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.104Z\",\"caller\":\"raft/raft.go:1530\",\"msg\":\"774cc3e2fcb28274 switched to configuration voters=()\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.104Z\",\"caller\":\"raft/raft.go:700\",\"msg\":\"774cc3e2fcb28274 became follower at term 0\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.104Z\",\"caller\":\"raft/raft.go:383\",\"msg\":\"newRaft 774cc3e2fcb28274 [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.104Z\",\"caller\":\"raft/raft.go:700\",\"msg\":\"774cc3e2fcb28274 became follower at term 1\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.105Z\",\"caller\":\"raft/raft.go:1530\",\"msg\":\"774cc3e2fcb28274 switched to configuration voters=(8596461168413016692)\"}\n{\"level\":\"warn\",\"ts\":\"2021-09-21T19:18:33.108Z\",\"caller\":\"auth/store.go:1366\",\"msg\":\"simple token is not cryptographically signed\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.112Z\",\"caller\":\"etcdserver/quota.go:98\",\"msg\":\"enabled backend quota with default value\",\"quota-name\":\"v3-applier\",\"quota-size-bytes\":2147483648,\"quota-size\":\"2.1 GB\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.116Z\",\"caller\":\"etcdserver/server.go:803\",\"msg\":\"starting etcd server\",\"local-member-id\":\"774cc3e2fcb28274\",\"local-server-version\":\"3.4.13\",\"cluster-version\":\"to_be_decided\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.117Z\",\"caller\":\"etcdserver/server.go:669\",\"msg\":\"started as single-node; fast-forwarding election ticks\",\"local-member-id\":\"774cc3e2fcb28274\",\"forward-ticks\":9,\"forward-duration\":\"900ms\",\"election-ticks\":10,\"election-timeout\":\"1s\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.117Z\",\"caller\":\"raft/raft.go:1530\",\"msg\":\"774cc3e2fcb28274 switched to configuration voters=(8596461168413016692)\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.117Z\",\"caller\":\"membership/cluster.go:392\",\"msg\":\"added member\",\"cluster-id\":\"485be81d56be297d\",\"local-member-id\":\"774cc3e2fcb28274\",\"added-peer-id\":\"774cc3e2fcb28274\",\"added-peer-peer-urls\":[\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\"]}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.120Z\",\"caller\":\"embed/etcd.go:711\",\"msg\":\"starting with client TLS\",\"tls-info\":\"cert = /rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/clients/server.crt, key = /rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/clients/server.key, trusted-ca = /rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/clients/ca.crt, client-cert-auth = true, crl-file = \",\"cipher-suites\":[]}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.120Z\",\"caller\":\"embed/etcd.go:579\",\"msg\":\"serving peer traffic\",\"address\":\"[::]:2381\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.120Z\",\"caller\":\"embed/etcd.go:244\",\"msg\":\"now serving peer/client/metrics\",\"local-member-id\":\"774cc3e2fcb28274\",\"initial-advertise-peer-urls\":[\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\"],\"listen-peer-urls\":[\"https://0.0.0.0:2381\"],\"advertise-client-urls\":[\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:3995\"],\"listen-client-urls\":[\"https://0.0.0.0:3995\"],\"listen-metrics-urls\":[]}\nI0921 19:18:33.402699    4024 s3fs.go:199] Writing file \"s3://k8s-kops-prow/e2e-0143302838-62691.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0921 19:18:33.570908    4024 controller.go:189] starting controller iteration\nI0921 19:18:33.570930    4024 controller.go:266] Broadcasting leadership assertion with token \"lnnEnocc4uxu9iAVHN7svg\"\nI0921 19:18:33.571164    4024 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.62.185:3997\" > leadership_token:\"lnnEnocc4uxu9iAVHN7svg\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.62.185:3997\" > > \nI0921 19:18:33.571323    4024 controller.go:295] I am leader with token \"lnnEnocc4uxu9iAVHN7svg\"\nI0921 19:18:33.572111    4024 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:3995]\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.805Z\",\"caller\":\"raft/raft.go:923\",\"msg\":\"774cc3e2fcb28274 is starting a new election at term 1\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.805Z\",\"caller\":\"raft/raft.go:713\",\"msg\":\"774cc3e2fcb28274 became candidate at term 2\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.805Z\",\"caller\":\"raft/raft.go:824\",\"msg\":\"774cc3e2fcb28274 received MsgVoteResp from 774cc3e2fcb28274 at term 2\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.805Z\",\"caller\":\"raft/raft.go:765\",\"msg\":\"774cc3e2fcb28274 became leader at term 2\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.805Z\",\"caller\":\"raft/node.go:325\",\"msg\":\"raft.node: 774cc3e2fcb28274 elected leader 774cc3e2fcb28274 at term 2\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.805Z\",\"caller\":\"etcdserver/server.go:2528\",\"msg\":\"setting up initial cluster version\",\"cluster-version\":\"3.4\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.806Z\",\"caller\":\"membership/cluster.go:558\",\"msg\":\"set initial cluster version\",\"cluster-id\":\"485be81d56be297d\",\"local-member-id\":\"774cc3e2fcb28274\",\"cluster-version\":\"3.4\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.806Z\",\"caller\":\"api/capability.go:76\",\"msg\":\"enabled capabilities for version\",\"cluster-version\":\"3.4\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.806Z\",\"caller\":\"etcdserver/server.go:2560\",\"msg\":\"cluster version is updated\",\"cluster-version\":\"3.4\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.806Z\",\"caller\":\"etcdserver/server.go:2037\",\"msg\":\"published local member to cluster through raft\",\"local-member-id\":\"774cc3e2fcb28274\",\"local-member-attributes\":\"{Name:etcd-events-a ClientURLs:[https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:3995]}\",\"request-path\":\"/0/members/774cc3e2fcb28274/attributes\",\"cluster-id\":\"485be81d56be297d\",\"publish-timeout\":\"7s\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.808Z\",\"caller\":\"embed/serve.go:191\",\"msg\":\"serving client traffic securely\",\"address\":\"[::]:3995\"}\nI0921 19:18:33.825258    4024 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:3995\"],\"ID\":\"8596461168413016692\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.62.185:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"IO_6F6VuETQaQeCb5D4SbA\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" quarantined:true > }\nI0921 19:18:33.825380    4024 controller.go:303] etcd cluster members: map[8596461168413016692:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:3995\"],\"ID\":\"8596461168413016692\"}]\nI0921 19:18:33.825650    4024 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io\" addresses:\"172.20.62.185\" > \nI0921 19:18:33.826288    4024 etcdserver.go:248] updating hosts: map[172.20.62.185:[etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io]]\nI0921 19:18:33.826308    4024 hosts.go:84] hosts update: primary=map[172.20.62.185:[etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:[172.20.62.185 172.20.62.185]], final=map[172.20.62.185:[etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io]]\nI0921 19:18:33.826407    4024 hosts.go:181] skipping update of unchanged /etc/hosts\nI0921 19:18:33.826567    4024 commands.go:38] not refreshing commands - TTL not hit\nI0921 19:18:33.826581    4024 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-0143302838-62691.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0921 19:18:33.984686    4024 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0921 19:18:33.985713    4024 backup.go:134] performing snapshot save to /tmp/811440994/snapshot.db.gz\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.991Z\",\"caller\":\"clientv3/maintenance.go:200\",\"msg\":\"opened snapshot stream; downloading\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.991Z\",\"caller\":\"v3rpc/maintenance.go:139\",\"msg\":\"sending database snapshot to client\",\"total-bytes\":20480,\"size\":\"20 kB\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.992Z\",\"caller\":\"v3rpc/maintenance.go:177\",\"msg\":\"sending database sha256 checksum to client\",\"total-bytes\":20480,\"checksum-size\":32}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.992Z\",\"caller\":\"v3rpc/maintenance.go:191\",\"msg\":\"successfully sent database snapshot to client\",\"total-bytes\":20480,\"size\":\"20 kB\",\"took\":\"now\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:33.993Z\",\"caller\":\"clientv3/maintenance.go:208\",\"msg\":\"completed snapshot read; closing\"}\nI0921 19:18:33.993485    4024 s3fs.go:199] Writing file \"s3://k8s-kops-prow/e2e-0143302838-62691.test-cncf-aws.k8s.io/backups/etcd/events/2021-09-21T19:18:33Z-000001/etcd.backup.gz\"\nI0921 19:18:34.181938    4024 s3fs.go:199] Writing file \"s3://k8s-kops-prow/e2e-0143302838-62691.test-cncf-aws.k8s.io/backups/etcd/events/2021-09-21T19:18:33Z-000001/_etcd_backup.meta\"\nI0921 19:18:34.370806    4024 backup.go:159] backup complete: name:\"2021-09-21T19:18:33Z-000001\" \nI0921 19:18:34.371533    4024 controller.go:937] backup response: name:\"2021-09-21T19:18:33Z-000001\" \nI0921 19:18:34.371550    4024 controller.go:576] took backup: name:\"2021-09-21T19:18:33Z-000001\" \nI0921 19:18:34.536843    4024 vfs.go:118] listed backups in s3://k8s-kops-prow/e2e-0143302838-62691.test-cncf-aws.k8s.io/backups/etcd/events: [2021-09-21T19:18:33Z-000001]\nI0921 19:18:34.536865    4024 cleanup.go:166] retaining backup \"2021-09-21T19:18:33Z-000001\"\nI0921 19:18:34.536961    4024 restore.go:98] Setting quarantined state to false\nI0921 19:18:34.537287    4024 etcdserver.go:393] Reconfigure request: header:<leadership_token:\"lnnEnocc4uxu9iAVHN7svg\" cluster_name:\"etcd-events\" > \nI0921 19:18:34.537385    4024 etcdserver.go:436] Stopping etcd for reconfigure request: header:<leadership_token:\"lnnEnocc4uxu9iAVHN7svg\" cluster_name:\"etcd-events\" > \nI0921 19:18:34.537461    4024 etcdserver.go:640] killing etcd with datadir /rootfs/mnt/master-vol-04e970008c9a0f2be/data/IO_6F6VuETQaQeCb5D4SbA\nI0921 19:18:34.537565    4024 etcdprocess.go:131] Waiting for etcd to exit\nI0921 19:18:34.637873    4024 etcdprocess.go:131] Waiting for etcd to exit\nI0921 19:18:34.637892    4024 etcdprocess.go:136] Exited etcd: signal: killed\nI0921 19:18:34.638040    4024 etcdserver.go:443] updated cluster state: cluster:<cluster_token:\"IO_6F6VuETQaQeCb5D4SbA\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" \nI0921 19:18:34.638229    4024 etcdserver.go:448] Starting etcd version \"3.4.13\"\nI0921 19:18:34.638243    4024 etcdserver.go:556] starting etcd with state cluster:<cluster_token:\"IO_6F6VuETQaQeCb5D4SbA\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" \nI0921 19:18:34.638325    4024 etcdserver.go:565] starting etcd with datadir /rootfs/mnt/master-vol-04e970008c9a0f2be/data/IO_6F6VuETQaQeCb5D4SbA\nI0921 19:18:34.638465    4024 pki.go:59] adding peerClientIPs [172.20.62.185]\nI0921 19:18:34.638488    4024 pki.go:67] generating peer keypair for etcd: {CommonName:etcd-events-a Organization:[] AltNames:{DNSNames:[etcd-events-a etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io] IPs:[172.20.62.185 127.0.0.1]} Usages:[2 1]}\nI0921 19:18:34.638772    4024 certs.go:122] existing certificate not valid after 2023-09-21T19:18:32Z; will regenerate\nI0921 19:18:34.638784    4024 certs.go:183] generating certificate for \"etcd-events-a\"\nI0921 19:18:34.640934    4024 pki.go:110] building client-serving certificate: {CommonName:etcd-events-a Organization:[] AltNames:{DNSNames:[etcd-events-a etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io] IPs:[127.0.0.1]} Usages:[1 2]}\nI0921 19:18:34.641150    4024 certs.go:122] existing certificate not valid after 2023-09-21T19:18:32Z; will regenerate\nI0921 19:18:34.641164    4024 certs.go:183] generating certificate for \"etcd-events-a\"\nI0921 19:18:34.797868    4024 certs.go:183] generating certificate for \"etcd-events-a\"\nI0921 19:18:34.799803    4024 etcdprocess.go:203] executing command /opt/etcd-v3.4.13-linux-amd64/etcd [/opt/etcd-v3.4.13-linux-amd64/etcd]\nI0921 19:18:34.800265    4024 restore.go:116] ReconfigureResponse: \nI0921 19:18:34.801535    4024 controller.go:189] starting controller iteration\nI0921 19:18:34.801555    4024 controller.go:266] Broadcasting leadership assertion with token \"lnnEnocc4uxu9iAVHN7svg\"\nI0921 19:18:34.801762    4024 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.62.185:3997\" > leadership_token:\"lnnEnocc4uxu9iAVHN7svg\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.62.185:3997\" > > \nI0921 19:18:34.801865    4024 controller.go:295] I am leader with token \"lnnEnocc4uxu9iAVHN7svg\"\nI0921 19:18:34.802253    4024 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:4002]\n2021-09-21 19:18:34.806893 I | pkg/flags: recognized and used environment variable ETCD_ADVERTISE_CLIENT_URLS=https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:4002\n2021-09-21 19:18:34.806922 I | pkg/flags: recognized and used environment variable ETCD_CERT_FILE=/rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/clients/server.crt\n2021-09-21 19:18:34.806980 I | pkg/flags: recognized and used environment variable ETCD_CLIENT_CERT_AUTH=true\n2021-09-21 19:18:34.807009 I | pkg/flags: recognized and used environment variable ETCD_DATA_DIR=/rootfs/mnt/master-vol-04e970008c9a0f2be/data/IO_6F6VuETQaQeCb5D4SbA\n2021-09-21 19:18:34.807075 I | pkg/flags: recognized and used environment variable ETCD_ENABLE_V2=false\n2021-09-21 19:18:34.807138 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_ADVERTISE_PEER_URLS=https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\n2021-09-21 19:18:34.807148 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER=etcd-events-a=https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\n2021-09-21 19:18:34.807228 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER_STATE=existing\n2021-09-21 19:18:34.807240 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER_TOKEN=IO_6F6VuETQaQeCb5D4SbA\n2021-09-21 19:18:34.807246 I | pkg/flags: recognized and used environment variable ETCD_KEY_FILE=/rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/clients/server.key\n2021-09-21 19:18:34.807254 I | pkg/flags: recognized and used environment variable ETCD_LISTEN_CLIENT_URLS=https://0.0.0.0:4002\n2021-09-21 19:18:34.807362 I | pkg/flags: recognized and used environment variable ETCD_LISTEN_PEER_URLS=https://0.0.0.0:2381\n2021-09-21 19:18:34.807376 I | pkg/flags: recognized and used environment variable ETCD_LOG_OUTPUTS=stdout\n2021-09-21 19:18:34.807461 I | pkg/flags: recognized and used environment variable ETCD_LOGGER=zap\n2021-09-21 19:18:34.807510 I | pkg/flags: recognized and used environment variable ETCD_NAME=etcd-events-a\n2021-09-21 19:18:34.807523 I | pkg/flags: recognized and used environment variable ETCD_PEER_CERT_FILE=/rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/peers/me.crt\n2021-09-21 19:18:34.807528 I | pkg/flags: recognized and used environment variable ETCD_PEER_CLIENT_CERT_AUTH=true\n2021-09-21 19:18:34.807535 I | pkg/flags: recognized and used environment variable ETCD_PEER_KEY_FILE=/rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/peers/me.key\n2021-09-21 19:18:34.807580 I | pkg/flags: recognized and used environment variable ETCD_PEER_TRUSTED_CA_FILE=/rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/peers/ca.crt\n2021-09-21 19:18:34.807632 I | pkg/flags: recognized and used environment variable ETCD_TRUSTED_CA_FILE=/rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/clients/ca.crt\n2021-09-21 19:18:34.807683 W | pkg/flags: unrecognized environment variable ETCD_LISTEN_METRICS_URLS=\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:34.807Z\",\"caller\":\"etcdmain/etcd.go:134\",\"msg\":\"server has been already initialized\",\"data-dir\":\"/rootfs/mnt/master-vol-04e970008c9a0f2be/data/IO_6F6VuETQaQeCb5D4SbA\",\"dir-type\":\"member\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:34.807Z\",\"caller\":\"embed/etcd.go:117\",\"msg\":\"configuring peer listeners\",\"listen-peer-urls\":[\"https://0.0.0.0:2381\"]}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:34.807Z\",\"caller\":\"embed/etcd.go:468\",\"msg\":\"starting with peer TLS\",\"tls-info\":\"cert = /rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/peers/me.crt, key = /rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/peers/me.key, trusted-ca = /rootfs/mnt/master-vol-04e970008c9a0f2be/pki/IO_6F6VuETQaQeCb5D4SbA/peers/ca.crt, client-cert-auth = true, crl-file = \",\"cipher-suites\":[]}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:34.808Z\",\"caller\":\"embed/etcd.go:127\",\"msg\":\"configuring client listeners\",\"listen-client-urls\":[\"https://0.0.0.0:4002\"]}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:34.808Z\",\"caller\":\"embed/etcd.go:302\",\"msg\":\"starting an etcd server\",\"etcd-version\":\"3.4.13\",\"git-sha\":\"ae9734ed2\",\"go-version\":\"go1.12.17\",\"go-os\":\"linux\",\"go-arch\":\"amd64\",\"max-cpu-set\":2,\"max-cpu-available\":2,\"member-initialized\":true,\"name\":\"etcd-events-a\",\"data-dir\":\"/rootfs/mnt/master-vol-04e970008c9a0f2be/data/IO_6F6VuETQaQeCb5D4SbA\",\"wal-dir\":\"\",\"wal-dir-dedicated\":\"\",\"member-dir\":\"/rootfs/mnt/master-vol-04e970008c9a0f2be/data/IO_6F6VuETQaQeCb5D4SbA/member\",\"force-new-cluster\":false,\"heartbeat-interval\":\"100ms\",\"election-timeout\":\"1s\",\"initial-election-tick-advance\":true,\"snapshot-count\":100000,\"snapshot-catchup-entries\":5000,\"initial-advertise-peer-urls\":[\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\"],\"listen-peer-urls\":[\"https://0.0.0.0:2381\"],\"advertise-client-urls\":[\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:4002\"],\"listen-client-urls\":[\"https://0.0.0.0:4002\"],\"listen-metrics-urls\":[],\"cors\":[\"*\"],\"host-whitelist\":[\"*\"],\"initial-cluster\":\"\",\"initial-cluster-state\":\"existing\",\"initial-cluster-token\":\"\",\"quota-size-bytes\":2147483648,\"pre-vote\":false,\"initial-corrupt-check\":false,\"corrupt-check-time-interval\":\"0s\",\"auto-compaction-mode\":\"periodic\",\"auto-compaction-retention\":\"0s\",\"auto-compaction-interval\":\"0s\",\"discovery-url\":\"\",\"discovery-proxy\":\"\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:34.809Z\",\"caller\":\"etcdserver/backend.go:80\",\"msg\":\"opened backend db\",\"path\":\"/rootfs/mnt/master-vol-04e970008c9a0f2be/data/IO_6F6VuETQaQeCb5D4SbA/member/snap/db\",\"took\":\"132.95µs\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:34.809Z\",\"caller\":\"etcdserver/raft.go:536\",\"msg\":\"restarting local member\",\"cluster-id\":\"485be81d56be297d\",\"local-member-id\":\"774cc3e2fcb28274\",\"commit-index\":4}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:34.810Z\",\"caller\":\"raft/raft.go:1530\",\"msg\":\"774cc3e2fcb28274 switched to configuration voters=()\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:34.810Z\",\"caller\":\"raft/raft.go:700\",\"msg\":\"774cc3e2fcb28274 became follower at term 2\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:34.810Z\",\"caller\":\"raft/raft.go:383\",\"msg\":\"newRaft 774cc3e2fcb28274 [peers: [], term: 2, commit: 4, applied: 0, lastindex: 4, lastterm: 2]\"}\n{\"level\":\"warn\",\"ts\":\"2021-09-21T19:18:34.811Z\",\"caller\":\"auth/store.go:1366\",\"msg\":\"simple token is not cryptographically signed\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:34.813Z\",\"caller\":\"etcdserver/quota.go:98\",\"msg\":\"enabled backend quota with default value\",\"quota-name\":\"v3-applier\",\"quota-size-bytes\":2147483648,\"quota-size\":\"2.1 GB\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:34.814Z\",\"caller\":\"etcdserver/server.go:803\",\"msg\":\"starting etcd server\",\"local-member-id\":\"774cc3e2fcb28274\",\"local-server-version\":\"3.4.13\",\"cluster-version\":\"to_be_decided\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:34.814Z\",\"caller\":\"etcdserver/server.go:691\",\"msg\":\"starting initial election tick advance\",\"election-ticks\":10}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:34.815Z\",\"caller\":\"raft/raft.go:1530\",\"msg\":\"774cc3e2fcb28274 switched to configuration voters=(8596461168413016692)\"}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:34.815Z\",\"caller\":\"membership/cluster.go:392\",\"msg\":\"added member\",\"cluster-id\":\"485be81d56be297d\",\"local-member-id\":\"774cc3e2fcb28274\",\"added-peer-id\":\"774cc3e2fcb28274\",\"added-peer-peer-urls\":[\"https://etcd-events-a.internal.e2e-0143302838-62691.test-cncf-aws.k8s.io:2381\"]}\n{\"level\":\"info\",\"ts\":\"2021-09-21T19:18:34.816Z\",\"caller\":\"membership/cluster.go:558\",\"msg\":\"set initial cluster version\",\&#