This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 0 failed / 0 succeeded
Started2021-09-23 16:27
Elapsed35m54s
Revisionmaster

No Test Failures!


Error lines from build-log.txt

... skipping 134 lines ...
I0923 16:28:04.361510    4687 up.go:43] Cleaning up any leaked resources from previous cluster
I0923 16:28:04.361544    4687 dumplogs.go:40] /logs/artifacts/0762e7b7-1c8b-11ec-883b-c61df66c07e7/kops toolbox dump --name e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io --dir /logs/artifacts --private-key /etc/aws-ssh/aws-ssh-private --ssh-user ec2-user
I0923 16:28:04.378322    4709 featureflag.go:165] FeatureFlag "SpecOverrideFlag"=true
I0923 16:28:04.378437    4709 featureflag.go:165] FeatureFlag "AlphaAllowGCE"=true

Cluster.kops.k8s.io "e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io" not found
W0923 16:28:04.945358    4687 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1
I0923 16:28:04.945401    4687 down.go:48] /logs/artifacts/0762e7b7-1c8b-11ec-883b-c61df66c07e7/kops delete cluster --name e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io --yes
I0923 16:28:04.962666    4719 featureflag.go:165] FeatureFlag "SpecOverrideFlag"=true
I0923 16:28:04.963372    4719 featureflag.go:165] FeatureFlag "AlphaAllowGCE"=true

error reading cluster configuration: Cluster.kops.k8s.io "e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io" not found
I0923 16:28:05.441352    4687 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip
2021/09/23 16:28:05 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404
I0923 16:28:05.449532    4687 http.go:37] curl https://ip.jsb.workers.dev
I0923 16:28:05.551178    4687 up.go:144] /logs/artifacts/0762e7b7-1c8b-11ec-883b-c61df66c07e7/kops create cluster --name e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io --cloud aws --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.21.5 --ssh-public-key /etc/aws-ssh/aws-ssh-public --override cluster.spec.nodePortAccess=0.0.0.0/0 --yes --image=amazon/amzn2-ami-hvm-2.0.20210813.1-x86_64-gp2 --channel=alpha --networking=flannel --container-runtime=containerd --admin-access 35.184.20.240/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones ap-northeast-1a --master-size c5.large
I0923 16:28:05.569173    4729 featureflag.go:165] FeatureFlag "SpecOverrideFlag"=true
I0923 16:28:05.569274    4729 featureflag.go:165] FeatureFlag "AlphaAllowGCE"=true
I0923 16:28:05.617061    4729 create_cluster.go:728] Using SSH public key: /etc/aws-ssh/aws-ssh-public
I0923 16:28:06.260430    4729 new_cluster.go:1011]  Cloud Provider ID = aws
... skipping 42 lines ...

I0923 16:28:34.656642    4687 up.go:181] /logs/artifacts/0762e7b7-1c8b-11ec-883b-c61df66c07e7/kops validate cluster --name e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io --count 10 --wait 15m0s
I0923 16:28:34.673484    4749 featureflag.go:165] FeatureFlag "SpecOverrideFlag"=true
I0923 16:28:34.673584    4749 featureflag.go:165] FeatureFlag "AlphaAllowGCE"=true
Validating cluster e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io

W0923 16:28:36.080067    4749 validate_cluster.go:173] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:28:46.109641    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:28:56.147898    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:29:06.192365    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:29:16.222542    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:29:26.251527    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:29:36.297015    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:29:46.326963    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:29:56.371842    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:30:06.407954    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:30:16.436243    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:30:26.478478    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:30:36.506197    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:30:46.549262    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:30:56.586370    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:31:06.613979    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:31:16.658466    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:31:26.686708    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:31:36.721026    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:31:46.783378    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:31:56.850375    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:32:06.896711    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:32:16.931125    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W0923 16:32:26.961112    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

... skipping 14 lines ...
Pod	kube-system/coredns-5dc785954d-nfmmr			system-cluster-critical pod "coredns-5dc785954d-nfmmr" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-4mrql		system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-4mrql" is pending
Pod	kube-system/kube-flannel-ds-9cctk			system-node-critical pod "kube-flannel-ds-9cctk" is pending
Pod	kube-system/kube-flannel-ds-jn9xx			system-node-critical pod "kube-flannel-ds-jn9xx" is pending
Pod	kube-system/kube-flannel-ds-lpmtw			system-node-critical pod "kube-flannel-ds-lpmtw" is pending

Validation Failed
W0923 16:32:40.403860    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

... skipping 8 lines ...
VALIDATION ERRORS
KIND	NAME						MESSAGE
Node	ip-172-20-54-72.ap-northeast-1.compute.internal	node "ip-172-20-54-72.ap-northeast-1.compute.internal" of role "node" is not ready
Pod	kube-system/coredns-5dc785954d-nfmmr		system-cluster-critical pod "coredns-5dc785954d-nfmmr" is not ready (coredns)
Pod	kube-system/coredns-5dc785954d-wbcvv		system-cluster-critical pod "coredns-5dc785954d-wbcvv" is pending

Validation Failed
W0923 16:32:52.626032    4749 validate_cluster.go:221] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-northeast-1a	Master	c5.large	1	1	ap-northeast-1a
nodes-ap-northeast-1a	Node	t3.medium	4	4	ap-northeast-1a

... skipping 1169 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 23 16:35:26.880: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "kubectl-7352" for this suite.

•
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Kubectl create quota should create a quota with scopes","total":-1,"completed":1,"skipped":2,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 23 16:35:27.289: INFO: Only supported for providers [openstack] (not aws)
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 67 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 23 16:35:27.127: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "clientset-6217" for this suite.

•
------------------------------
{"msg":"PASSED [sig-api-machinery] Generated clientset should create v1beta1 cronJobs, delete cronJobs, watch cronJobs","total":-1,"completed":1,"skipped":0,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 23 16:35:27.555: INFO: Driver hostPath doesn't support DynamicPV -- skipping
... skipping 26 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: hostPath]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (delayed binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Driver hostPath doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
... skipping 39 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 23 16:35:28.737: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "pods-7748" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Pods Extended Pods Set QOS Class should be set on Pods with matching resource requests and limits for memory and cpu [Conformance]","total":-1,"completed":2,"skipped":12,"failed":0}

SSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 23 16:35:29.063: INFO: Only supported for providers [gce gke] (not aws)
... skipping 61 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 23 16:35:28.701: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "kubectl-361" for this suite.

•SS
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Kubectl api-versions should check if v1 is in available api versions  [Conformance]","total":-1,"completed":1,"skipped":16,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 23 16:35:29.100: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 375 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 23 16:35:29.210: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "proxy-4931" for this suite.

•
------------------------------
{"msg":"PASSED [sig-network] Proxy version v1 should proxy logs on node with explicit kubelet port using proxy subresource ","total":-1,"completed":1,"skipped":5,"failed":0}

S
------------------------------
[BeforeEach] [sig-auth] ServiceAccounts
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 47 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Sep 23 16:35:30.979: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "secrets-5112" for this suite.

•
------------------------------
{"msg":"PASSED [sig-storage] Secrets should be immutable if `immutable` field is set [Conformance]","total":-1,"completed":2,"skipped":32,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 23 16:35:31.272: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian)
... skipping 47 lines ...
Sep 23 16:35:26.287: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled
Sep 23 16:35:26.422: INFO: No PSP annotation exists on dry run pod; assuming PodSecurityPolicy is disabled
STEP: Waiting for a default service account to be provisioned in namespace
[It] should allow substituting values in a container's args [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test substitution in container's args
Sep 23 16:35:26.820: INFO: Waiting up to 5m0s for pod "var-expansion-28c5d9c0-baee-4d65-ad3c-387afc055db9" in namespace "var-expansion-7807" to be "Succeeded or Failed"
Sep 23 16:35:26.953: INFO: Pod "var-expansion-28c5d9c0-baee-4d65-ad3c-387afc055db9": Phase="Pending", Reason="", readiness=false. Elapsed: 132.411891ms
Sep 23 16:35:29.086: INFO: Pod "var-expansion-28c5d9c0-baee-4d65-ad3c-387afc055db9": Phase="Pending", Reason="", readiness=false. Elapsed: 2.265166172s
Sep 23 16:35:31.219: INFO: Pod "var-expansion-28c5d9c0-baee-4d65-ad3c-387afc055db9": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.398209614s
STEP: Saw pod success
Sep 23 16:35:31.219: INFO: Pod "var-expansion-28c5d9c0-baee-4d65-ad3c-387afc055db9" satisfied condition "Succeeded or Failed"
Sep 23 16:35:31.351: INFO: Trying to get logs from node ip-172-20-43-215.ap-northeast-1.compute.internal pod var-expansion-28c5d9c0-baee-4d65-ad3c-387afc055db9 container dapi-container: <nil>
STEP: delete the pod
Sep 23 16:35:31.622: INFO: Waiting for pod var-expansion-28c5d9c0-baee-4d65-ad3c-387afc055db9 to disappear
Sep 23 16:35:31.754: INFO: Pod var-expansion-28c5d9c0-baee-4d65-ad3c-387afc055db9 no longer exists
[AfterEach] [sig-node] Variable Expansion
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:6.811 seconds]
[sig-node] Variable Expansion
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should allow substituting values in a container's args [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Variable Expansion should allow substituting values in a container's args [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":6,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 23 16:35:32.173: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 87 lines ...
• [SLOW TEST:7.942 seconds]
[sig-apps] DisruptionController
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  evictions: no PDB => should allow an eviction
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/disruption.go:267
------------------------------
{"msg":"PASSED [sig-apps] DisruptionController evictions: no PDB =\u003e should allow an eviction","total":-1,"completed":1,"skipped":0,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 23 16:35:33.209: INFO: Driver csi-hostpath doesn't support InlineVolume -- skipping
[AfterEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 43 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/runtime.go:41
    on terminated container
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/runtime.go:134
      should report termination message [LinuxOnly] if TerminationMessagePath is set [NodeConformance]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/runtime.go:171
------------------------------
{"msg":"PASSED [sig-node] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] if TerminationMessagePath is set [NodeConformance]","total":-1,"completed":1,"skipped":7,"failed":0}

S
------------------------------
[BeforeEach] [sig-cli] Kubectl client
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 4 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:241
[It] should check if cluster-info dump succeeds
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1078
STEP: running cluster-info dump
Sep 23 16:35:28.517: INFO: Running '/tmp/kubectl2133144207/kubectl --server=https://api.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-1761 cluster-info dump'
Sep 23 16:35:35.362: INFO: stderr: ""
Sep 23 16:35:35.364: INFO: stdout: "{\n    \"kind\": \"NodeList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"1431\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\",\n                \"uid\": \"20f0e66d-c770-4b7c-b18e-49b17f0d0ef1\",\n                \"resourceVersion\": \"785\",\n                \"creationTimestamp\": \"2021-09-23T16:32:30Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"ap-northeast-1\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"ap-northeast-1a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-ap-northeast-1a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"node\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"topology.kubernetes.io/region\": \"ap-northeast-1\",\n                    \"topology.kubernetes.io/zone\": \"ap-northeast-1a\"\n                },\n                \"annotations\": {\n                    \"flannel.alpha.coreos.com/backend-data\": \"{\\\"VtepMAC\\\":\\\"b6:3d:bc:51:c4:bf\\\"}\",\n                    \"flannel.alpha.coreos.com/backend-type\": \"vxlan\",\n                    \"flannel.alpha.coreos.com/kube-subnet-manager\": \"true\",\n                    \"flannel.alpha.coreos.com/public-ip\": \"172.20.34.24\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.2.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.2.0/24\"\n                ],\n                \"providerID\": \"aws:///ap-northeast-1a/i-00dbf8d707c9db41a\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"50319340Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3977792Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"46374303668\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3875392Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:32:42Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:42Z\",\n                        \"reason\": \"FlannelIsUp\",\n                        \"message\": \"Flannel is running on this node\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:33:00Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:30Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:33:00Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:30Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:33:00Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:30Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:33:00Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:40Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.34.24\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"18.181.174.104\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-18-181-174-104.ap-northeast-1.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec214dee1f497e5a0c3f972da49e4684\",\n                    \"systemUUID\": \"EC25C05E-B6FB-75DE-9A66-C63230A49CC3\",\n                    \"bootID\": \"991dd31f-6077-473a-baa9-5b2677f0d9fd\",\n                    \"kernelVersion\": \"4.14.243-185.433.amzn2.x86_64\",\n                    \"osImage\": \"Amazon Linux 2\",\n                    \"containerRuntimeVersion\": \"containerd://1.4.9\",\n                    \"kubeletVersion\": \"v1.21.5\",\n                    \"kubeProxyVersion\": \"v1.21.5\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 105352393\n                    },\n                    {\n                        \"names\": [\n                            \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                            \"quay.io/coreos/flannel:v0.13.0\"\n                        ],\n                        \"sizeBytes\": 19388223\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/coredns/coredns@sha256:6e5a02c21641597998b4be7cb5eb1e7b02c0d8d23cce4dd09f4682d463798890\",\n                            \"k8s.gcr.io/coredns/coredns:v1.8.4\"\n                        ],\n                        \"sizeBytes\": 13707249\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f\",\n                            \"k8s.gcr.io/pause:3.2\"\n                        ],\n                        \"sizeBytes\": 299513\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"42a5f8ca-7e32-4b00-8ee8-9d829587a401\",\n                \"resourceVersion\": \"552\",\n                \"creationTimestamp\": \"2021-09-23T16:31:06Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"c5.large\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"ap-northeast-1\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"ap-northeast-1a\",\n                    \"kops.k8s.io/instancegroup\": \"master-ap-northeast-1a\",\n                    \"kops.k8s.io/kops-controller-pki\": \"\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"master\",\n                    \"node-role.kubernetes.io/control-plane\": \"\",\n                    \"node-role.kubernetes.io/master\": \"\",\n                    \"node.kubernetes.io/exclude-from-external-load-balancers\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"c5.large\",\n                    \"topology.kubernetes.io/region\": \"ap-northeast-1\",\n                    \"topology.kubernetes.io/zone\": \"ap-northeast-1a\"\n                },\n                \"annotations\": {\n                    \"flannel.alpha.coreos.com/backend-data\": \"{\\\"VtepMAC\\\":\\\"86:45:0d:62:af:0d\\\"}\",\n                    \"flannel.alpha.coreos.com/backend-type\": \"vxlan\",\n                    \"flannel.alpha.coreos.com/kube-subnet-manager\": \"true\",\n                    \"flannel.alpha.coreos.com/public-ip\": \"172.20.42.57\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.0.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.0.0/24\"\n                ],\n                \"providerID\": \"aws:///ap-northeast-1a/i-0cb466337e23815c6\",\n                \"taints\": [\n                    {\n                        \"key\": \"node-role.kubernetes.io/master\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ]\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"50319340Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3793476Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"46374303668\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3691076Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:31:48Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:31:48Z\",\n                        \"reason\": \"FlannelIsUp\",\n                        \"message\": \"Flannel is running on this node\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:32:16Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:30:59Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:32:16Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:30:59Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:32:16Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:30:59Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:32:16Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:31:56Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.42.57\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"13.113.30.195\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-13-113-30-195.ap-northeast-1.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec214dee1f497e5a0c3f972da49e4684\",\n                    \"systemUUID\": \"EC2B1966-9C15-D1FA-1C29-C51A302D06C1\",\n                    \"bootID\": \"50114f4e-ae83-47a1-b430-0774e35a1fe3\",\n                    \"kernelVersion\": \"4.14.243-185.433.amzn2.x86_64\",\n                    \"osImage\": \"Amazon Linux 2\",\n                    \"containerRuntimeVersion\": \"containerd://1.4.9\",\n                    \"kubeletVersion\": \"v1.21.5\",\n                    \"kubeProxyVersion\": \"v1.21.5\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/etcdadm/etcd-manager@sha256:ebb73d3d4a99da609f9e01c556cd9f9aa7a0aecba8f5bc5588d7c45eb38e3a7e\",\n                            \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\"\n                        ],\n                        \"sizeBytes\": 171082409\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-apiserver-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 127101402\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-controller-manager-amd64@sha256:d9efa3d5179e044f19b102d0a4b6b76bb77f3be3baa38c1b0d71d314e18d49aa\",\n                            \"k8s.gcr.io/kube-controller-manager-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 121137987\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kops/dns-controller:1.21.1\"\n                        ],\n                        \"sizeBytes\": 113860118\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kops/kops-controller:1.21.1\"\n                        ],\n                        \"sizeBytes\": 112068119\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 105352393\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-scheduler-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 52099384\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kops/kube-apiserver-healthcheck:1.21.1\"\n                        ],\n                        \"sizeBytes\": 25622039\n                    },\n                    {\n                        \"names\": [\n                            \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                            \"quay.io/coreos/flannel:v0.13.0\"\n                        ],\n                        \"sizeBytes\": 19388223\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f\",\n                            \"k8s.gcr.io/pause:3.2\"\n                        ],\n                        \"sizeBytes\": 299513\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\",\n                \"uid\": \"e3ee3e88-18b3-487b-b4df-ac06ffd7fa73\",\n                \"resourceVersion\": \"793\",\n                \"creationTimestamp\": \"2021-09-23T16:32:33Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"ap-northeast-1\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"ap-northeast-1a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-ap-northeast-1a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"node\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"topology.kubernetes.io/region\": \"ap-northeast-1\",\n                    \"topology.kubernetes.io/zone\": \"ap-northeast-1a\"\n                },\n                \"annotations\": {\n                    \"flannel.alpha.coreos.com/backend-data\": \"{\\\"VtepMAC\\\":\\\"16:79:43:31:3d:09\\\"}\",\n                    \"flannel.alpha.coreos.com/backend-type\": \"vxlan\",\n                    \"flannel.alpha.coreos.com/kube-subnet-manager\": \"true\",\n                    \"flannel.alpha.coreos.com/public-ip\": \"172.20.43.215\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.4.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.4.0/24\"\n                ],\n                \"providerID\": \"aws:///ap-northeast-1a/i-078633771d149434c\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"50319340Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3977792Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"46374303668\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3875392Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:32:45Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:45Z\",\n                        \"reason\": \"FlannelIsUp\",\n                        \"message\": \"Flannel is running on this node\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:33:03Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:33Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:33:03Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:33Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:33:03Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:33Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:33:03Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:43Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.43.215\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"54.238.117.197\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-54-238-117-197.ap-northeast-1.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec214dee1f497e5a0c3f972da49e4684\",\n                    \"systemUUID\": \"EC26864F-E941-077E-E725-78D2ED9C9FA0\",\n                    \"bootID\": \"a026338f-d791-4b55-91aa-72a4b27fca5c\",\n                    \"kernelVersion\": \"4.14.243-185.433.amzn2.x86_64\",\n                    \"osImage\": \"Amazon Linux 2\",\n                    \"containerRuntimeVersion\": \"containerd://1.4.9\",\n                    \"kubeletVersion\": \"v1.21.5\",\n                    \"kubeProxyVersion\": \"v1.21.5\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 105352393\n                    },\n                    {\n                        \"names\": [\n                            \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                            \"quay.io/coreos/flannel:v0.13.0\"\n                        ],\n                        \"sizeBytes\": 19388223\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/coredns/coredns@sha256:6e5a02c21641597998b4be7cb5eb1e7b02c0d8d23cce4dd09f4682d463798890\",\n                            \"k8s.gcr.io/coredns/coredns:v1.8.4\"\n                        ],\n                        \"sizeBytes\": 13707249\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f\",\n                            \"k8s.gcr.io/pause:3.2\"\n                        ],\n                        \"sizeBytes\": 299513\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-54-72.ap-northeast-1.compute.internal\",\n                \"uid\": \"38dfc56a-a21b-4dfb-9fcf-27118947e0b4\",\n                \"resourceVersion\": \"787\",\n                \"creationTimestamp\": \"2021-09-23T16:32:31Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"ap-northeast-1\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"ap-northeast-1a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-ap-northeast-1a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-54-72.ap-northeast-1.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"node\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"topology.kubernetes.io/region\": \"ap-northeast-1\",\n                    \"topology.kubernetes.io/zone\": \"ap-northeast-1a\"\n                },\n                \"annotations\": {\n                    \"flannel.alpha.coreos.com/backend-data\": \"{\\\"VtepMAC\\\":\\\"9a:88:cf:b2:c5:1e\\\"}\",\n                    \"flannel.alpha.coreos.com/backend-type\": \"vxlan\",\n                    \"flannel.alpha.coreos.com/kube-subnet-manager\": \"true\",\n                    \"flannel.alpha.coreos.com/public-ip\": \"172.20.54.72\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.3.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.3.0/24\"\n                ],\n                \"providerID\": \"aws:///ap-northeast-1a/i-06dfe49066c4bc329\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"50319340Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3977792Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"46374303668\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3875392Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:32:44Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:44Z\",\n                        \"reason\": \"FlannelIsUp\",\n                        \"message\": \"Flannel is running on this node\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:33:01Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:31Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:33:01Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:31Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:33:01Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:31Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:33:01Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:51Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.54.72\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"3.112.222.63\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-54-72.ap-northeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-54-72.ap-northeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-3-112-222-63.ap-northeast-1.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec214dee1f497e5a0c3f972da49e4684\",\n                    \"systemUUID\": \"EC2A2658-180E-3D09-4CA7-F1453FBFC248\",\n                    \"bootID\": \"ce26d5ff-0de6-4abd-a4fb-b06940148eeb\",\n                    \"kernelVersion\": \"4.14.243-185.433.amzn2.x86_64\",\n                    \"osImage\": \"Amazon Linux 2\",\n                    \"containerRuntimeVersion\": \"containerd://1.4.9\",\n                    \"kubeletVersion\": \"v1.21.5\",\n                    \"kubeProxyVersion\": \"v1.21.5\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 105352393\n                    },\n                    {\n                        \"names\": [\n                            \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                            \"quay.io/coreos/flannel:v0.13.0\"\n                        ],\n                        \"sizeBytes\": 19388223\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f\",\n                            \"k8s.gcr.io/pause:3.2\"\n                        ],\n                        \"sizeBytes\": 299513\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\",\n                \"uid\": \"692468f8-c0fd-4f1b-ba63-3a5833701dc5\",\n                \"resourceVersion\": \"765\",\n                \"creationTimestamp\": \"2021-09-23T16:32:25Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"ap-northeast-1\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"ap-northeast-1a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-ap-northeast-1a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"node\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"topology.kubernetes.io/region\": \"ap-northeast-1\",\n                    \"topology.kubernetes.io/zone\": \"ap-northeast-1a\"\n                },\n                \"annotations\": {\n                    \"flannel.alpha.coreos.com/backend-data\": \"{\\\"VtepMAC\\\":\\\"b2:92:7e:9b:25:fb\\\"}\",\n                    \"flannel.alpha.coreos.com/backend-type\": \"vxlan\",\n                    \"flannel.alpha.coreos.com/kube-subnet-manager\": \"true\",\n                    \"flannel.alpha.coreos.com/public-ip\": \"172.20.63.252\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.1.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.1.0/24\"\n                ],\n                \"providerID\": \"aws:///ap-northeast-1a/i-0205747e31c81c410\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"50319340Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3977792Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"46374303668\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3875392Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:32:38Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:38Z\",\n                        \"reason\": \"FlannelIsUp\",\n                        \"message\": \"Flannel is running on this node\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:32:55Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:25Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:32:55Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:25Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:32:55Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:25Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-09-23T16:32:55Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:45Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.63.252\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"18.183.255.70\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-18-183-255-70.ap-northeast-1.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec214dee1f497e5a0c3f972da49e4684\",\n                    \"systemUUID\": \"EC2BE762-469D-3DB8-D36D-3F3DBAECFD12\",\n                    \"bootID\": \"7a0c22ad-f6e6-400d-94fb-a71b7721e287\",\n                    \"kernelVersion\": \"4.14.243-185.433.amzn2.x86_64\",\n                    \"osImage\": \"Amazon Linux 2\",\n                    \"containerRuntimeVersion\": \"containerd://1.4.9\",\n                    \"kubeletVersion\": \"v1.21.5\",\n                    \"kubeProxyVersion\": \"v1.21.5\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 105352393\n                    },\n                    {\n                        \"names\": [\n                            \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                            \"quay.io/coreos/flannel:v0.13.0\"\n                        ],\n                        \"sizeBytes\": 19388223\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def\",\n                            \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\"\n                        ],\n                        \"sizeBytes\": 15209393\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f\",\n                            \"k8s.gcr.io/pause:3.2\"\n                        ],\n                        \"sizeBytes\": 299513\n                    }\n                ]\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"EventList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"266\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-nfmmr.16a780852e9d96f2\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c1a1123d-7d08-47a4-8b5d-4271b536bd24\",\n                \"resourceVersion\": \"93\",\n                \"creationTimestamp\": \"2021-09-23T16:31:39Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-nfmmr\",\n                \"uid\": \"52da063f-6abb-4694-a8a1-51c790b93c93\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"426\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/1 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:39Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:05Z\",\n            \"count\": 5,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-nfmmr.16a78090011f0b19\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"310a1e24-366c-41fd-bb1b-aecf7ed4d487\",\n                \"resourceVersion\": \"98\",\n                \"creationTimestamp\": \"2021-09-23T16:32:25Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-nfmmr\",\n                \"uid\": \"52da063f-6abb-4694-a8a1-51c790b93c93\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"454\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/2 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate, 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:25Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:25Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-nfmmr.16a78092763e86a7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3712d085-fb15-447f-a12c-c0e65173124d\",\n                \"resourceVersion\": \"159\",\n                \"creationTimestamp\": \"2021-09-23T16:32:36Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-nfmmr\",\n                \"uid\": \"52da063f-6abb-4694-a8a1-51c790b93c93\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"576\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/5 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate, 4 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:36Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:36Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-nfmmr.16a78094cae37ec8\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2dde7173-1180-4143-934f-25b4a516cbc9\",\n                \"resourceVersion\": \"188\",\n                \"creationTimestamp\": \"2021-09-23T16:32:46Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-nfmmr\",\n                \"uid\": \"52da063f-6abb-4694-a8a1-51c790b93c93\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"652\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/coredns-5dc785954d-nfmmr to ip-172-20-34-24.ap-northeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:46Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:46Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-nfmmr.16a7809504747c29\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"890b2e13-7b06-4407-817b-453dace62de6\",\n                \"resourceVersion\": \"189\",\n                \"creationTimestamp\": \"2021-09-23T16:32:47Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-nfmmr\",\n                \"uid\": \"52da063f-6abb-4694-a8a1-51c790b93c93\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"708\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/coredns/coredns:v1.8.4\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:47Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:47Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-nfmmr.16a78095914bbde0\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b3d10be0-8223-47d0-b0f4-c46c40fe8d0b\",\n                \"resourceVersion\": \"193\",\n                \"creationTimestamp\": \"2021-09-23T16:32:49Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-nfmmr\",\n                \"uid\": \"52da063f-6abb-4694-a8a1-51c790b93c93\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"708\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/coredns/coredns:v1.8.4\\\" in 2.36286204s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:49Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:49Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-nfmmr.16a78095996981e4\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6ae98a2f-b668-43d6-bd88-f2333c2c10f3\",\n                \"resourceVersion\": \"194\",\n                \"creationTimestamp\": \"2021-09-23T16:32:49Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-nfmmr\",\n                \"uid\": \"52da063f-6abb-4694-a8a1-51c790b93c93\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"708\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:49Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:49Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-nfmmr.16a78095a1f59681\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8b1103d5-baa4-4a95-92d0-695d75de54a0\",\n                \"resourceVersion\": \"195\",\n                \"creationTimestamp\": \"2021-09-23T16:32:50Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-nfmmr\",\n                \"uid\": \"52da063f-6abb-4694-a8a1-51c790b93c93\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"708\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:50Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:50Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-nfmmr.16a78095a63d5dd2\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f8970359-4054-4db0-9e04-f8a8269a84b6\",\n                \"resourceVersion\": \"196\",\n                \"creationTimestamp\": \"2021-09-23T16:32:50Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-nfmmr\",\n                \"uid\": \"52da063f-6abb-4694-a8a1-51c790b93c93\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"708\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Unhealthy\",\n            \"message\": \"Readiness probe failed: HTTP probe failed with statuscode: 503\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:50Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:50Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-wbcvv.16a78095ebb317e7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"efb0cc4f-5ba7-4b71-b7b4-1411d70a8b32\",\n                \"resourceVersion\": \"202\",\n                \"creationTimestamp\": \"2021-09-23T16:32:51Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-wbcvv\",\n                \"uid\": \"0520aa32-9018-4ecc-a085-03724175ab96\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"730\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/coredns-5dc785954d-wbcvv to ip-172-20-43-215.ap-northeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:51Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:51Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-wbcvv.16a7809626e1de25\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4ec13a04-7e96-4c0e-95f5-d0d7af2f1509\",\n                \"resourceVersion\": \"204\",\n                \"creationTimestamp\": \"2021-09-23T16:32:52Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-wbcvv\",\n                \"uid\": \"0520aa32-9018-4ecc-a085-03724175ab96\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"732\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/coredns/coredns:v1.8.4\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:52Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:52Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-wbcvv.16a780969f522438\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7ee53777-93a0-4a4a-8454-517e91479d2f\",\n                \"resourceVersion\": \"205\",\n                \"creationTimestamp\": \"2021-09-23T16:32:54Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-wbcvv\",\n                \"uid\": \"0520aa32-9018-4ecc-a085-03724175ab96\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"732\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/coredns/coredns:v1.8.4\\\" in 2.020601147s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:54Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:54Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-wbcvv.16a78096a81a4630\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2afc23c5-1645-4eaf-89bc-080afa4152b2\",\n                \"resourceVersion\": \"206\",\n                \"creationTimestamp\": \"2021-09-23T16:32:54Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-wbcvv\",\n                \"uid\": \"0520aa32-9018-4ecc-a085-03724175ab96\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"732\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:54Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:54Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-wbcvv.16a78096af2212de\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1b713351-1768-4aa1-a51f-77d6bda87d24\",\n                \"resourceVersion\": \"207\",\n                \"creationTimestamp\": \"2021-09-23T16:32:54Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d-wbcvv\",\n                \"uid\": \"0520aa32-9018-4ecc-a085-03724175ab96\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"732\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:54Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:54Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d.16a7808191b0218b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b21999b2-8ab6-4389-a7b6-43b1b52f2a07\",\n                \"resourceVersion\": \"63\",\n                \"creationTimestamp\": \"2021-09-23T16:31:23Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d\",\n                \"uid\": \"33c65ec4-8b36-4e61-998f-4c5a180dadc4\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"417\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: coredns-5dc785954d-nfmmr\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:23Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:23Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d.16a78095eb4e2bee\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a675658a-1008-4451-8b0e-39b0eb0d604f\",\n                \"resourceVersion\": \"201\",\n                \"creationTimestamp\": \"2021-09-23T16:32:51Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-5dc785954d\",\n                \"uid\": \"33c65ec4-8b36-4e61-998f-4c5a180dadc4\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"728\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: coredns-5dc785954d-wbcvv\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:51Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:51Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-4mrql.16a7808531279eb7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f778f2ff-ce62-46b4-9f5c-b02bc25783cf\",\n                \"resourceVersion\": \"94\",\n                \"creationTimestamp\": \"2021-09-23T16:31:39Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-4mrql\",\n                \"uid\": \"f7410268-adc8-4ef2-a660-87bd13a043b6\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"427\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/1 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:39Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:05Z\",\n            \"count\": 5,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-4mrql.16a78090023e11c4\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6660a033-46ed-431e-8648-020bdb70da1d\",\n                \"resourceVersion\": \"101\",\n                \"creationTimestamp\": \"2021-09-23T16:32:25Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-4mrql\",\n                \"uid\": \"f7410268-adc8-4ef2-a660-87bd13a043b6\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"456\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/2 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate, 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:25Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:25Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-4mrql.16a7809276d24743\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"10d5ab45-0682-4229-a55d-30e97e15268b\",\n                \"resourceVersion\": \"160\",\n                \"creationTimestamp\": \"2021-09-23T16:32:36Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-4mrql\",\n                \"uid\": \"f7410268-adc8-4ef2-a660-87bd13a043b6\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"580\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/5 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate, 4 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:36Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:36Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-4mrql.16a7809506732c0d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3b95acd1-0c3e-4822-ae28-28363f70a747\",\n                \"resourceVersion\": \"190\",\n                \"creationTimestamp\": \"2021-09-23T16:32:47Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-4mrql\",\n                \"uid\": \"f7410268-adc8-4ef2-a660-87bd13a043b6\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"653\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/coredns-autoscaler-84d4cfd89c-4mrql to ip-172-20-63-252.ap-northeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:47Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:47Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-4mrql.16a78095352b71f1\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3c4b4508-c5dc-4693-8b96-143270a4a1d3\",\n                \"resourceVersion\": \"191\",\n                \"creationTimestamp\": \"2021-09-23T16:32:48Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-4mrql\"\n            },\n            \"reason\": \"TaintManagerEviction\",\n            \"message\": \"Cancelling deletion of Pod kube-system/coredns-autoscaler-84d4cfd89c-4mrql\",\n            \"source\": {\n                \"component\": \"taint-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:48Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:48Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-4mrql.16a780953c70c432\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4e52243a-b767-4a9b-9809-b7d9c8d3736e\",\n                \"resourceVersion\": \"192\",\n                \"creationTimestamp\": \"2021-09-23T16:32:48Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-4mrql\",\n                \"uid\": \"f7410268-adc8-4ef2-a660-87bd13a043b6\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"710\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:48Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:48Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-4mrql.16a78095c50b2f7c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8a420299-c4fc-4c4f-873d-77317127c1c2\",\n                \"resourceVersion\": \"197\",\n                \"creationTimestamp\": \"2021-09-23T16:32:50Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-4mrql\",\n                \"uid\": \"f7410268-adc8-4ef2-a660-87bd13a043b6\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"710\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\\\" in 2.291804095s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:50Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:50Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-4mrql.16a78095d369f792\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"61e4a68e-490a-4e80-a2ed-1afc2c37f72a\",\n                \"resourceVersion\": \"198\",\n                \"creationTimestamp\": \"2021-09-23T16:32:50Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-4mrql\",\n                \"uid\": \"f7410268-adc8-4ef2-a660-87bd13a043b6\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"710\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container autoscaler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:50Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:50Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-4mrql.16a78095dae4a4a2\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"198e01a0-01fd-4629-bc6e-50fbab8ee1bd\",\n                \"resourceVersion\": \"199\",\n                \"creationTimestamp\": \"2021-09-23T16:32:51Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-4mrql\",\n                \"uid\": \"f7410268-adc8-4ef2-a660-87bd13a043b6\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"710\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container autoscaler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:51Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:51Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c.16a78081922951a6\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f3373e5c-2bff-4f1c-9fa6-b172686f5487\",\n                \"resourceVersion\": \"65\",\n                \"creationTimestamp\": \"2021-09-23T16:31:23Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c\",\n                \"uid\": \"65f35825-656d-44eb-9eee-dcb1573fe692\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"418\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: coredns-autoscaler-84d4cfd89c-4mrql\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:23Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:23Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler.16a780818982ec66\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"cbbb352b-1a29-4342-bd24-edbc172bd55d\",\n                \"resourceVersion\": \"60\",\n                \"creationTimestamp\": \"2021-09-23T16:31:23Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler\",\n                \"uid\": \"f7fa6f4d-3641-4caa-92a8-d9636b72bcbd\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"301\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set coredns-autoscaler-84d4cfd89c to 1\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:23Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:23Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns.16a780818979b9b3\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1b090abb-9d81-43c4-88a3-33280cd68e16\",\n                \"resourceVersion\": \"59\",\n                \"creationTimestamp\": \"2021-09-23T16:31:23Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns\",\n                \"uid\": \"043f7284-5214-407f-8baa-1c7fa9d33a51\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"292\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set coredns-5dc785954d to 1\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:23Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:23Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns.16a78095eab1b57a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fb53ace5-1f4a-4ad3-b88a-846422acbc39\",\n                \"resourceVersion\": \"200\",\n                \"creationTimestamp\": \"2021-09-23T16:32:51Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns\",\n                \"uid\": \"043f7284-5214-407f-8baa-1c7fa9d33a51\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"727\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set coredns-5dc785954d to 2\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:51Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:51Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-56b8dc9b5b-rgnj7.16a7808531b0bcf7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3aa10dfa-3d2c-40b2-96a1-09eaf66cfa0a\",\n                \"resourceVersion\": \"70\",\n                \"creationTimestamp\": \"2021-09-23T16:31:39Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-56b8dc9b5b-rgnj7\",\n                \"uid\": \"d9390b2c-dd47-4ffa-b3fe-aab39d6cf8d0\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"428\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/dns-controller-56b8dc9b5b-rgnj7 to ip-172-20-42-57.ap-northeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:39Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:39Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-56b8dc9b5b-rgnj7.16a780855bd3dd29\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fe794ee5-5c6e-4f2d-8366-a8ce6bc0e6fa\",\n                \"resourceVersion\": \"72\",\n                \"creationTimestamp\": \"2021-09-23T16:31:40Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-56b8dc9b5b-rgnj7\",\n                \"uid\": \"d9390b2c-dd47-4ffa-b3fe-aab39d6cf8d0\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"457\",\n                \"fieldPath\": \"spec.containers{dns-controller}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kops/dns-controller:1.21.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:40Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:40Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-56b8dc9b5b-rgnj7.16a78085601748b5\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f49d2606-f808-4910-8b1e-7fd20b56b6d8\",\n                \"resourceVersion\": \"73\",\n                \"creationTimestamp\": \"2021-09-23T16:31:40Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-56b8dc9b5b-rgnj7\",\n                \"uid\": \"d9390b2c-dd47-4ffa-b3fe-aab39d6cf8d0\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"457\",\n                \"fieldPath\": \"spec.containers{dns-controller}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container dns-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:40Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:40Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-56b8dc9b5b-rgnj7.16a780856745ca0e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7173aefe-e546-488b-894a-0913d2d4d523\",\n                \"resourceVersion\": \"74\",\n                \"creationTimestamp\": \"2021-09-23T16:31:40Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-56b8dc9b5b-rgnj7\",\n                \"uid\": \"d9390b2c-dd47-4ffa-b3fe-aab39d6cf8d0\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"457\",\n                \"fieldPath\": \"spec.containers{dns-controller}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container dns-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:40Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:40Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-56b8dc9b5b.16a78081922403d3\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"eb19ab58-8f59-4010-8b7a-be88cace212d\",\n                \"resourceVersion\": \"64\",\n                \"creationTimestamp\": \"2021-09-23T16:31:23Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-56b8dc9b5b\",\n                \"uid\": \"6c6e26d6-69db-4af5-b908-57a0f03ec412\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"416\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: dns-controller-56b8dc9b5b-rgnj7\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:23Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:23Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller.16a7808188c1cf6a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"0762ee40-b1e4-40e1-95b1-d15bb2512fa0\",\n                \"resourceVersion\": \"58\",\n                \"creationTimestamp\": \"2021-09-23T16:31:23Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller\",\n                \"uid\": \"a8c3bab2-ef11-4f61-8614-085429ca6ad5\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"308\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set dns-controller-56b8dc9b5b to 1\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:23Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:23Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-42-57.ap-northeast-1.compute.internal.16a780737873c226\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3a16e157-d031-468e-8b72-914ce1c41340\",\n                \"resourceVersion\": \"29\",\n                \"creationTimestamp\": \"2021-09-23T16:31:17Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"1505dbbcc3704681e070ada96386576b\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:23Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:23Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-42-57.ap-northeast-1.compute.internal.16a78076ca328746\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"791de497-c6a6-4dd7-b503-fa92b7ea5c52\",\n                \"resourceVersion\": \"44\",\n                \"creationTimestamp\": \"2021-09-23T16:31:20Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"1505dbbcc3704681e070ada96386576b\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\\\" in 14.256343839s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:37Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:37Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-42-57.ap-northeast-1.compute.internal.16a780772aea85c3\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"64ffa17d-47ec-4ab7-aaa7-22eb46bdf050\",\n                \"resourceVersion\": \"47\",\n                \"creationTimestamp\": \"2021-09-23T16:31:20Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"1505dbbcc3704681e070ada96386576b\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:39Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:39Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-42-57.ap-northeast-1.compute.internal.16a78077333028c7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"33e771b5-3e5e-4319-9c11-400095398cca\",\n                \"resourceVersion\": \"49\",\n                \"creationTimestamp\": \"2021-09-23T16:31:21Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"1505dbbcc3704681e070ada96386576b\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:39Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:39Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-42-57.ap-northeast-1.compute.internal.16a7807383d26799\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"04d5882c-84e7-4446-8adf-2bb5a630138c\",\n                \"resourceVersion\": \"30\",\n                \"creationTimestamp\": \"2021-09-23T16:31:17Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"ad8477668726fa8352eccd35e530400d\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:23Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:23Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-42-57.ap-northeast-1.compute.internal.16a78076fc12e4a8\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6cd847d4-1b61-4fb7-b9a6-ac6d50e4d6ce\",\n                \"resourceVersion\": \"45\",\n                \"creationTimestamp\": \"2021-09-23T16:31:20Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"ad8477668726fa8352eccd35e530400d\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\\\" in 14.902378595s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:38Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:38Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-42-57.ap-northeast-1.compute.internal.16a780772ad975d5\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8a1c5976-28aa-421d-a583-f277be289b53\",\n                \"resourceVersion\": \"46\",\n                \"creationTimestamp\": \"2021-09-23T16:31:20Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"ad8477668726fa8352eccd35e530400d\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:39Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:39Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-42-57.ap-northeast-1.compute.internal.16a7807730630c61\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9074cf14-a5e9-4da9-b6c0-e93a623e8716\",\n                \"resourceVersion\": \"48\",\n                \"creationTimestamp\": \"2021-09-23T16:31:21Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"ad8477668726fa8352eccd35e530400d\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:39Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:39Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-cdk2g.16a780892d6c5aa4\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6253bec4-f762-474d-9d9b-aef571ac41ba\",\n                \"resourceVersion\": \"88\",\n                \"creationTimestamp\": \"2021-09-23T16:31:56Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-cdk2g\",\n                \"uid\": \"57d7addd-c52f-4b45-afe8-89c401845d52\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"495\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kops-controller-cdk2g to ip-172-20-42-57.ap-northeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:56Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:56Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-cdk2g.16a7808952554124\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6d07b016-3d70-452c-ad64-925c5b63632d\",\n                \"resourceVersion\": \"89\",\n                \"creationTimestamp\": \"2021-09-23T16:31:57Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-cdk2g\",\n                \"uid\": \"57d7addd-c52f-4b45-afe8-89c401845d52\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"496\",\n                \"fieldPath\": \"spec.containers{kops-controller}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kops/kops-controller:1.21.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:57Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:57Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-cdk2g.16a7808956132863\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fc44930a-0fd2-4235-be99-ee0b36f8f493\",\n                \"resourceVersion\": \"90\",\n                \"creationTimestamp\": \"2021-09-23T16:31:57Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-cdk2g\",\n                \"uid\": \"57d7addd-c52f-4b45-afe8-89c401845d52\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"496\",\n                \"fieldPath\": \"spec.containers{kops-controller}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kops-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:57Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:57Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-cdk2g.16a780895d21e027\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"82c7fcce-e6f7-49d5-ba28-92a353d39fb9\",\n                \"resourceVersion\": \"91\",\n                \"creationTimestamp\": \"2021-09-23T16:31:57Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-cdk2g\",\n                \"uid\": \"57d7addd-c52f-4b45-afe8-89c401845d52\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"496\",\n                \"fieldPath\": \"spec.containers{kops-controller}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kops-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:57Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:57Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-leader.16a78089831e7ce6\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3d0bd48c-6856-49f6-80ac-33b318a86e7d\",\n                \"resourceVersion\": \"92\",\n                \"creationTimestamp\": \"2021-09-23T16:31:58Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ConfigMap\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-leader\",\n                \"uid\": \"6b686c9e-670f-423a-9d98-756e93c3d4aa\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"503\"\n            },\n            \"reason\": \"LeaderElection\",\n            \"message\": \"ip-172-20-42-57.ap-northeast-1.compute.internal_f97ad562-7cc6-4486-a992-363daacbbde4 became leader\",\n            \"source\": {\n                \"component\": \"ip-172-20-42-57.ap-northeast-1.compute.internal_f97ad562-7cc6-4486-a992-363daacbbde4\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:58Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:58Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller.16a780892ca5139e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"63191397-6a94-4d51-8d44-c7a67a0a47c5\",\n                \"resourceVersion\": \"87\",\n                \"creationTimestamp\": \"2021-09-23T16:31:56Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller\",\n                \"uid\": \"d0fadbda-5aca-41c0-95d0-2a5e0dbf94d3\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"411\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kops-controller-cdk2g\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:56Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:56Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-42-57.ap-northeast-1.compute.internal.16a78073afe7e4ac\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f3d059c5-210a-4d5a-a484-74efc3a76e34\",\n                \"resourceVersion\": \"53\",\n                \"creationTimestamp\": \"2021-09-23T16:31:18Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"812493a4619e1b63869c54ea45dc35fe\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-apiserver}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-apiserver-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:24Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:53Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-42-57.ap-northeast-1.compute.internal.16a7807559ccec35\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e7bee6a4-0b53-45ad-a0b7-b2dadef39396\",\n                \"resourceVersion\": \"54\",\n                \"creationTimestamp\": \"2021-09-23T16:31:19Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"812493a4619e1b63869c54ea45dc35fe\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-apiserver}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-apiserver\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:31Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:53Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-42-57.ap-northeast-1.compute.internal.16a7807564ac94a0\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d17ec2ee-0dbf-4717-a22f-d35ce9f2620b\",\n                \"resourceVersion\": \"55\",\n                \"creationTimestamp\": \"2021-09-23T16:31:19Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"812493a4619e1b63869c54ea45dc35fe\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-apiserver}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-apiserver\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:31Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:53Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-42-57.ap-northeast-1.compute.internal.16a7807564b7907f\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"32711758-2083-4cb3-8d4c-6ae219fc5fbd\",\n                \"resourceVersion\": \"41\",\n                \"creationTimestamp\": \"2021-09-23T16:31:19Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"812493a4619e1b63869c54ea45dc35fe\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{healthcheck}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kops/kube-apiserver-healthcheck:1.21.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:31Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:31Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-42-57.ap-northeast-1.compute.internal.16a78075959c6915\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a336c5be-60b4-41c9-a88e-1e13defe62dd\",\n                \"resourceVersion\": \"42\",\n                \"creationTimestamp\": \"2021-09-23T16:31:19Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"812493a4619e1b63869c54ea45dc35fe\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{healthcheck}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container healthcheck\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:32Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:32Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-42-57.ap-northeast-1.compute.internal.16a780759d399999\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fdea63d5-1d8b-4bad-9903-fd4e489f1788\",\n                \"resourceVersion\": \"43\",\n                \"creationTimestamp\": \"2021-09-23T16:31:20Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"812493a4619e1b63869c54ea45dc35fe\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{healthcheck}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container healthcheck\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:32Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:32Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-ip-172-20-42-57.ap-northeast-1.compute.internal.16a78073ad845440\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9d78b103-229a-4a76-b42d-6ef7bc5e919f\",\n                \"resourceVersion\": \"35\",\n                \"creationTimestamp\": \"2021-09-23T16:31:18Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"768810cb4a21155e5c9f3ce3bb1dfc4b\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/kube-controller-manager-amd64:v1.21.5\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:24Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:24Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-ip-172-20-42-57.ap-northeast-1.compute.internal.16a7807735e69898\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"86d47c7b-f508-4958-ac75-05331032163a\",\n                \"resourceVersion\": \"50\",\n                \"creationTimestamp\": \"2021-09-23T16:31:21Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"768810cb4a21155e5c9f3ce3bb1dfc4b\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/kube-controller-manager-amd64:v1.21.5\\\" in 15.173029001s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:39Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:39Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-ip-172-20-42-57.ap-northeast-1.compute.internal.16a7807738cd220b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"eafff21a-dc95-419d-b9d5-4bd5a6fea6d0\",\n                \"resourceVersion\": \"51\",\n                \"creationTimestamp\": \"2021-09-23T16:31:21Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"768810cb4a21155e5c9f3ce3bb1dfc4b\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-controller-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:39Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:39Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-ip-172-20-42-57.ap-northeast-1.compute.internal.16a7807741517df9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d071b256-6b3c-4ba6-890e-e996d73560d4\",\n                \"resourceVersion\": \"52\",\n                \"creationTimestamp\": \"2021-09-23T16:31:21Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"768810cb4a21155e5c9f3ce3bb1dfc4b\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-controller-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:39Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:39Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager.16a7807e37a7921f\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"bfd418ac-83f3-4256-9c0a-86ba814a1f94\",\n                \"resourceVersion\": \"2\",\n                \"creationTimestamp\": \"2021-09-23T16:31:09Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Lease\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager\",\n                \"uid\": \"83a27fc0-55b9-4882-ba7d-01f2036654e9\",\n                \"apiVersion\": \"coordination.k8s.io/v1\",\n                \"resourceVersion\": \"215\"\n            },\n            \"reason\": \"LeaderElection\",\n            \"message\": \"ip-172-20-42-57.ap-northeast-1.compute.internal_23b0a126-0e3f-4e26-b55b-b9777b393b7f became leader\",\n            \"source\": {\n                \"component\": \"kube-controller-manager\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:09Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:09Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-dns.16a780816b6614f2\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5cfcabf3-da90-4ff0-8e7e-39b5aa5c396c\",\n                \"resourceVersion\": \"62\",\n                \"creationTimestamp\": \"2021-09-23T16:31:23Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"PodDisruptionBudget\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-dns\",\n                \"uid\": \"23091c76-8e55-413d-b40d-e97b523650c0\",\n                \"apiVersion\": \"policy/v1\",\n                \"resourceVersion\": \"295\"\n            },\n            \"reason\": \"NoPods\",\n            \"message\": \"No matching pods found\",\n            \"source\": {\n                \"component\": \"controllermanager\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:23Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:23Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-758lm.16a7809003abe2e4\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"742d495d-ac30-4c45-9d95-75a5da5edc4c\",\n                \"resourceVersion\": \"103\",\n                \"creationTimestamp\": \"2021-09-23T16:32:25Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-758lm\",\n                \"uid\": \"eb0e27af-6569-4ff1-bcd9-82bb9ab356cb\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"579\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kube-flannel-ds-758lm to ip-172-20-63-252.ap-northeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:25Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:25Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-758lm.16a78090e7ed9b7a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"85b08735-9bce-4a5e-925c-16a3c9970c8d\",\n                \"resourceVersion\": \"109\",\n                \"creationTimestamp\": \"2021-09-23T16:32:29Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-758lm\",\n                \"uid\": \"eb0e27af-6569-4ff1-bcd9-82bb9ab356cb\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"582\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"quay.io/coreos/flannel:v0.13.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:29Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:29Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-758lm.16a7809261a6c58b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d4fdd6e3-2c69-4f52-bb71-51b771a99327\",\n                \"resourceVersion\": \"154\",\n                \"creationTimestamp\": \"2021-09-23T16:32:36Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-758lm\",\n                \"uid\": \"eb0e27af-6569-4ff1-bcd9-82bb9ab356cb\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"582\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"quay.io/coreos/flannel:v0.13.0\\\" in 6.337126921s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:36Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:36Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-758lm.16a7809275775bd9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"66d205d6-6eeb-46e8-90ec-10d2be7426bd\",\n                \"resourceVersion\": \"158\",\n                \"creationTimestamp\": \"2021-09-23T16:32:36Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-758lm\",\n                \"uid\": \"eb0e27af-6569-4ff1-bcd9-82bb9ab356cb\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"582\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:36Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:36Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-758lm.16a780927cf5ec78\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"ff5b9fd5-818f-43e3-955d-02bef512a00b\",\n                \"resourceVersion\": \"161\",\n                \"creationTimestamp\": \"2021-09-23T16:32:36Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-758lm\",\n                \"uid\": \"eb0e27af-6569-4ff1-bcd9-82bb9ab356cb\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"582\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:36Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:36Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-758lm.16a78092ae0bf1be\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"65e285ed-c60a-428a-93f2-50cb91b66051\",\n                \"resourceVersion\": \"163\",\n                \"creationTimestamp\": \"2021-09-23T16:32:37Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-758lm\",\n                \"uid\": \"eb0e27af-6569-4ff1-bcd9-82bb9ab356cb\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"582\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"quay.io/coreos/flannel:v0.13.0\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:37Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:37Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-758lm.16a78092b1ce3b89\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a9c7e06f-f461-4e9b-b7fb-84c84d0faac6\",\n                \"resourceVersion\": \"164\",\n                \"creationTimestamp\": \"2021-09-23T16:32:37Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-758lm\",\n                \"uid\": \"eb0e27af-6569-4ff1-bcd9-82bb9ab356cb\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"582\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:37Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:37Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-758lm.16a78092b9a38572\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"779c0d2c-9ce0-4fc7-af0d-408e76bf4fab\",\n                \"resourceVersion\": \"165\",\n                \"creationTimestamp\": \"2021-09-23T16:32:37Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-758lm\",\n                \"uid\": \"eb0e27af-6569-4ff1-bcd9-82bb9ab356cb\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"582\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:37Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:37Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-9cctk.16a78091c944c064\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"84064f89-913f-4437-9ae4-047c31d059e6\",\n                \"resourceVersion\": \"141\",\n                \"creationTimestamp\": \"2021-09-23T16:32:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-9cctk\",\n                \"uid\": \"e7090420-c93a-4aa1-a10b-ead90d2505c9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"631\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kube-flannel-ds-9cctk to ip-172-20-43-215.ap-northeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:33Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-9cctk.16a780926b34a969\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"57595fee-a445-4552-a470-703795d733e3\",\n                \"resourceVersion\": \"157\",\n                \"creationTimestamp\": \"2021-09-23T16:32:36Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-9cctk\",\n                \"uid\": \"e7090420-c93a-4aa1-a10b-ead90d2505c9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"632\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"quay.io/coreos/flannel:v0.13.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:36Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:36Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-9cctk.16a78093e7401630\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c03d55b9-e9cc-44c2-b4ef-233a0ad0bd71\",\n                \"resourceVersion\": \"175\",\n                \"creationTimestamp\": \"2021-09-23T16:32:42Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-9cctk\",\n                \"uid\": \"e7090420-c93a-4aa1-a10b-ead90d2505c9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"632\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"quay.io/coreos/flannel:v0.13.0\\\" in 6.376075707s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:42Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:42Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-9cctk.16a78093f1595409\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7e6cb9ff-55d4-47a2-9b33-ff615b3abc8f\",\n                \"resourceVersion\": \"177\",\n                \"creationTimestamp\": \"2021-09-23T16:32:42Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-9cctk\",\n                \"uid\": \"e7090420-c93a-4aa1-a10b-ead90d2505c9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"632\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:42Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:42Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-9cctk.16a78093f7f6353f\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c23e80fd-ad2c-4d5d-9107-bb8db52d7325\",\n                \"resourceVersion\": \"179\",\n                \"creationTimestamp\": \"2021-09-23T16:32:42Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-9cctk\",\n                \"uid\": \"e7090420-c93a-4aa1-a10b-ead90d2505c9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"632\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:42Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:42Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-9cctk.16a7809432aa8a66\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"06fd2c72-7c39-4f01-a1bc-a3238f6f1e99\",\n                \"resourceVersion\": \"184\",\n                \"creationTimestamp\": \"2021-09-23T16:32:43Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-9cctk\",\n                \"uid\": \"e7090420-c93a-4aa1-a10b-ead90d2505c9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"632\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"quay.io/coreos/flannel:v0.13.0\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:43Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:43Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-9cctk.16a78094360c0777\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b2511ebc-abf9-4677-9587-c69e429be9b7\",\n                \"resourceVersion\": \"185\",\n                \"creationTimestamp\": \"2021-09-23T16:32:43Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-9cctk\",\n                \"uid\": \"e7090420-c93a-4aa1-a10b-ead90d2505c9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"632\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:43Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:43Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-9cctk.16a780943d1d4506\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1ffc7274-47a0-4191-ac84-ade46ac5524b\",\n                \"resourceVersion\": \"186\",\n                \"creationTimestamp\": \"2021-09-23T16:32:44Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-9cctk\",\n                \"uid\": \"e7090420-c93a-4aa1-a10b-ead90d2505c9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"632\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:44Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:44Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-jn9xx.16a78091563c08c9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5dc034d0-e6cb-4559-91fb-61609e5036ea\",\n                \"resourceVersion\": \"128\",\n                \"creationTimestamp\": \"2021-09-23T16:32:31Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-jn9xx\",\n                \"uid\": \"63019a38-6600-4f16-810d-364cfbb54a62\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"611\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kube-flannel-ds-jn9xx to ip-172-20-54-72.ap-northeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:31Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:31Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-jn9xx.16a7809250a4ea5b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d2514c6c-07e1-42e5-9a0a-6a1cec24e310\",\n                \"resourceVersion\": \"151\",\n                \"creationTimestamp\": \"2021-09-23T16:32:35Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-jn9xx\",\n                \"uid\": \"63019a38-6600-4f16-810d-364cfbb54a62\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"614\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"quay.io/coreos/flannel:v0.13.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-54-72.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:35Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:35Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-jn9xx.16a78093d0392a34\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c550ccca-6745-4a4c-ac18-c6110bb8adef\",\n                \"resourceVersion\": \"174\",\n                \"creationTimestamp\": \"2021-09-23T16:32:42Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-jn9xx\",\n                \"uid\": \"63019a38-6600-4f16-810d-364cfbb54a62\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"614\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"quay.io/coreos/flannel:v0.13.0\\\" in 6.435369381s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-54-72.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:42Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:42Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-jn9xx.16a78093ec7d9303\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c7c48186-8360-445a-ab52-36c71d60c208\",\n                \"resourceVersion\": \"176\",\n                \"creationTimestamp\": \"2021-09-23T16:32:42Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-jn9xx\",\n                \"uid\": \"63019a38-6600-4f16-810d-364cfbb54a62\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"614\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-54-72.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:42Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:42Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-jn9xx.16a78093f2c38973\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"917d0856-fe8b-452e-9111-b98765356f55\",\n                \"resourceVersion\": \"178\",\n                \"creationTimestamp\": \"2021-09-23T16:32:42Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-jn9xx\",\n                \"uid\": \"63019a38-6600-4f16-810d-364cfbb54a62\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"614\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-54-72.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:42Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:42Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-jn9xx.16a7809416616823\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"230bcf76-eb6b-4784-8391-dd28faae9d7c\",\n                \"resourceVersion\": \"180\",\n                \"creationTimestamp\": \"2021-09-23T16:32:43Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-jn9xx\",\n                \"uid\": \"63019a38-6600-4f16-810d-364cfbb54a62\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"614\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"quay.io/coreos/flannel:v0.13.0\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-54-72.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:43Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:43Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-jn9xx.16a780941ade0b97\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1e0a7416-f0b0-4086-a325-0d2eec85df03\",\n                \"resourceVersion\": \"181\",\n                \"creationTimestamp\": \"2021-09-23T16:32:43Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-jn9xx\",\n                \"uid\": \"63019a38-6600-4f16-810d-364cfbb54a62\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"614\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-54-72.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:43Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:43Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-jn9xx.16a7809421a32a34\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1e29fe36-7ed8-48aa-acb0-d5e7849f0a8c\",\n                \"resourceVersion\": \"183\",\n                \"creationTimestamp\": \"2021-09-23T16:32:43Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-jn9xx\",\n                \"uid\": \"63019a38-6600-4f16-810d-364cfbb54a62\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"614\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-54-72.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:43Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:43Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-lpmtw.16a78091278e6f4d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"752945bb-5300-4212-9d4f-7dd7666bfa0d\",\n                \"resourceVersion\": \"121\",\n                \"creationTimestamp\": \"2021-09-23T16:32:30Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-lpmtw\",\n                \"uid\": \"d1db4ff4-c3f0-41fb-965a-7309364fddcc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"603\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kube-flannel-ds-lpmtw to ip-172-20-34-24.ap-northeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:30Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:30Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-lpmtw.16a78091e0e622f5\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"957960c0-a348-41fc-b70b-01583e8bea01\",\n                \"resourceVersion\": \"146\",\n                \"creationTimestamp\": \"2021-09-23T16:32:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-lpmtw\",\n                \"uid\": \"d1db4ff4-c3f0-41fb-965a-7309364fddcc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"605\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"quay.io/coreos/flannel:v0.13.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:33Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-lpmtw.16a780935866eff4\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e1b65f52-de86-43b7-af3e-4d9505f96d19\",\n                \"resourceVersion\": \"167\",\n                \"creationTimestamp\": \"2021-09-23T16:32:40Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-lpmtw\",\n                \"uid\": \"d1db4ff4-c3f0-41fb-965a-7309364fddcc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"605\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"quay.io/coreos/flannel:v0.13.0\\\" in 6.299863186s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:40Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:40Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-lpmtw.16a780936201f9cc\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f33e159f-500f-462a-9926-a439ec1438fd\",\n                \"resourceVersion\": \"168\",\n                \"creationTimestamp\": \"2021-09-23T16:32:40Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-lpmtw\",\n                \"uid\": \"d1db4ff4-c3f0-41fb-965a-7309364fddcc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"605\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:40Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:40Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-lpmtw.16a78093697560a4\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"457de639-dcc7-480e-92d3-156c04c70e1a\",\n                \"resourceVersion\": \"169\",\n                \"creationTimestamp\": \"2021-09-23T16:32:40Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-lpmtw\",\n                \"uid\": \"d1db4ff4-c3f0-41fb-965a-7309364fddcc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"605\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:40Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:40Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-lpmtw.16a780938cc83176\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f6f34cf9-3e73-48c0-8767-d769e4a06572\",\n                \"resourceVersion\": \"171\",\n                \"creationTimestamp\": \"2021-09-23T16:32:41Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-lpmtw\",\n                \"uid\": \"d1db4ff4-c3f0-41fb-965a-7309364fddcc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"605\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"quay.io/coreos/flannel:v0.13.0\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:41Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:41Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-lpmtw.16a780939071cfcd\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5241dae3-a2fc-4d9c-ac70-c1b967405018\",\n                \"resourceVersion\": \"172\",\n                \"creationTimestamp\": \"2021-09-23T16:32:41Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-lpmtw\",\n                \"uid\": \"d1db4ff4-c3f0-41fb-965a-7309364fddcc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"605\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:41Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:41Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-lpmtw.16a780939791c560\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4b5a1b88-f9af-4aa8-b9b1-435e275e10f6\",\n                \"resourceVersion\": \"173\",\n                \"creationTimestamp\": \"2021-09-23T16:32:41Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-lpmtw\",\n                \"uid\": \"d1db4ff4-c3f0-41fb-965a-7309364fddcc\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"605\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:41Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:41Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-xdtzt.16a780852fb209f0\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d4f670c8-9e93-400c-a555-845528025fea\",\n                \"resourceVersion\": \"68\",\n                \"creationTimestamp\": \"2021-09-23T16:31:39Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-xdtzt\",\n                \"uid\": \"03ca9ab5-98dc-4097-b7bd-f518aa86607a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"412\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kube-flannel-ds-xdtzt to ip-172-20-42-57.ap-northeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:39Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:39Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-xdtzt.16a7808559345e52\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e12014dc-395b-4b5b-b5dd-55d99930a32f\",\n                \"resourceVersion\": \"71\",\n                \"creationTimestamp\": \"2021-09-23T16:31:40Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-xdtzt\",\n                \"uid\": \"03ca9ab5-98dc-4097-b7bd-f518aa86607a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"452\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"quay.io/coreos/flannel:v0.13.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:40Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:40Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-xdtzt.16a78086c9b277d2\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2f842447-aeae-4561-b08c-98305d19ac32\",\n                \"resourceVersion\": \"77\",\n                \"creationTimestamp\": \"2021-09-23T16:31:46Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-xdtzt\",\n                \"uid\": \"03ca9ab5-98dc-4097-b7bd-f518aa86607a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"452\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"quay.io/coreos/flannel:v0.13.0\\\" in 6.182257055s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:46Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:46Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-xdtzt.16a78086d2e05084\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b6507d63-e4d7-46bc-b864-b7d3e71ae1f4\",\n                \"resourceVersion\": \"78\",\n                \"creationTimestamp\": \"2021-09-23T16:31:46Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-xdtzt\",\n                \"uid\": \"03ca9ab5-98dc-4097-b7bd-f518aa86607a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"452\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:46Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:46Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-xdtzt.16a78086dc3b688b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8cd700f1-610c-47a0-a82b-73fe4cb0fca7\",\n                \"resourceVersion\": \"79\",\n                \"creationTimestamp\": \"2021-09-23T16:31:46Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-xdtzt\",\n                \"uid\": \"03ca9ab5-98dc-4097-b7bd-f518aa86607a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"452\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:46Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:46Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-xdtzt.16a78086fb902a6e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"52c9699f-eb89-4a6a-b995-0503f351efad\",\n                \"resourceVersion\": \"80\",\n                \"creationTimestamp\": \"2021-09-23T16:31:47Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-xdtzt\",\n                \"uid\": \"03ca9ab5-98dc-4097-b7bd-f518aa86607a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"452\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"quay.io/coreos/flannel:v0.13.0\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:47Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:47Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-xdtzt.16a78086feeb4d46\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"0e440a97-854c-4aab-bcdb-9c1664102512\",\n                \"resourceVersion\": \"81\",\n                \"creationTimestamp\": \"2021-09-23T16:31:47Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-xdtzt\",\n                \"uid\": \"03ca9ab5-98dc-4097-b7bd-f518aa86607a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"452\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:47Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:47Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-xdtzt.16a78087069935a4\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6736ba49-5d8a-41a0-b6df-7d4f880ca4ca\",\n                \"resourceVersion\": \"82\",\n                \"creationTimestamp\": \"2021-09-23T16:31:47Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-xdtzt\",\n                \"uid\": \"03ca9ab5-98dc-4097-b7bd-f518aa86607a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"452\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:47Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:47Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds.16a7808183414128\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3ae2966d-054a-4ebc-90b9-b671b71a6c9b\",\n                \"resourceVersion\": \"57\",\n                \"creationTimestamp\": \"2021-09-23T16:31:23Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds\",\n                \"uid\": \"98b93b87-2c8d-464d-b72d-5786378d4475\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"329\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kube-flannel-ds-xdtzt\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:23Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:23Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds.16a7809003251c19\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"71015fc7-f4dd-4d9d-9e46-6462c932be3e\",\n                \"resourceVersion\": \"102\",\n                \"creationTimestamp\": \"2021-09-23T16:32:25Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds\",\n                \"uid\": \"98b93b87-2c8d-464d-b72d-5786378d4475\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"477\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kube-flannel-ds-758lm\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:25Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:25Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds.16a7809126e40ea7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"64fbad57-6d60-4151-a51a-dab8c303207d\",\n                \"resourceVersion\": \"120\",\n                \"creationTimestamp\": \"2021-09-23T16:32:30Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds\",\n                \"uid\": \"98b93b87-2c8d-464d-b72d-5786378d4475\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"581\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kube-flannel-ds-lpmtw\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:30Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:30Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds.16a7809155834873\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"cad192d6-a749-431b-ad79-e2a75b8d0fb4\",\n                \"resourceVersion\": \"127\",\n                \"creationTimestamp\": \"2021-09-23T16:32:31Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds\",\n                \"uid\": \"98b93b87-2c8d-464d-b72d-5786378d4475\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"607\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kube-flannel-ds-jn9xx\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:31Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:31Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds.16a78091c9307b85\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3c7ff5ca-440f-4526-a767-55816b00fb29\",\n                \"resourceVersion\": \"142\",\n                \"creationTimestamp\": \"2021-09-23T16:32:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds\",\n                \"uid\": \"98b93b87-2c8d-464d-b72d-5786378d4475\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"616\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kube-flannel-ds-9cctk\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:33Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-34-24.ap-northeast-1.compute.internal.16a78091cfbb25ca\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6bda6c46-4d1b-49d0-92d2-08b9b7b3a72d\",\n                \"resourceVersion\": \"143\",\n                \"creationTimestamp\": \"2021-09-23T16:32:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-34-24.ap-northeast-1.compute.internal\",\n                \"uid\": \"31aca4323d54b2361b419aa26bb6a713\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-proxy-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:33Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-34-24.ap-northeast-1.compute.internal.16a78091d50d3a53\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"674f6607-9687-43d9-a986-d9cd621d08fb\",\n                \"resourceVersion\": \"144\",\n                \"creationTimestamp\": \"2021-09-23T16:32:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-34-24.ap-northeast-1.compute.internal\",\n                \"uid\": \"31aca4323d54b2361b419aa26bb6a713\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:33Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-34-24.ap-northeast-1.compute.internal.16a78091de4dc4b5\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2885c7c8-bf32-4af9-b67f-514da2d65e07\",\n                \"resourceVersion\": \"145\",\n                \"creationTimestamp\": \"2021-09-23T16:32:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-34-24.ap-northeast-1.compute.internal\",\n                \"uid\": \"31aca4323d54b2361b419aa26bb6a713\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:33Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-42-57.ap-northeast-1.compute.internal.16a780738af9fa5c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"70e82f88-98d6-4b07-a063-2aa52c173ac9\",\n                \"resourceVersion\": \"31\",\n                \"creationTimestamp\": \"2021-09-23T16:31:17Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"245b61638b1a6f6798d27c6578306535\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-proxy-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:23Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:23Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-42-57.ap-northeast-1.compute.internal.16a78073a86e8f2c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8798da15-7c30-4181-aab4-5b2e3e85e902\",\n                \"resourceVersion\": \"33\",\n                \"creationTimestamp\": \"2021-09-23T16:31:18Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"245b61638b1a6f6798d27c6578306535\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:24Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:24Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-42-57.ap-northeast-1.compute.internal.16a78073bda5c229\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"34ff91d1-0ff1-4fac-90b9-5415bb85f7e8\",\n                \"resourceVersion\": \"37\",\n                \"creationTimestamp\": \"2021-09-23T16:31:18Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"245b61638b1a6f6798d27c6578306535\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:24Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:24Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-43-215.ap-northeast-1.compute.internal.16a780925b4b2cfe\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a07dabda-54ab-4c26-b1a3-61bf4bfd66c5\",\n                \"resourceVersion\": \"152\",\n                \"creationTimestamp\": \"2021-09-23T16:32:36Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-43-215.ap-northeast-1.compute.internal\",\n                \"uid\": \"1f56aa3378d0c76c93caab7f68cd8d3d\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-proxy-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:36Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:36Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-43-215.ap-northeast-1.compute.internal.16a780926073848d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d9b81160-abf7-4726-9e1a-d70cd2cc17fd\",\n                \"resourceVersion\": \"153\",\n                \"creationTimestamp\": \"2021-09-23T16:32:36Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-43-215.ap-northeast-1.compute.internal\",\n                \"uid\": \"1f56aa3378d0c76c93caab7f68cd8d3d\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:36Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:36Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-43-215.ap-northeast-1.compute.internal.16a7809268e82bcf\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"bdb4b58c-24c5-4259-a2d8-58f9dd4d3ee6\",\n                \"resourceVersion\": \"156\",\n                \"creationTimestamp\": \"2021-09-23T16:32:36Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-43-215.ap-northeast-1.compute.internal\",\n                \"uid\": \"1f56aa3378d0c76c93caab7f68cd8d3d\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:36Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:36Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-54-72.ap-northeast-1.compute.internal.16a78092406c867e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"170b0201-e121-41f2-bfb7-6528b41c5469\",\n                \"resourceVersion\": \"148\",\n                \"creationTimestamp\": \"2021-09-23T16:32:35Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-54-72.ap-northeast-1.compute.internal\",\n                \"uid\": \"3db826e0f6bba9859abf1813dc9c91a6\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-proxy-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-54-72.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:35Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:35Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-54-72.ap-northeast-1.compute.internal.16a780924643e547\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"159cdb82-c5ef-42ce-a56b-676468ed2420\",\n                \"resourceVersion\": \"149\",\n                \"creationTimestamp\": \"2021-09-23T16:32:35Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-54-72.ap-northeast-1.compute.internal\",\n                \"uid\": \"3db826e0f6bba9859abf1813dc9c91a6\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-54-72.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:35Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:35Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-54-72.ap-northeast-1.compute.internal.16a780924e157c64\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c78fd639-afe3-411f-9c90-73fe17da0b53\",\n                \"resourceVersion\": \"150\",\n                \"creationTimestamp\": \"2021-09-23T16:32:35Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-54-72.ap-northeast-1.compute.internal\",\n                \"uid\": \"3db826e0f6bba9859abf1813dc9c91a6\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-54-72.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:35Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:35Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-63-252.ap-northeast-1.compute.internal.16a78090d0c65656\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7a975653-f4ab-46f5-82e4-b81251ae0de2\",\n                \"resourceVersion\": \"106\",\n                \"creationTimestamp\": \"2021-09-23T16:32:29Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-63-252.ap-northeast-1.compute.internal\",\n                \"uid\": \"8c1884608a63f05f9ef643671c2ecb29\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-proxy-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:29Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:29Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-63-252.ap-northeast-1.compute.internal.16a78090d5fd0709\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"157c73ed-b477-4737-bc4e-be9499c7ced3\",\n                \"resourceVersion\": \"107\",\n                \"creationTimestamp\": \"2021-09-23T16:32:29Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-63-252.ap-northeast-1.compute.internal\",\n                \"uid\": \"8c1884608a63f05f9ef643671c2ecb29\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:29Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:29Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-63-252.ap-northeast-1.compute.internal.16a78090e214560a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e287028a-1631-4ce2-9465-ad13b8fad0bf\",\n                \"resourceVersion\": \"108\",\n                \"creationTimestamp\": \"2021-09-23T16:32:29Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-63-252.ap-northeast-1.compute.internal\",\n                \"uid\": \"8c1884608a63f05f9ef643671c2ecb29\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:32:29Z\",\n            \"lastTimestamp\": \"2021-09-23T16:32:29Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-ip-172-20-42-57.ap-northeast-1.compute.internal.16a7807399ddb38b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fdb1b634-3d6d-47a7-92f0-1fa3d1fe2d31\",\n                \"resourceVersion\": \"32\",\n                \"creationTimestamp\": \"2021-09-23T16:31:17Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"f258137e61136ac8b23bfd95e5bfbc7a\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-scheduler}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-scheduler-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:23Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:23Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-ip-172-20-42-57.ap-northeast-1.compute.internal.16a78073ad5d27dc\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"33eae66a-c4f3-43a1-90c6-d7a211ce64a9\",\n                \"resourceVersion\": \"34\",\n                \"creationTimestamp\": \"2021-09-23T16:31:18Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"f258137e61136ac8b23bfd95e5bfbc7a\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-scheduler}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-scheduler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:24Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:24Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-ip-172-20-42-57.ap-northeast-1.compute.internal.16a78073bdb99981\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5dd79027-e6f5-4f3e-8e8b-fb110acc4c68\",\n                \"resourceVersion\": \"38\",\n                \"creationTimestamp\": \"2021-09-23T16:31:19Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"uid\": \"f258137e61136ac8b23bfd95e5bfbc7a\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-scheduler}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-scheduler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:30:24Z\",\n            \"lastTimestamp\": \"2021-09-23T16:30:24Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler.16a780852e836d32\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"961fa251-49fd-4a93-a8d6-e9fe585ff448\",\n                \"resourceVersion\": \"66\",\n                \"creationTimestamp\": \"2021-09-23T16:31:39Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Lease\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler\",\n                \"uid\": \"44540c07-bef3-4e66-bfa8-32d5e50f3d1c\",\n                \"apiVersion\": \"coordination.k8s.io/v1\",\n                \"resourceVersion\": \"451\"\n            },\n            \"reason\": \"LeaderElection\",\n            \"message\": \"ip-172-20-42-57.ap-northeast-1.compute.internal_8e7e619d-8e1e-4f84-b8fd-7fe20b1b25a6 became leader\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-09-23T16:31:39Z\",\n            \"lastTimestamp\": \"2021-09-23T16:31:39Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        }\n    ]\n}\n{\n    \"kind\": \"ReplicationControllerList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"1446\"\n    },\n    \"items\": []\n}\n{\n    \"kind\": \"ServiceList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"1457\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"kube-dns\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8d644f6f-a4bd-4160-8eb2-bd85e2c06361\",\n                \"resourceVersion\": \"294\",\n                \"creationTimestamp\": \"2021-09-23T16:31:13Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"coredns.addons.k8s.io\",\n                    \"addon.kops.k8s.io/version\": \"1.8.3-kops.3\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"coredns.addons.k8s.io\",\n                    \"k8s-app\": \"kube-dns\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"kubernetes.io/name\": \"CoreDNS\"\n                },\n                \"annotations\": {\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"v1\\\",\\\"kind\\\":\\\"Service\\\",\\\"metadata\\\":{\\\"annotations\\\":{\\\"prometheus.io/port\\\":\\\"9153\\\",\\\"prometheus.io/scrape\\\":\\\"true\\\"},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"coredns.addons.k8s.io\\\",\\\"addon.kops.k8s.io/version\\\":\\\"1.8.3-kops.3\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"coredns.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"kube-dns\\\",\\\"kubernetes.io/cluster-service\\\":\\\"true\\\",\\\"kubernetes.io/name\\\":\\\"CoreDNS\\\"},\\\"name\\\":\\\"kube-dns\\\",\\\"namespace\\\":\\\"kube-system\\\",\\\"resourceVersion\\\":\\\"0\\\"},\\\"spec\\\":{\\\"clusterIP\\\":\\\"100.64.0.10\\\",\\\"ports\\\":[{\\\"name\\\":\\\"dns\\\",\\\"port\\\":53,\\\"protocol\\\":\\\"UDP\\\"},{\\\"name\\\":\\\"dns-tcp\\\",\\\"port\\\":53,\\\"protocol\\\":\\\"TCP\\\"},{\\\"name\\\":\\\"metrics\\\",\\\"port\\\":9153,\\\"protocol\\\":\\\"TCP\\\"}],\\\"selector\\\":{\\\"k8s-app\\\":\\\"kube-dns\\\"}}}\\n\",\n                    \"prometheus.io/port\": \"9153\",\n                    \"prometheus.io/scrape\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"ports\": [\n                    {\n                        \"name\": \"dns\",\n                        \"protocol\": \"UDP\",\n                        \"port\": 53,\n                        \"targetPort\": 53\n                    },\n                    {\n                        \"name\": \"dns-tcp\",\n                        \"protocol\": \"TCP\",\n                        \"port\": 53,\n                        \"targetPort\": 53\n                    },\n                    {\n                        \"name\": \"metrics\",\n                        \"protocol\": \"TCP\",\n                        \"port\": 9153,\n                        \"targetPort\": 9153\n                    }\n                ],\n                \"selector\": {\n                    \"k8s-app\": \"kube-dns\"\n                },\n                \"clusterIP\": \"100.64.0.10\",\n                \"clusterIPs\": [\n                    \"100.64.0.10\"\n                ],\n                \"type\": \"ClusterIP\",\n                \"sessionAffinity\": \"None\",\n                \"ipFamilies\": [\n                    \"IPv4\"\n                ],\n                \"ipFamilyPolicy\": \"SingleStack\"\n            },\n            \"status\": {\n                \"loadBalancer\": {}\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"DaemonSetList\",\n    \"apiVersion\": \"apps/v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"1463\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d0fadbda-5aca-41c0-95d0-2a5e0dbf94d3\",\n                \"resourceVersion\": \"507\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-09-23T16:31:16Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"kops-controller.addons.k8s.io\",\n                    \"addon.kops.k8s.io/version\": \"1.21.1\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"kops-controller.addons.k8s.io\",\n                    \"k8s-app\": \"kops-controller\",\n                    \"version\": \"v1.21.1\"\n                },\n                \"annotations\": {\n                    \"deprecated.daemonset.template.generation\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"DaemonSet\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"kops-controller.addons.k8s.io\\\",\\\"addon.kops.k8s.io/version\\\":\\\"1.21.1\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"kops-controller.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"kops-controller\\\",\\\"version\\\":\\\"v1.21.1\\\"},\\\"name\\\":\\\"kops-controller\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"selector\\\":{\\\"matchLabels\\\":{\\\"k8s-app\\\":\\\"kops-controller\\\"}},\\\"template\\\":{\\\"metadata\\\":{\\\"annotations\\\":{\\\"dns.alpha.kubernetes.io/internal\\\":\\\"kops-controller.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\\\"},\\\"labels\\\":{\\\"k8s-addon\\\":\\\"kops-controller.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"kops-controller\\\",\\\"version\\\":\\\"v1.21.1\\\"}},\\\"spec\\\":{\\\"containers\\\":[{\\\"command\\\":[\\\"/kops-controller\\\",\\\"--v=2\\\",\\\"--conf=/etc/kubernetes/kops-controller/config/config.yaml\\\"],\\\"env\\\":[{\\\"name\\\":\\\"KUBERNETES_SERVICE_HOST\\\",\\\"value\\\":\\\"127.0.0.1\\\"}],\\\"image\\\":\\\"k8s.gcr.io/kops/kops-controller:1.21.1\\\",\\\"name\\\":\\\"kops-controller\\\",\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"50m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"securityContext\\\":{\\\"runAsNonRoot\\\":true},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/kops-controller/config/\\\",\\\"name\\\":\\\"kops-controller-config\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/kops-controller/pki/\\\",\\\"name\\\":\\\"kops-controller-pki\\\"}]}],\\\"dnsPolicy\\\":\\\"Default\\\",\\\"hostNetwork\\\":true,\\\"nodeSelector\\\":{\\\"kops.k8s.io/kops-controller-pki\\\":\\\"\\\",\\\"node-role.kubernetes.io/master\\\":\\\"\\\"},\\\"priorityClassName\\\":\\\"system-node-critical\\\",\\\"serviceAccount\\\":\\\"kops-controller\\\",\\\"tolerations\\\":[{\\\"key\\\":\\\"node-role.kubernetes.io/master\\\",\\\"operator\\\":\\\"Exists\\\"}],\\\"volumes\\\":[{\\\"configMap\\\":{\\\"name\\\":\\\"kops-controller\\\"},\\\"name\\\":\\\"kops-controller-config\\\"},{\\\"hostPath\\\":{\\\"path\\\":\\\"/etc/kubernetes/kops-controller/\\\",\\\"type\\\":\\\"Directory\\\"},\\\"name\\\":\\\"kops-controller-pki\\\"}]}},\\\"updateStrategy\\\":{\\\"type\\\":\\\"OnDelete\\\"}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"kops-controller\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-addon\": \"kops-controller.addons.k8s.io\",\n                            \"k8s-app\": \"kops-controller\",\n                            \"version\": \"v1.21.1\"\n                        },\n                        \"annotations\": {\n                            \"dns.alpha.kubernetes.io/internal\": \"kops-controller.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"kops-controller-config\",\n                                \"configMap\": {\n                                    \"name\": \"kops-controller\",\n                                    \"defaultMode\": 420\n                                }\n                            },\n                            {\n                                \"name\": \"kops-controller-pki\",\n                                \"hostPath\": {\n                                    \"path\": \"/etc/kubernetes/kops-controller/\",\n                                    \"type\": \"Directory\"\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"kops-controller\",\n                                \"image\": \"k8s.gcr.io/kops/kops-controller:1.21.1\",\n                                \"command\": [\n                                    \"/kops-controller\",\n                                    \"--v=2\",\n                                    \"--conf=/etc/kubernetes/kops-controller/config/config.yaml\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                        \"value\": \"127.0.0.1\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"50m\",\n                                        \"memory\": \"50Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"kops-controller-config\",\n                                        \"mountPath\": \"/etc/kubernetes/kops-controller/config/\"\n                                    },\n                                    {\n                                        \"name\": \"kops-controller-pki\",\n                                        \"mountPath\": \"/etc/kubernetes/kops-controller/pki/\"\n                                    }\n                                ],\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"runAsNonRoot\": true\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"kops.k8s.io/kops-controller-pki\": \"\",\n                            \"node-role.kubernetes.io/master\": \"\"\n                        },\n                        \"serviceAccountName\": \"kops-controller\",\n                        \"serviceAccount\": \"kops-controller\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"node-role.kubernetes.io/master\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-node-critical\"\n                    }\n                },\n                \"updateStrategy\": {\n                    \"type\": \"OnDelete\"\n                },\n                \"revisionHistoryLimit\": 10\n            },\n            \"status\": {\n                \"currentNumberScheduled\": 1,\n                \"numberMisscheduled\": 0,\n                \"desiredNumberScheduled\": 1,\n                \"numberReady\": 1,\n                \"observedGeneration\": 1,\n                \"updatedNumberScheduled\": 1,\n                \"numberAvailable\": 1\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"98b93b87-2c8d-464d-b72d-5786378d4475\",\n                \"resourceVersion\": \"698\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-09-23T16:31:16Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"networking.flannel\",\n                    \"addon.kops.k8s.io/version\": \"0.13.0-kops.1\",\n                    \"app\": \"flannel\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-app\": \"flannel\",\n                    \"role.kubernetes.io/networking\": \"1\",\n                    \"tier\": \"node\"\n                },\n                \"annotations\": {\n                    \"deprecated.daemonset.template.generation\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"DaemonSet\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"networking.flannel\\\",\\\"addon.kops.k8s.io/version\\\":\\\"0.13.0-kops.1\\\",\\\"app\\\":\\\"flannel\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-app\\\":\\\"flannel\\\",\\\"role.kubernetes.io/networking\\\":\\\"1\\\",\\\"tier\\\":\\\"node\\\"},\\\"name\\\":\\\"kube-flannel-ds\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"selector\\\":{\\\"matchLabels\\\":{\\\"app\\\":\\\"flannel\\\",\\\"tier\\\":\\\"node\\\"}},\\\"template\\\":{\\\"metadata\\\":{\\\"labels\\\":{\\\"app\\\":\\\"flannel\\\",\\\"tier\\\":\\\"node\\\"}},\\\"spec\\\":{\\\"affinity\\\":{\\\"nodeAffinity\\\":{\\\"requiredDuringSchedulingIgnoredDuringExecution\\\":{\\\"nodeSelectorTerms\\\":[{\\\"matchExpressions\\\":[{\\\"key\\\":\\\"kubernetes.io/os\\\",\\\"operator\\\":\\\"In\\\",\\\"values\\\":[\\\"linux\\\"]}]}]}}},\\\"containers\\\":[{\\\"args\\\":[\\\"--ip-masq\\\",\\\"--kube-subnet-mgr\\\",\\\"--iptables-resync=5\\\"],\\\"command\\\":[\\\"/opt/bin/flanneld\\\"],\\\"env\\\":[{\\\"name\\\":\\\"POD_NAME\\\",\\\"valueFrom\\\":{\\\"fieldRef\\\":{\\\"fieldPath\\\":\\\"metadata.name\\\"}}},{\\\"name\\\":\\\"POD_NAMESPACE\\\",\\\"valueFrom\\\":{\\\"fieldRef\\\":{\\\"fieldPath\\\":\\\"metadata.namespace\\\"}}}],\\\"image\\\":\\\"quay.io/coreos/flannel:v0.13.0\\\",\\\"name\\\":\\\"kube-flannel\\\",\\\"resources\\\":{\\\"limits\\\":{\\\"memory\\\":\\\"100Mi\\\"},\\\"requests\\\":{\\\"cpu\\\":\\\"100m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"securityContext\\\":{\\\"capabilities\\\":{\\\"add\\\":[\\\"NET_ADMIN\\\",\\\"NET_RAW\\\"]},\\\"privileged\\\":false},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/run/flannel\\\",\\\"name\\\":\\\"run\\\"},{\\\"mountPath\\\":\\\"/dev/net\\\",\\\"name\\\":\\\"dev-net\\\"},{\\\"mountPath\\\":\\\"/etc/kube-flannel/\\\",\\\"name\\\":\\\"flannel-cfg\\\"}]}],\\\"hostNetwork\\\":true,\\\"initContainers\\\":[{\\\"args\\\":[\\\"-f\\\",\\\"/etc/kube-flannel/cni-conf.json\\\",\\\"/etc/cni/net.d/10-flannel.conflist\\\"],\\\"command\\\":[\\\"cp\\\"],\\\"image\\\":\\\"quay.io/coreos/flannel:v0.13.0\\\",\\\"name\\\":\\\"install-cni\\\",\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"cni\\\"},{\\\"mountPath\\\":\\\"/etc/kube-flannel/\\\",\\\"name\\\":\\\"flannel-cfg\\\"}]}],\\\"priorityClassName\\\":\\\"system-node-critical\\\",\\\"serviceAccountName\\\":\\\"flannel\\\",\\\"tolerations\\\":[{\\\"operator\\\":\\\"Exists\\\"}],\\\"volumes\\\":[{\\\"hostPath\\\":{\\\"path\\\":\\\"/run/flannel\\\"},\\\"name\\\":\\\"run\\\"},{\\\"hostPath\\\":{\\\"path\\\":\\\"/dev/net\\\"},\\\"name\\\":\\\"dev-net\\\"},{\\\"hostPath\\\":{\\\"path\\\":\\\"/etc/cni/net.d\\\"},\\\"name\\\":\\\"cni\\\"},{\\\"configMap\\\":{\\\"name\\\":\\\"kube-flannel-cfg\\\"},\\\"name\\\":\\\"flannel-cfg\\\"}]}}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"app\": \"flannel\",\n                        \"tier\": \"node\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"app\": \"flannel\",\n                            \"tier\": \"node\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"run\",\n                                \"hostPath\": {\n                                    \"path\": \"/run/flannel\",\n                                    \"type\": \"\"\n                                }\n                            },\n                            {\n                                \"name\": \"dev-net\",\n                                \"hostPath\": {\n                                    \"path\": \"/dev/net\",\n                                    \"type\": \"\"\n                                }\n                            },\n                            {\n                                \"name\": \"cni\",\n                                \"hostPath\": {\n                                    \"path\": \"/etc/cni/net.d\",\n                                    \"type\": \"\"\n                                }\n                            },\n                            {\n                                \"name\": \"flannel-cfg\",\n                                \"configMap\": {\n                                    \"name\": \"kube-flannel-cfg\",\n                                    \"defaultMode\": 420\n                                }\n                            }\n                        ],\n                        \"initContainers\": [\n                            {\n                                \"name\": \"install-cni\",\n                                \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                                \"command\": [\n                                    \"cp\"\n                                ],\n                                \"args\": [\n                                    \"-f\",\n                                    \"/etc/kube-flannel/cni-conf.json\",\n                                    \"/etc/cni/net.d/10-flannel.conflist\"\n                                ],\n                                \"resources\": {},\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"cni\",\n                                        \"mountPath\": \"/etc/cni/net.d\"\n                                    },\n                                    {\n                                        \"name\": \"flannel-cfg\",\n                                        \"mountPath\": \"/etc/kube-flannel/\"\n                                    }\n                                ],\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\"\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"kube-flannel\",\n                                \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                                \"command\": [\n                                    \"/opt/bin/flanneld\"\n                                ],\n                                \"args\": [\n                                    \"--ip-masq\",\n                                    \"--kube-subnet-mgr\",\n                                    \"--iptables-resync=5\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"POD_NAME\",\n                                        \"valueFrom\": {\n                                            \"fieldRef\": {\n                                                \"apiVersion\": \"v1\",\n                                                \"fieldPath\": \"metadata.name\"\n                                            }\n                                        }\n                                    },\n                                    {\n                                        \"name\": \"POD_NAMESPACE\",\n                                        \"valueFrom\": {\n                                            \"fieldRef\": {\n                                                \"apiVersion\": \"v1\",\n                                                \"fieldPath\": \"metadata.namespace\"\n                                            }\n                                        }\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"limits\": {\n                                        \"memory\": \"100Mi\"\n                                    },\n                                    \"requests\": {\n                                        \"cpu\": \"100m\",\n                                        \"memory\": \"100Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"run\",\n                                        \"mountPath\": \"/run/flannel\"\n                                    },\n                                    {\n                                        \"name\": \"dev-net\",\n                                        \"mountPath\": \"/dev/net\"\n                                    },\n                                    {\n                                        \"name\": \"flannel-cfg\",\n                                        \"mountPath\": \"/etc/kube-flannel/\"\n                                    }\n                                ],\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"capabilities\": {\n                                        \"add\": [\n                                            \"NET_ADMIN\",\n                                            \"NET_RAW\"\n                                        ]\n                                    },\n                                    \"privileged\": false\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"ClusterFirst\",\n                        \"serviceAccountName\": \"flannel\",\n                        \"serviceAccount\": \"flannel\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"affinity\": {\n                            \"nodeAffinity\": {\n                                \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                                    \"nodeSelectorTerms\": [\n                                        {\n                                            \"matchExpressions\": [\n                                                {\n                                                    \"key\": \"kubernetes.io/os\",\n                                                    \"operator\": \"In\",\n                                                    \"values\": [\n                                                        \"linux\"\n                                                    ]\n                                                }\n                                            ]\n                                        }\n                                    ]\n                                }\n                            }\n                        },\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-node-critical\"\n                    }\n                },\n                \"updateStrategy\": {\n                    \"type\": \"RollingUpdate\",\n                    \"rollingUpdate\": {\n                        \"maxUnavailable\": 1,\n                        \"maxSurge\": 0\n                    }\n                },\n                \"revisionHistoryLimit\": 10\n            },\n            \"status\": {\n                \"currentNumberScheduled\": 5,\n                \"numberMisscheduled\": 0,\n                \"desiredNumberScheduled\": 5,\n                \"numberReady\": 5,\n                \"observedGeneration\": 1,\n                \"updatedNumberScheduled\": 5,\n                \"numberAvailable\": 5\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"DeploymentList\",\n    \"apiVersion\": \"apps/v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"1464\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"coredns\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"043f7284-5214-407f-8baa-1c7fa9d33a51\",\n                \"resourceVersion\": \"774\",\n                \"generation\": 2,\n                \"creationTimestamp\": \"2021-09-23T16:31:13Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"coredns.addons.k8s.io\",\n                    \"addon.kops.k8s.io/version\": \"1.8.3-kops.3\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"coredns.addons.k8s.io\",\n                    \"k8s-app\": \"kube-dns\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"kubernetes.io/name\": \"CoreDNS\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/revision\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"Deployment\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"coredns.addons.k8s.io\\\",\\\"addon.kops.k8s.io/version\\\":\\\"1.8.3-kops.3\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"coredns.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"kube-dns\\\",\\\"kubernetes.io/cluster-service\\\":\\\"true\\\",\\\"kubernetes.io/name\\\":\\\"CoreDNS\\\"},\\\"name\\\":\\\"coredns\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"selector\\\":{\\\"matchLabels\\\":{\\\"k8s-app\\\":\\\"kube-dns\\\"}},\\\"strategy\\\":{\\\"rollingUpdate\\\":{\\\"maxSurge\\\":\\\"10%\\\",\\\"maxUnavailable\\\":1},\\\"type\\\":\\\"RollingUpdate\\\"},\\\"template\\\":{\\\"metadata\\\":{\\\"labels\\\":{\\\"k8s-app\\\":\\\"kube-dns\\\"}},\\\"spec\\\":{\\\"affinity\\\":{\\\"podAntiAffinity\\\":{\\\"preferredDuringSchedulingIgnoredDuringExecution\\\":[{\\\"podAffinityTerm\\\":{\\\"labelSelector\\\":{\\\"matchExpressions\\\":[{\\\"key\\\":\\\"k8s-app\\\",\\\"operator\\\":\\\"In\\\",\\\"values\\\":[\\\"kube-dns\\\"]}]},\\\"topologyKey\\\":\\\"kubernetes.io/hostname\\\"},\\\"weight\\\":100}]}},\\\"containers\\\":[{\\\"args\\\":[\\\"-conf\\\",\\\"/etc/coredns/Corefile\\\"],\\\"image\\\":\\\"k8s.gcr.io/coredns/coredns:v1.8.4\\\",\\\"imagePullPolicy\\\":\\\"IfNotPresent\\\",\\\"livenessProbe\\\":{\\\"failureThreshold\\\":5,\\\"httpGet\\\":{\\\"path\\\":\\\"/health\\\",\\\"port\\\":8080,\\\"scheme\\\":\\\"HTTP\\\"},\\\"initialDelaySeconds\\\":60,\\\"successThreshold\\\":1,\\\"timeoutSeconds\\\":5},\\\"name\\\":\\\"coredns\\\",\\\"ports\\\":[{\\\"containerPort\\\":53,\\\"name\\\":\\\"dns\\\",\\\"protocol\\\":\\\"UDP\\\"},{\\\"containerPort\\\":53,\\\"name\\\":\\\"dns-tcp\\\",\\\"protocol\\\":\\\"TCP\\\"},{\\\"containerPort\\\":9153,\\\"name\\\":\\\"metrics\\\",\\\"protocol\\\":\\\"TCP\\\"}],\\\"readinessProbe\\\":{\\\"httpGet\\\":{\\\"path\\\":\\\"/ready\\\",\\\"port\\\":8181,\\\"scheme\\\":\\\"HTTP\\\"}},\\\"resources\\\":{\\\"limits\\\":{\\\"memory\\\":\\\"170Mi\\\"},\\\"requests\\\":{\\\"cpu\\\":\\\"100m\\\",\\\"memory\\\":\\\"70Mi\\\"}},\\\"securityContext\\\":{\\\"allowPrivilegeEscalation\\\":false,\\\"capabilities\\\":{\\\"add\\\":[\\\"NET_BIND_SERVICE\\\"],\\\"drop\\\":[\\\"all\\\"]},\\\"readOnlyRootFilesystem\\\":true},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/coredns\\\",\\\"name\\\":\\\"config-volume\\\",\\\"readOnly\\\":true}]}],\\\"dnsPolicy\\\":\\\"Default\\\",\\\"nodeSelector\\\":{\\\"kubernetes.io/os\\\":\\\"linux\\\"},\\\"priorityClassName\\\":\\\"system-cluster-critical\\\",\\\"serviceAccountName\\\":\\\"coredns\\\",\\\"tolerations\\\":[{\\\"key\\\":\\\"CriticalAddonsOnly\\\",\\\"operator\\\":\\\"Exists\\\"}],\\\"volumes\\\":[{\\\"configMap\\\":{\\\"items\\\":[{\\\"key\\\":\\\"Corefile\\\",\\\"path\\\":\\\"Corefile\\\"}],\\\"name\\\":\\\"coredns\\\"},\\\"name\\\":\\\"config-volume\\\"}]}}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"replicas\": 2,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"kube-dns\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"kube-dns\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"configMap\": {\n                                    \"name\": \"coredns\",\n                                    \"items\": [\n                                        {\n                                            \"key\": \"Corefile\",\n                                            \"path\": \"Corefile\"\n                                        }\n                                    ],\n                                    \"defaultMode\": 420\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"coredns\",\n                                \"image\": \"k8s.gcr.io/coredns/coredns:v1.8.4\",\n                                \"args\": [\n                                    \"-conf\",\n                                    \"/etc/coredns/Corefile\"\n                                ],\n                                \"ports\": [\n                                    {\n                                        \"name\": \"dns\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"UDP\"\n                                    },\n                                    {\n                                        \"name\": \"dns-tcp\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"TCP\"\n                                    },\n                                    {\n                                        \"name\": \"metrics\",\n                                        \"containerPort\": 9153,\n                                        \"protocol\": \"TCP\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"limits\": {\n                                        \"memory\": \"170Mi\"\n                                    },\n                                    \"requests\": {\n                                        \"cpu\": \"100m\",\n                                        \"memory\": \"70Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"config-volume\",\n                                        \"readOnly\": true,\n                                        \"mountPath\": \"/etc/coredns\"\n                                    }\n                                ],\n                                \"livenessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/health\",\n                                        \"port\": 8080,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"initialDelaySeconds\": 60,\n                                    \"timeoutSeconds\": 5,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 5\n                                },\n                                \"readinessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/ready\",\n                                        \"port\": 8181,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"timeoutSeconds\": 1,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 3\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"capabilities\": {\n                                        \"add\": [\n                                            \"NET_BIND_SERVICE\"\n                                        ],\n                                        \"drop\": [\n                                            \"all\"\n                                        ]\n                                    },\n                                    \"readOnlyRootFilesystem\": true,\n                                    \"allowPrivilegeEscalation\": false\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"kubernetes.io/os\": \"linux\"\n                        },\n                        \"serviceAccountName\": \"coredns\",\n                        \"serviceAccount\": \"coredns\",\n                        \"securityContext\": {},\n                        \"affinity\": {\n                            \"podAntiAffinity\": {\n                                \"preferredDuringSchedulingIgnoredDuringExecution\": [\n                                    {\n                                        \"weight\": 100,\n                                        \"podAffinityTerm\": {\n                                            \"labelSelector\": {\n                                                \"matchExpressions\": [\n                                                    {\n                                                        \"key\": \"k8s-app\",\n                                                        \"operator\": \"In\",\n                                                        \"values\": [\n                                                            \"kube-dns\"\n                                                        ]\n                                                    }\n                                                ]\n                                            },\n                                            \"topologyKey\": \"kubernetes.io/hostname\"\n                                        }\n                                    }\n                                ]\n                            }\n                        },\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                },\n                \"strategy\": {\n                    \"type\": \"RollingUpdate\",\n                    \"rollingUpdate\": {\n                        \"maxUnavailable\": 1,\n                        \"maxSurge\": \"10%\"\n                    }\n                },\n                \"revisionHistoryLimit\": 10,\n                \"progressDeadlineSeconds\": 600\n            },\n            \"status\": {\n                \"observedGeneration\": 2,\n                \"replicas\": 2,\n                \"updatedReplicas\": 2,\n                \"readyReplicas\": 2,\n                \"availableReplicas\": 2,\n                \"conditions\": [\n                    {\n                        \"type\": \"Available\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-09-23T16:32:55Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:55Z\",\n                        \"reason\": \"MinimumReplicasAvailable\",\n                        \"message\": \"Deployment has minimum availability.\"\n                    },\n                    {\n                        \"type\": \"Progressing\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-09-23T16:32:56Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:31:23Z\",\n                        \"reason\": \"NewReplicaSetAvailable\",\n                        \"message\": \"ReplicaSet \\\"coredns-5dc785954d\\\" has successfully progressed.\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f7fa6f4d-3641-4caa-92a8-d9636b72bcbd\",\n                \"resourceVersion\": \"741\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-09-23T16:31:13Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"coredns.addons.k8s.io\",\n                    \"addon.kops.k8s.io/version\": \"1.8.3-kops.3\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"coredns.addons.k8s.io\",\n                    \"k8s-app\": \"coredns-autoscaler\",\n                    \"kubernetes.io/cluster-service\": \"true\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/revision\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"Deployment\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"coredns.addons.k8s.io\\\",\\\"addon.kops.k8s.io/version\\\":\\\"1.8.3-kops.3\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"coredns.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"coredns-autoscaler\\\",\\\"kubernetes.io/cluster-service\\\":\\\"true\\\"},\\\"name\\\":\\\"coredns-autoscaler\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"selector\\\":{\\\"matchLabels\\\":{\\\"k8s-app\\\":\\\"coredns-autoscaler\\\"}},\\\"template\\\":{\\\"metadata\\\":{\\\"annotations\\\":{\\\"scheduler.alpha.kubernetes.io/critical-pod\\\":\\\"\\\"},\\\"labels\\\":{\\\"k8s-app\\\":\\\"coredns-autoscaler\\\"}},\\\"spec\\\":{\\\"containers\\\":[{\\\"command\\\":[\\\"/cluster-proportional-autoscaler\\\",\\\"--namespace=kube-system\\\",\\\"--configmap=coredns-autoscaler\\\",\\\"--target=Deployment/coredns\\\",\\\"--default-params={\\\\\\\"linear\\\\\\\":{\\\\\\\"coresPerReplica\\\\\\\":256,\\\\\\\"nodesPerReplica\\\\\\\":16,\\\\\\\"preventSinglePointFailure\\\\\\\":true}}\\\",\\\"--logtostderr=true\\\",\\\"--v=2\\\"],\\\"image\\\":\\\"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\\\",\\\"name\\\":\\\"autoscaler\\\",\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"10Mi\\\"}}}],\\\"nodeSelector\\\":{\\\"kubernetes.io/os\\\":\\\"linux\\\"},\\\"priorityClassName\\\":\\\"system-cluster-critical\\\",\\\"serviceAccountName\\\":\\\"coredns-autoscaler\\\",\\\"tolerations\\\":[{\\\"key\\\":\\\"CriticalAddonsOnly\\\",\\\"operator\\\":\\\"Exists\\\"}]}}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"coredns-autoscaler\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"coredns-autoscaler\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"autoscaler\",\n                                \"image\": \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\",\n                                \"command\": [\n                                    \"/cluster-proportional-autoscaler\",\n                                    \"--namespace=kube-system\",\n                                    \"--configmap=coredns-autoscaler\",\n                                    \"--target=Deployment/coredns\",\n                                    \"--default-params={\\\"linear\\\":{\\\"coresPerReplica\\\":256,\\\"nodesPerReplica\\\":16,\\\"preventSinglePointFailure\\\":true}}\",\n                                    \"--logtostderr=true\",\n                                    \"--v=2\"\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"20m\",\n                                        \"memory\": \"10Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\"\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"ClusterFirst\",\n                        \"nodeSelector\": {\n                            \"kubernetes.io/os\": \"linux\"\n                        },\n                        \"serviceAccountName\": \"coredns-autoscaler\",\n                        \"serviceAccount\": \"coredns-autoscaler\",\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                },\n                \"strategy\": {\n                    \"type\": \"RollingUpdate\",\n                    \"rollingUpdate\": {\n                        \"maxUnavailable\": \"25%\",\n                        \"maxSurge\": \"25%\"\n                    }\n                },\n                \"revisionHistoryLimit\": 10,\n                \"progressDeadlineSeconds\": 600\n            },\n            \"status\": {\n                \"observedGeneration\": 1,\n                \"replicas\": 1,\n                \"updatedReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"conditions\": [\n                    {\n                        \"type\": \"Available\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-09-23T16:32:51Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:32:51Z\",\n                        \"reason\": \"MinimumReplicasAvailable\",\n                        \"message\": \"Deployment has minimum availability.\"\n                    },\n                    {\n                        \"type\": \"Progressing\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-09-23T16:32:51Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:31:23Z\",\n                        \"reason\": \"NewReplicaSetAvailable\",\n                        \"message\": \"ReplicaSet \\\"coredns-autoscaler-84d4cfd89c\\\" has successfully progressed.\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a8c3bab2-ef11-4f61-8614-085429ca6ad5\",\n                \"resourceVersion\": \"462\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-09-23T16:31:14Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"dns-controller.addons.k8s.io\",\n                    \"addon.kops.k8s.io/version\": \"1.21.1\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                    \"k8s-app\": \"dns-controller\",\n                    \"version\": \"v1.21.1\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/revision\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"Deployment\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"dns-controller.addons.k8s.io\\\",\\\"addon.kops.k8s.io/version\\\":\\\"1.21.1\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"dns-controller.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"dns-controller\\\",\\\"version\\\":\\\"v1.21.1\\\"},\\\"name\\\":\\\"dns-controller\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"replicas\\\":1,\\\"selector\\\":{\\\"matchLabels\\\":{\\\"k8s-app\\\":\\\"dns-controller\\\"}},\\\"strategy\\\":{\\\"type\\\":\\\"Recreate\\\"},\\\"template\\\":{\\\"metadata\\\":{\\\"annotations\\\":{\\\"scheduler.alpha.kubernetes.io/critical-pod\\\":\\\"\\\"},\\\"labels\\\":{\\\"k8s-addon\\\":\\\"dns-controller.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"dns-controller\\\",\\\"version\\\":\\\"v1.21.1\\\"}},\\\"spec\\\":{\\\"containers\\\":[{\\\"command\\\":[\\\"/dns-controller\\\",\\\"--watch-ingress=false\\\",\\\"--dns=aws-route53\\\",\\\"--zone=*/ZEMLNXIIWQ0RV\\\",\\\"--zone=*/*\\\",\\\"-v=2\\\"],\\\"env\\\":[{\\\"name\\\":\\\"KUBERNETES_SERVICE_HOST\\\",\\\"value\\\":\\\"127.0.0.1\\\"}],\\\"image\\\":\\\"k8s.gcr.io/kops/dns-controller:1.21.1\\\",\\\"name\\\":\\\"dns-controller\\\",\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"50m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"securityContext\\\":{\\\"runAsNonRoot\\\":true}}],\\\"dnsPolicy\\\":\\\"Default\\\",\\\"hostNetwork\\\":true,\\\"nodeSelector\\\":{\\\"node-role.kubernetes.io/master\\\":\\\"\\\"},\\\"priorityClassName\\\":\\\"system-cluster-critical\\\",\\\"serviceAccount\\\":\\\"dns-controller\\\",\\\"tolerations\\\":[{\\\"operator\\\":\\\"Exists\\\"}]}}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"dns-controller\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                            \"k8s-app\": \"dns-controller\",\n                            \"version\": \"v1.21.1\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"dns-controller\",\n                                \"image\": \"k8s.gcr.io/kops/dns-controller:1.21.1\",\n                                \"command\": [\n                                    \"/dns-controller\",\n                                    \"--watch-ingress=false\",\n                                    \"--dns=aws-route53\",\n                                    \"--zone=*/ZEMLNXIIWQ0RV\",\n                                    \"--zone=*/*\",\n                                    \"-v=2\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                        \"value\": \"127.0.0.1\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"50m\",\n                                        \"memory\": \"50Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"runAsNonRoot\": true\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"node-role.kubernetes.io/master\": \"\"\n                        },\n                        \"serviceAccountName\": \"dns-controller\",\n                        \"serviceAccount\": \"dns-controller\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                },\n                \"strategy\": {\n                    \"type\": \"Recreate\"\n                },\n                \"revisionHistoryLimit\": 10,\n                \"progressDeadlineSeconds\": 600\n            },\n            \"status\": {\n                \"observedGeneration\": 1,\n                \"replicas\": 1,\n                \"updatedReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"conditions\": [\n                    {\n                        \"type\": \"Available\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-09-23T16:31:41Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:31:41Z\",\n                        \"reason\": \"MinimumReplicasAvailable\",\n                        \"message\": \"Deployment has minimum availability.\"\n                    },\n                    {\n                        \"type\": \"Progressing\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-09-23T16:31:41Z\",\n                        \"lastTransitionTime\": \"2021-09-23T16:31:23Z\",\n                        \"reason\": \"NewReplicaSetAvailable\",\n                        \"message\": \"ReplicaSet \\\"dns-controller-56b8dc9b5b\\\" has successfully progressed.\"\n                    }\n                ]\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"ReplicaSetList\",\n    \"apiVersion\": \"apps/v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"1469\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"33c65ec4-8b36-4e61-998f-4c5a180dadc4\",\n                \"resourceVersion\": \"770\",\n                \"generation\": 2,\n                \"creationTimestamp\": \"2021-09-23T16:31:23Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-dns\",\n                    \"pod-template-hash\": \"5dc785954d\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/desired-replicas\": \"2\",\n                    \"deployment.kubernetes.io/max-replicas\": \"3\",\n                    \"deployment.kubernetes.io/revision\": \"1\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"Deployment\",\n                        \"name\": \"coredns\",\n                        \"uid\": \"043f7284-5214-407f-8baa-1c7fa9d33a51\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"replicas\": 2,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"kube-dns\",\n                        \"pod-template-hash\": \"5dc785954d\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"kube-dns\",\n                            \"pod-template-hash\": \"5dc785954d\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"configMap\": {\n                                    \"name\": \"coredns\",\n                                    \"items\": [\n                                        {\n                                            \"key\": \"Corefile\",\n                                            \"path\": \"Corefile\"\n                                        }\n                                    ],\n                                    \"defaultMode\": 420\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"coredns\",\n                                \"image\": \"k8s.gcr.io/coredns/coredns:v1.8.4\",\n                                \"args\": [\n                                    \"-conf\",\n                                    \"/etc/coredns/Corefile\"\n                                ],\n                                \"ports\": [\n                                    {\n                                        \"name\": \"dns\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"UDP\"\n                                    },\n                                    {\n                                        \"name\": \"dns-tcp\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"TCP\"\n                                    },\n                                    {\n                                        \"name\": \"metrics\",\n                                        \"containerPort\": 9153,\n                                        \"protocol\": \"TCP\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"limits\": {\n                                        \"memory\": \"170Mi\"\n                                    },\n                                    \"requests\": {\n                                        \"cpu\": \"100m\",\n                                        \"memory\": \"70Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"config-volume\",\n                                        \"readOnly\": true,\n                                        \"mountPath\": \"/etc/coredns\"\n                                    }\n                                ],\n                                \"livenessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/health\",\n                                        \"port\": 8080,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"initialDelaySeconds\": 60,\n                                    \"timeoutSeconds\": 5,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 5\n                                },\n                                \"readinessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/ready\",\n                                        \"port\": 8181,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"timeoutSeconds\": 1,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 3\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"capabilities\": {\n                                        \"add\": [\n                                            \"NET_BIND_SERVICE\"\n                                        ],\n                                        \"drop\": [\n                                            \"all\"\n                                        ]\n                                    },\n                                    \"readOnlyRootFilesystem\": true,\n                                    \"allowPrivilegeEscalation\": false\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"kubernetes.io/os\": \"linux\"\n                        },\n                        \"serviceAccountName\": \"coredns\",\n                        \"serviceAccount\": \"coredns\",\n                        \"securityContext\": {},\n                        \"affinity\": {\n                            \"podAntiAffinity\": {\n                                \"preferredDuringSchedulingIgnoredDuringExecution\": [\n                                    {\n                                        \"weight\": 100,\n                                        \"podAffinityTerm\": {\n                                            \"labelSelector\": {\n                                                \"matchExpressions\": [\n                                                    {\n                                                        \"key\": \"k8s-app\",\n                                                        \"operator\": \"In\",\n                                                        \"values\": [\n                                                            \"kube-dns\"\n                                                        ]\n                                                    }\n                                                ]\n                                            },\n                                            \"topologyKey\": \"kubernetes.io/hostname\"\n                                        }\n                                    }\n                                ]\n                            }\n                        },\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                }\n            },\n            \"status\": {\n                \"replicas\": 2,\n                \"fullyLabeledReplicas\": 2,\n                \"readyReplicas\": 2,\n                \"availableReplicas\": 2,\n                \"observedGeneration\": 2\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"65f35825-656d-44eb-9eee-dcb1573fe692\",\n                \"resourceVersion\": \"740\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-09-23T16:31:23Z\",\n                \"labels\": {\n                    \"k8s-app\": \"coredns-autoscaler\",\n                    \"pod-template-hash\": \"84d4cfd89c\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/desired-replicas\": \"1\",\n                    \"deployment.kubernetes.io/max-replicas\": \"2\",\n                    \"deployment.kubernetes.io/revision\": \"1\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"Deployment\",\n                        \"name\": \"coredns-autoscaler\",\n                        \"uid\": \"f7fa6f4d-3641-4caa-92a8-d9636b72bcbd\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"coredns-autoscaler\",\n                        \"pod-template-hash\": \"84d4cfd89c\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"coredns-autoscaler\",\n                            \"pod-template-hash\": \"84d4cfd89c\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"autoscaler\",\n                                \"image\": \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\",\n                                \"command\": [\n                                    \"/cluster-proportional-autoscaler\",\n                                    \"--namespace=kube-system\",\n                                    \"--configmap=coredns-autoscaler\",\n                                    \"--target=Deployment/coredns\",\n                                    \"--default-params={\\\"linear\\\":{\\\"coresPerReplica\\\":256,\\\"nodesPerReplica\\\":16,\\\"preventSinglePointFailure\\\":true}}\",\n                                    \"--logtostderr=true\",\n                                    \"--v=2\"\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"20m\",\n                                        \"memory\": \"10Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\"\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"ClusterFirst\",\n                        \"nodeSelector\": {\n                            \"kubernetes.io/os\": \"linux\"\n                        },\n                        \"serviceAccountName\": \"coredns-autoscaler\",\n                        \"serviceAccount\": \"coredns-autoscaler\",\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                }\n            },\n            \"status\": {\n                \"replicas\": 1,\n                \"fullyLabeledReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"observedGeneration\": 1\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-56b8dc9b5b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6c6e26d6-69db-4af5-b908-57a0f03ec412\",\n                \"resourceVersion\": \"461\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-09-23T16:31:23Z\",\n                \"labels\": {\n                    \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                    \"k8s-app\": \"dns-controller\",\n                    \"pod-template-hash\": \"56b8dc9b5b\",\n                    \"version\": \"v1.21.1\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/desired-replicas\": \"1\",\n                    \"deployment.kubernetes.io/max-replicas\": \"1\",\n                    \"deployment.kubernetes.io/revision\": \"1\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"Deployment\",\n                        \"name\": \"dns-controller\",\n                        \"uid\": \"a8c3bab2-ef11-4f61-8614-085429ca6ad5\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"dns-controller\",\n                        \"pod-template-hash\": \"56b8dc9b5b\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                            \"k8s-app\": \"dns-controller\",\n                            \"pod-template-hash\": \"56b8dc9b5b\",\n                            \"version\": \"v1.21.1\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"dns-controller\",\n                                \"image\": \"k8s.gcr.io/kops/dns-controller:1.21.1\",\n                                \"command\": [\n                                    \"/dns-controller\",\n                                    \"--watch-ingress=false\",\n                                    \"--dns=aws-route53\",\n                                    \"--zone=*/ZEMLNXIIWQ0RV\",\n                                    \"--zone=*/*\",\n                                    \"-v=2\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                        \"value\": \"127.0.0.1\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"50m\",\n                                        \"memory\": \"50Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"runAsNonRoot\": true\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"node-role.kubernetes.io/master\": \"\"\n                        },\n                        \"serviceAccountName\": \"dns-controller\",\n                        \"serviceAccount\": \"dns-controller\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                }\n            },\n            \"status\": {\n                \"replicas\": 1,\n                \"fullyLabeledReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"observedGeneration\": 1\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"PodList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"1479\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-nfmmr\",\n                \"generateName\": \"coredns-5dc785954d-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"52da063f-6abb-4694-a8a1-51c790b93c93\",\n                \"resourceVersion\": \"769\",\n                \"creationTimestamp\": \"2021-09-23T16:31:23Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-dns\",\n                    \"pod-template-hash\": \"5dc785954d\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"coredns-5dc785954d\",\n                        \"uid\": \"33c65ec4-8b36-4e61-998f-4c5a180dadc4\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"config-volume\",\n                        \"configMap\": {\n                            \"name\": \"coredns\",\n                            \"items\": [\n                                {\n                                    \"key\": \"Corefile\",\n                                    \"path\": \"Corefile\"\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-2ltch\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"image\": \"k8s.gcr.io/coredns/coredns:v1.8.4\",\n                        \"args\": [\n                            \"-conf\",\n                            \"/etc/coredns/Corefile\"\n                        ],\n                        \"ports\": [\n                            {\n                                \"name\": \"dns\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"UDP\"\n                            },\n                            {\n                                \"name\": \"dns-tcp\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"TCP\"\n                            },\n                            {\n                                \"name\": \"metrics\",\n                                \"containerPort\": 9153,\n                                \"protocol\": \"TCP\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"170Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"70Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/coredns\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-2ltch\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/health\",\n                                \"port\": 8080,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 60,\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 5\n                        },\n                        \"readinessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/ready\",\n                                \"port\": 8181,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"timeoutSeconds\": 1,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_BIND_SERVICE\"\n                                ],\n                                \"drop\": [\n                                    \"all\"\n                                ]\n                            },\n                            \"readOnlyRootFilesystem\": true,\n                            \"allowPrivilegeEscalation\": false\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"kubernetes.io/os\": \"linux\"\n                },\n                \"serviceAccountName\": \"coredns\",\n                \"serviceAccount\": \"coredns\",\n                \"nodeName\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\",\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"podAntiAffinity\": {\n                        \"preferredDuringSchedulingIgnoredDuringExecution\": [\n                            {\n                                \"weight\": 100,\n                                \"podAffinityTerm\": {\n                                    \"labelSelector\": {\n                                        \"matchExpressions\": [\n                                            {\n                                                \"key\": \"k8s-app\",\n                                                \"operator\": \"In\",\n                                                \"values\": [\n                                                    \"kube-dns\"\n                                                ]\n                                            }\n                                        ]\n                                    },\n                                    \"topologyKey\": \"kubernetes.io/hostname\"\n                                }\n                            }\n                        ]\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:46Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:56Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:56Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:46Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.34.24\",\n                \"podIP\": \"100.96.2.2\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"100.96.2.2\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:32:46Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:32:50Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/coredns/coredns:v1.8.4\",\n                        \"imageID\": \"k8s.gcr.io/coredns/coredns@sha256:6e5a02c21641597998b4be7cb5eb1e7b02c0d8d23cce4dd09f4682d463798890\",\n                        \"containerID\": \"containerd://54f71904d4c1cb200e4adf210eb7fe2b8b68bb7f38d49837350c6b9c9070f8d4\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-5dc785954d-wbcvv\",\n                \"generateName\": \"coredns-5dc785954d-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"0520aa32-9018-4ecc-a085-03724175ab96\",\n                \"resourceVersion\": \"759\",\n                \"creationTimestamp\": \"2021-09-23T16:32:51Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-dns\",\n                    \"pod-template-hash\": \"5dc785954d\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"coredns-5dc785954d\",\n                        \"uid\": \"33c65ec4-8b36-4e61-998f-4c5a180dadc4\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"config-volume\",\n                        \"configMap\": {\n                            \"name\": \"coredns\",\n                            \"items\": [\n                                {\n                                    \"key\": \"Corefile\",\n                                    \"path\": \"Corefile\"\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-kmf5h\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"image\": \"k8s.gcr.io/coredns/coredns:v1.8.4\",\n                        \"args\": [\n                            \"-conf\",\n                            \"/etc/coredns/Corefile\"\n                        ],\n                        \"ports\": [\n                            {\n                                \"name\": \"dns\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"UDP\"\n                            },\n                            {\n                                \"name\": \"dns-tcp\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"TCP\"\n                            },\n                            {\n                                \"name\": \"metrics\",\n                                \"containerPort\": 9153,\n                                \"protocol\": \"TCP\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"170Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"70Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/coredns\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-kmf5h\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/health\",\n                                \"port\": 8080,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 60,\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 5\n                        },\n                        \"readinessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/ready\",\n                                \"port\": 8181,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"timeoutSeconds\": 1,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_BIND_SERVICE\"\n                                ],\n                                \"drop\": [\n                                    \"all\"\n                                ]\n                            },\n                            \"readOnlyRootFilesystem\": true,\n                            \"allowPrivilegeEscalation\": false\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"kubernetes.io/os\": \"linux\"\n                },\n                \"serviceAccountName\": \"coredns\",\n                \"serviceAccount\": \"coredns\",\n                \"nodeName\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\",\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"podAntiAffinity\": {\n                        \"preferredDuringSchedulingIgnoredDuringExecution\": [\n                            {\n                                \"weight\": 100,\n                                \"podAffinityTerm\": {\n                                    \"labelSelector\": {\n                                        \"matchExpressions\": [\n                                            {\n                                                \"key\": \"k8s-app\",\n                                                \"operator\": \"In\",\n                                                \"values\": [\n                                                    \"kube-dns\"\n                                                ]\n                                            }\n                                        ]\n                                    },\n                                    \"topologyKey\": \"kubernetes.io/hostname\"\n                                }\n                            }\n                        ]\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:51Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:55Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:55Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:51Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.43.215\",\n                \"podIP\": \"100.96.4.2\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"100.96.4.2\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:32:51Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:32:54Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/coredns/coredns:v1.8.4\",\n                        \"imageID\": \"k8s.gcr.io/coredns/coredns@sha256:6e5a02c21641597998b4be7cb5eb1e7b02c0d8d23cce4dd09f4682d463798890\",\n                        \"containerID\": \"containerd://aa20f5a23bafdaf1ca2fc57a1b3a54e3e07fadbef093eef25638680a5e8ef874\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-4mrql\",\n                \"generateName\": \"coredns-autoscaler-84d4cfd89c-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f7410268-adc8-4ef2-a660-87bd13a043b6\",\n                \"resourceVersion\": \"739\",\n                \"creationTimestamp\": \"2021-09-23T16:31:23Z\",\n                \"labels\": {\n                    \"k8s-app\": \"coredns-autoscaler\",\n                    \"pod-template-hash\": \"84d4cfd89c\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"coredns-autoscaler-84d4cfd89c\",\n                        \"uid\": \"65f35825-656d-44eb-9eee-dcb1573fe692\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"kube-api-access-cj648\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"autoscaler\",\n                        \"image\": \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\",\n                        \"command\": [\n                            \"/cluster-proportional-autoscaler\",\n                            \"--namespace=kube-system\",\n                            \"--configmap=coredns-autoscaler\",\n                            \"--target=Deployment/coredns\",\n                            \"--default-params={\\\"linear\\\":{\\\"coresPerReplica\\\":256,\\\"nodesPerReplica\\\":16,\\\"preventSinglePointFailure\\\":true}}\",\n                            \"--logtostderr=true\",\n                            \"--v=2\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"20m\",\n                                \"memory\": \"10Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kube-api-access-cj648\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeSelector\": {\n                    \"kubernetes.io/os\": \"linux\"\n                },\n                \"serviceAccountName\": \"coredns-autoscaler\",\n                \"serviceAccount\": \"coredns-autoscaler\",\n                \"nodeName\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\",\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:47Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:51Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:51Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:47Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.63.252\",\n                \"podIP\": \"100.96.1.2\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"100.96.1.2\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:32:47Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"autoscaler\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:32:51Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\",\n                        \"imageID\": \"k8s.gcr.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def\",\n                        \"containerID\": \"containerd://c837e2ff34d0b1b29c99003846f9070c9fa45326d3d093f5ca3cc08a042fac3e\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-56b8dc9b5b-rgnj7\",\n                \"generateName\": \"dns-controller-56b8dc9b5b-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d9390b2c-dd47-4ffa-b3fe-aab39d6cf8d0\",\n                \"resourceVersion\": \"460\",\n                \"creationTimestamp\": \"2021-09-23T16:31:23Z\",\n                \"labels\": {\n                    \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                    \"k8s-app\": \"dns-controller\",\n                    \"pod-template-hash\": \"56b8dc9b5b\",\n                    \"version\": \"v1.21.1\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"dns-controller-56b8dc9b5b\",\n                        \"uid\": \"6c6e26d6-69db-4af5-b908-57a0f03ec412\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"kube-api-access-vb6wp\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"dns-controller\",\n                        \"image\": \"k8s.gcr.io/kops/dns-controller:1.21.1\",\n                        \"command\": [\n                            \"/dns-controller\",\n                            \"--watch-ingress=false\",\n                            \"--dns=aws-route53\",\n                            \"--zone=*/ZEMLNXIIWQ0RV\",\n                            \"--zone=*/*\",\n                            \"-v=2\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                \"value\": \"127.0.0.1\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"50m\",\n                                \"memory\": \"50Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kube-api-access-vb6wp\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"runAsNonRoot\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"node-role.kubernetes.io/master\": \"\"\n                },\n                \"serviceAccountName\": \"dns-controller\",\n                \"serviceAccount\": \"dns-controller\",\n                \"nodeName\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:31:39Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:31:41Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:31:41Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:31:39Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.42.57\",\n                \"podIP\": \"172.20.42.57\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.42.57\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:31:39Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"dns-controller\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:31:40Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kops/dns-controller:1.21.1\",\n                        \"imageID\": \"sha256:139e2fb6632308bea5fe08a80df1d7ad896b21481d84b93625bdb23fc9ab0245\",\n                        \"containerID\": \"containerd://85a1cb74360f7770bc89bd12ef29ca18db7643a1bc518ffddb9b412bbe4c0ec8\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"bae3e010-43b3-42ad-9340-0d4021e73805\",\n                \"resourceVersion\": \"478\",\n                \"creationTimestamp\": \"2021-09-23T16:31:43Z\",\n                \"labels\": {\n                    \"k8s-app\": \"etcd-manager-events\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"1505dbbcc3704681e070ada96386576b\",\n                    \"kubernetes.io/config.mirror\": \"1505dbbcc3704681e070ada96386576b\",\n                    \"kubernetes.io/config.seen\": \"2021-09-23T16:30:07.332072080Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                        \"uid\": \"42a5f8ca-7e32-4b00-8ee8-9d829587a401\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"rootfs\",\n                        \"hostPath\": {\n                            \"path\": \"/\",\n                            \"type\": \"Directory\"\n                        }\n                    },\n                    {\n                        \"name\": \"run\",\n                        \"hostPath\": {\n                            \"path\": \"/run\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"pki\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/pki/etcd-manager-events\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"varlogetcd\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/etcd-events.log\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"image\": \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\",\n                        \"command\": [\n                            \"/bin/sh\",\n                            \"-c\",\n                            \"mkfifo /tmp/pipe; (tee -a /var/log/etcd.log \\u003c /tmp/pipe \\u0026 ) ; exec /etcd-manager --backup-store=s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events --client-urls=https://__name__:4002 --cluster-name=etcd-events --containerized=true --dns-suffix=.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io --etcd-insecure=false --grpc-port=3997 --insecure=false --peer-urls=https://__name__:2381 --quarantine-client-urls=https://__name__:3995 --v=6 --volume-name-tag=k8s.io/etcd/events --volume-provider=aws --volume-tag=k8s.io/etcd/events --volume-tag=k8s.io/role/master=1 --volume-tag=kubernetes.io/cluster/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io=owned \\u003e /tmp/pipe 2\\u003e\\u00261\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"rootfs\",\n                                \"mountPath\": \"/rootfs\"\n                            },\n                            {\n                                \"name\": \"run\",\n                                \"mountPath\": \"/run\"\n                            },\n                            {\n                                \"name\": \"pki\",\n                                \"mountPath\": \"/etc/kubernetes/pki/etcd-manager\"\n                            },\n                            {\n                                \"name\": \"varlogetcd\",\n                                \"mountPath\": \"/var/log/etcd.log\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"hostPID\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:08Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:40Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:40Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:08Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.42.57\",\n                \"podIP\": \"172.20.42.57\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.42.57\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:30:08Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:30:39Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\",\n                        \"imageID\": \"k8s.gcr.io/etcdadm/etcd-manager@sha256:ebb73d3d4a99da609f9e01c556cd9f9aa7a0aecba8f5bc5588d7c45eb38e3a7e\",\n                        \"containerID\": \"containerd://1fb8986e167601d6084c1e2b1afafa91c017050261718349499581f3b0fc5ae8\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4b16be41-beda-46d6-89af-5014dff2e689\",\n                \"resourceVersion\": \"510\",\n                \"creationTimestamp\": \"2021-09-23T16:31:55Z\",\n                \"labels\": {\n                    \"k8s-app\": \"etcd-manager-main\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"ad8477668726fa8352eccd35e530400d\",\n                    \"kubernetes.io/config.mirror\": \"ad8477668726fa8352eccd35e530400d\",\n                    \"kubernetes.io/config.seen\": \"2021-09-23T16:30:07.332091021Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                        \"uid\": \"42a5f8ca-7e32-4b00-8ee8-9d829587a401\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"rootfs\",\n                        \"hostPath\": {\n                            \"path\": \"/\",\n                            \"type\": \"Directory\"\n                        }\n                    },\n                    {\n                        \"name\": \"run\",\n                        \"hostPath\": {\n                            \"path\": \"/run\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"pki\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/pki/etcd-manager-main\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"varlogetcd\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/etcd.log\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"image\": \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\",\n                        \"command\": [\n                            \"/bin/sh\",\n                            \"-c\",\n                            \"mkfifo /tmp/pipe; (tee -a /var/log/etcd.log \\u003c /tmp/pipe \\u0026 ) ; exec /etcd-manager --backup-store=s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main --client-urls=https://__name__:4001 --cluster-name=etcd --containerized=true --dns-suffix=.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io --etcd-insecure=false --grpc-port=3996 --insecure=false --peer-urls=https://__name__:2380 --quarantine-client-urls=https://__name__:3994 --v=6 --volume-name-tag=k8s.io/etcd/main --volume-provider=aws --volume-tag=k8s.io/etcd/main --volume-tag=k8s.io/role/master=1 --volume-tag=kubernetes.io/cluster/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io=owned \\u003e /tmp/pipe 2\\u003e\\u00261\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"200m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"rootfs\",\n                                \"mountPath\": \"/rootfs\"\n                            },\n                            {\n                                \"name\": \"run\",\n                                \"mountPath\": \"/run\"\n                            },\n                            {\n                                \"name\": \"pki\",\n                                \"mountPath\": \"/etc/kubernetes/pki/etcd-manager\"\n                            },\n                            {\n                                \"name\": \"varlogetcd\",\n                                \"mountPath\": \"/var/log/etcd.log\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"hostPID\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:08Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:40Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:40Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:08Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.42.57\",\n                \"podIP\": \"172.20.42.57\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.42.57\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:30:08Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:30:39Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20210430\",\n                        \"imageID\": \"k8s.gcr.io/etcdadm/etcd-manager@sha256:ebb73d3d4a99da609f9e01c556cd9f9aa7a0aecba8f5bc5588d7c45eb38e3a7e\",\n                        \"containerID\": \"containerd://6b28eaa4558b6f90869ca45f06debdb2b93ab3ed4ae3880fcebb188deb95deac\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-cdk2g\",\n                \"generateName\": \"kops-controller-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"57d7addd-c52f-4b45-afe8-89c401845d52\",\n                \"resourceVersion\": \"506\",\n                \"creationTimestamp\": \"2021-09-23T16:31:56Z\",\n                \"labels\": {\n                    \"controller-revision-hash\": \"94cbcd8c\",\n                    \"k8s-addon\": \"kops-controller.addons.k8s.io\",\n                    \"k8s-app\": \"kops-controller\",\n                    \"pod-template-generation\": \"1\",\n                    \"version\": \"v1.21.1\"\n                },\n                \"annotations\": {\n                    \"dns.alpha.kubernetes.io/internal\": \"kops-controller.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"kops-controller\",\n                        \"uid\": \"d0fadbda-5aca-41c0-95d0-2a5e0dbf94d3\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"kops-controller-config\",\n                        \"configMap\": {\n                            \"name\": \"kops-controller\",\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kops-controller-pki\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/kops-controller/\",\n                            \"type\": \"Directory\"\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-hs2lj\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kops-controller\",\n                        \"image\": \"k8s.gcr.io/kops/kops-controller:1.21.1\",\n                        \"command\": [\n                            \"/kops-controller\",\n                            \"--v=2\",\n                            \"--conf=/etc/kubernetes/kops-controller/config/config.yaml\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                \"value\": \"127.0.0.1\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"50m\",\n                                \"memory\": \"50Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kops-controller-config\",\n                                \"mountPath\": \"/etc/kubernetes/kops-controller/config/\"\n                            },\n                            {\n                                \"name\": \"kops-controller-pki\",\n                                \"mountPath\": \"/etc/kubernetes/kops-controller/pki/\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-hs2lj\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"runAsNonRoot\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"kops.k8s.io/kops-controller-pki\": \"\",\n                    \"node-role.kubernetes.io/master\": \"\"\n                },\n                \"serviceAccountName\": \"kops-controller\",\n                \"serviceAccount\": \"kops-controller\",\n                \"nodeName\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"node-role.kubernetes.io/master\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:31:56Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:31:58Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:31:58Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:31:56Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.42.57\",\n                \"podIP\": \"172.20.42.57\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.42.57\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:31:56Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kops-controller\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:31:57Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kops/kops-controller:1.21.1\",\n                        \"imageID\": \"sha256:5ee3d8547af7fe2ecb52ab9dae555c04eaf568a7de825a83735f6805735d8494\",\n                        \"containerID\": \"containerd://0d87edc361b0f955cad412e625fa242cdf4891ce4c6f6e863432e6510d247d87\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a273828d-d7bf-4f13-bb15-902a9d1b8cb8\",\n                \"resourceVersion\": \"559\",\n                \"creationTimestamp\": \"2021-09-23T16:32:16Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-apiserver\"\n                },\n                \"annotations\": {\n                    \"dns.alpha.kubernetes.io/external\": \"api.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\",\n                    \"dns.alpha.kubernetes.io/internal\": \"api.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\",\n                    \"kubernetes.io/config.hash\": \"812493a4619e1b63869c54ea45dc35fe\",\n                    \"kubernetes.io/config.mirror\": \"812493a4619e1b63869c54ea45dc35fe\",\n                    \"kubernetes.io/config.seen\": \"2021-09-23T16:30:07.332093155Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                        \"uid\": \"42a5f8ca-7e32-4b00-8ee8-9d829587a401\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-apiserver.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcssl\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcpkitls\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/pki/tls\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcpkica-trust\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/pki/ca-trust\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrsharessl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrssl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrlibssl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/lib/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrlocalopenssl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/local/openssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"varssl\",\n                        \"hostPath\": {\n                            \"path\": \"/var/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcopenssl\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/openssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"pki\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/pki/kube-apiserver\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"cloudconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/cloud.config\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"srvkube\",\n                        \"hostPath\": {\n                            \"path\": \"/srv/kubernetes\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"srvsshproxy\",\n                        \"hostPath\": {\n                            \"path\": \"/srv/sshproxy\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"healthcheck-secrets\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/kube-apiserver-healthcheck/secrets\",\n                            \"type\": \"Directory\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-apiserver\",\n                        \"image\": \"k8s.gcr.io/kube-apiserver-amd64:v1.21.5\",\n                        \"command\": [\n                            \"/usr/local/bin/kube-apiserver\"\n                        ],\n                        \"args\": [\n                            \"--allow-privileged=true\",\n                            \"--anonymous-auth=false\",\n                            \"--api-audiences=kubernetes.svc.default\",\n                            \"--apiserver-count=1\",\n                            \"--authorization-mode=Node,RBAC\",\n                            \"--bind-address=0.0.0.0\",\n                            \"--client-ca-file=/srv/kubernetes/ca.crt\",\n                            \"--cloud-config=/etc/kubernetes/cloud.config\",\n                            \"--cloud-provider=aws\",\n                            \"--enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,PersistentVolumeLabel,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,NodeRestriction,ResourceQuota\",\n                            \"--etcd-cafile=/etc/kubernetes/pki/kube-apiserver/etcd-ca.crt\",\n                            \"--etcd-certfile=/etc/kubernetes/pki/kube-apiserver/etcd-client.crt\",\n                            \"--etcd-keyfile=/etc/kubernetes/pki/kube-apiserver/etcd-client.key\",\n                            \"--etcd-servers-overrides=/events#https://127.0.0.1:4002\",\n                            \"--etcd-servers=https://127.0.0.1:4001\",\n                            \"--insecure-port=0\",\n                            \"--kubelet-client-certificate=/srv/kubernetes/kubelet-api.crt\",\n                            \"--kubelet-client-key=/srv/kubernetes/kubelet-api.key\",\n                            \"--kubelet-preferred-address-types=InternalIP,Hostname,ExternalIP\",\n                            \"--proxy-client-cert-file=/srv/kubernetes/apiserver-aggregator.crt\",\n                            \"--proxy-client-key-file=/srv/kubernetes/apiserver-aggregator.key\",\n                            \"--requestheader-allowed-names=aggregator\",\n                            \"--requestheader-client-ca-file=/srv/kubernetes/apiserver-aggregator-ca.crt\",\n                            \"--requestheader-extra-headers-prefix=X-Remote-Extra-\",\n                            \"--requestheader-group-headers=X-Remote-Group\",\n                            \"--requestheader-username-headers=X-Remote-User\",\n                            \"--secure-port=443\",\n                            \"--service-account-issuer=https://api.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\",\n                            \"--service-account-jwks-uri=https://api.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/openid/v1/jwks\",\n                            \"--service-account-key-file=/srv/kubernetes/service-account.key\",\n                            \"--service-account-signing-key-file=/srv/kubernetes/service-account.key\",\n                            \"--service-cluster-ip-range=100.64.0.0/13\",\n                            \"--storage-backend=etcd3\",\n                            \"--tls-cert-file=/srv/kubernetes/server.crt\",\n                            \"--tls-private-key-file=/srv/kubernetes/server.key\",\n                            \"--v=2\",\n                            \"--logtostderr=false\",\n                            \"--alsologtostderr\",\n                            \"--log-file=/var/log/kube-apiserver.log\"\n                        ],\n                        \"ports\": [\n                            {\n                                \"name\": \"https\",\n                                \"hostPort\": 443,\n                                \"containerPort\": 443,\n                                \"protocol\": \"TCP\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"150m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-apiserver.log\"\n                            },\n                            {\n                                \"name\": \"etcssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl\"\n                            },\n                            {\n                                \"name\": \"etcpkitls\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/pki/tls\"\n                            },\n                            {\n                                \"name\": \"etcpkica-trust\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/pki/ca-trust\"\n                            },\n                            {\n                                \"name\": \"usrsharessl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/share/ssl\"\n                            },\n                            {\n                                \"name\": \"usrssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/ssl\"\n                            },\n                            {\n                                \"name\": \"usrlibssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/lib/ssl\"\n                            },\n                            {\n                                \"name\": \"usrlocalopenssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/local/openssl\"\n                            },\n                            {\n                                \"name\": \"varssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/ssl\"\n                            },\n                            {\n                                \"name\": \"etcopenssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/openssl\"\n                            },\n                            {\n                                \"name\": \"pki\",\n                                \"mountPath\": \"/etc/kubernetes/pki/kube-apiserver\"\n                            },\n                            {\n                                \"name\": \"cloudconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/kubernetes/cloud.config\"\n                            },\n                            {\n                                \"name\": \"srvkube\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/srv/kubernetes\"\n                            },\n                            {\n                                \"name\": \"srvsshproxy\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/srv/sshproxy\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 3990,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 45,\n                            \"timeoutSeconds\": 15,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    },\n                    {\n                        \"name\": \"healthcheck\",\n                        \"image\": \"k8s.gcr.io/kops/kube-apiserver-healthcheck:1.21.1\",\n                        \"command\": [\n                            \"/kube-apiserver-healthcheck\"\n                        ],\n                        \"args\": [\n                            \"--ca-cert=/secrets/ca.crt\",\n                            \"--client-cert=/secrets/client.crt\",\n                            \"--client-key=/secrets/client.key\"\n                        ],\n                        \"resources\": {},\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"healthcheck-secrets\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/secrets\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/.kube-apiserver-healthcheck/healthz\",\n                                \"port\": 3990,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 5,\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:08Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:54Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:54Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:08Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.42.57\",\n                \"podIP\": \"172.20.42.57\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.42.57\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:30:08Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"healthcheck\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:30:32Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kops/kube-apiserver-healthcheck:1.21.1\",\n                        \"imageID\": \"sha256:c2059b363d16db00edcad94fa99a358bd8869d1f47520ac9c9b33f83574d8b47\",\n                        \"containerID\": \"containerd://10ca41ed6e583d33c4e51f35d95c7ec3064d2112c5c2ec05a1a8414e9a07cc5b\",\n                        \"started\": true\n                    },\n                    {\n                        \"name\": \"kube-apiserver\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:30:53Z\"\n                            }\n                        },\n                        \"lastState\": {\n                            \"terminated\": {\n                                \"exitCode\": 1,\n                                \"reason\": \"Error\",\n                                \"startedAt\": \"2021-09-23T16:30:31Z\",\n                                \"finishedAt\": \"2021-09-23T16:30:52Z\",\n                                \"containerID\": \"containerd://9c5e07753fc4c7aae096e72ba21e4715277dc13b2e7c2fa622ef45ec6817c92d\"\n                            }\n                        },\n                        \"ready\": true,\n                        \"restartCount\": 1,\n                        \"image\": \"k8s.gcr.io/kube-apiserver-amd64:v1.21.5\",\n                        \"imageID\": \"sha256:7b2ac941d4c3053c5d5b9ccaf9de1eb50c2f086b7f0461ff37d22d26c7ab14e4\",\n                        \"containerID\": \"containerd://6b22ce242c9660d2d26fda2b044e8e4453f15e78934fcf141b23efb7c81817d4\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a8ff4fa0-1e2d-4a9a-8c9a-0d014058aa50\",\n                \"resourceVersion\": \"479\",\n                \"creationTimestamp\": \"2021-09-23T16:31:42Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-controller-manager\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"768810cb4a21155e5c9f3ce3bb1dfc4b\",\n                    \"kubernetes.io/config.mirror\": \"768810cb4a21155e5c9f3ce3bb1dfc4b\",\n                    \"kubernetes.io/config.seen\": \"2021-09-23T16:30:07.332094746Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                        \"uid\": \"42a5f8ca-7e32-4b00-8ee8-9d829587a401\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-controller-manager.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcssl\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcpkitls\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/pki/tls\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcpkica-trust\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/pki/ca-trust\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrsharessl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrssl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrlibssl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/lib/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"usrlocalopenssl\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/local/openssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"varssl\",\n                        \"hostPath\": {\n                            \"path\": \"/var/ssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"etcopenssl\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/openssl\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"cloudconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/cloud.config\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"srvkube\",\n                        \"hostPath\": {\n                            \"path\": \"/srv/kubernetes\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"varlibkcm\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-controller-manager\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"volplugins\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/libexec/kubernetes/kubelet-plugins/volume/exec/\",\n                            \"type\": \"\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-controller-manager\",\n                        \"image\": \"k8s.gcr.io/kube-controller-manager-amd64:v1.21.5\",\n                        \"command\": [\n                            \"/usr/local/bin/kube-controller-manager\"\n                        ],\n                        \"args\": [\n                            \"--allocate-node-cidrs=true\",\n                            \"--attach-detach-reconcile-sync-period=1m0s\",\n                            \"--cloud-config=/etc/kubernetes/cloud.config\",\n                            \"--cloud-provider=aws\",\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--cluster-name=e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\",\n                            \"--cluster-signing-cert-file=/srv/kubernetes/ca.crt\",\n                            \"--cluster-signing-key-file=/srv/kubernetes/ca.key\",\n                            \"--configure-cloud-routes=false\",\n                            \"--flex-volume-plugin-dir=/usr/libexec/kubernetes/kubelet-plugins/volume/exec/\",\n                            \"--kubeconfig=/var/lib/kube-controller-manager/kubeconfig\",\n                            \"--leader-elect=true\",\n                            \"--root-ca-file=/srv/kubernetes/ca.crt\",\n                            \"--service-account-private-key-file=/srv/kubernetes/service-account.key\",\n                            \"--use-service-account-credentials=true\",\n                            \"--v=2\",\n                            \"--logtostderr=false\",\n                            \"--alsologtostderr\",\n                            \"--log-file=/var/log/kube-controller-manager.log\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-controller-manager.log\"\n                            },\n                            {\n                                \"name\": \"etcssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl\"\n                            },\n                            {\n                                \"name\": \"etcpkitls\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/pki/tls\"\n                            },\n                            {\n                                \"name\": \"etcpkica-trust\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/pki/ca-trust\"\n                            },\n                            {\n                                \"name\": \"usrsharessl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/share/ssl\"\n                            },\n                            {\n                                \"name\": \"usrssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/ssl\"\n                            },\n                            {\n                                \"name\": \"usrlibssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/lib/ssl\"\n                            },\n                            {\n                                \"name\": \"usrlocalopenssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/usr/local/openssl\"\n                            },\n                            {\n                                \"name\": \"varssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/ssl\"\n                            },\n                            {\n                                \"name\": \"etcopenssl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/openssl\"\n                            },\n                            {\n                                \"name\": \"cloudconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/kubernetes/cloud.config\"\n                            },\n                            {\n                                \"name\": \"srvkube\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/srv/kubernetes\"\n                            },\n                            {\n                                \"name\": \"varlibkcm\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-controller-manager\"\n                            },\n                            {\n                                \"name\": \"volplugins\",\n                                \"mountPath\": \"/usr/libexec/kubernetes/kubelet-plugins/volume/exec/\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 10252,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 15,\n                            \"timeoutSeconds\": 15,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:08Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:40Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:40Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:08Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.42.57\",\n                \"podIP\": \"172.20.42.57\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.42.57\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:30:08Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-controller-manager\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:30:39Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kube-controller-manager-amd64:v1.21.5\",\n                        \"imageID\": \"k8s.gcr.io/kube-controller-manager-amd64@sha256:d9efa3d5179e044f19b102d0a4b6b76bb77f3be3baa38c1b0d71d314e18d49aa\",\n                        \"containerID\": \"containerd://7fc67228efd1f4e2f4815318a8287f6dbf4d955c7340d726e0e1729e2cedba5c\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-758lm\",\n                \"generateName\": \"kube-flannel-ds-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"eb0e27af-6569-4ff1-bcd9-82bb9ab356cb\",\n                \"resourceVersion\": \"662\",\n                \"creationTimestamp\": \"2021-09-23T16:32:25Z\",\n                \"labels\": {\n                    \"app\": \"flannel\",\n                    \"controller-revision-hash\": \"7f578449d6\",\n                    \"pod-template-generation\": \"1\",\n                    \"tier\": \"node\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"kube-flannel-ds\",\n                        \"uid\": \"98b93b87-2c8d-464d-b72d-5786378d4475\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"run\",\n                        \"hostPath\": {\n                            \"path\": \"/run/flannel\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"dev-net\",\n                        \"hostPath\": {\n                            \"path\": \"/dev/net\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"cni\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/cni/net.d\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"flannel-cfg\",\n                        \"configMap\": {\n                            \"name\": \"kube-flannel-cfg\",\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-dhzkn\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"initContainers\": [\n                    {\n                        \"name\": \"install-cni\",\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"command\": [\n                            \"cp\"\n                        ],\n                        \"args\": [\n                            \"-f\",\n                            \"/etc/kube-flannel/cni-conf.json\",\n                            \"/etc/cni/net.d/10-flannel.conflist\"\n                        ],\n                        \"resources\": {},\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"cni\",\n                                \"mountPath\": \"/etc/cni/net.d\"\n                            },\n                            {\n                                \"name\": \"flannel-cfg\",\n                                \"mountPath\": \"/etc/kube-flannel/\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-dhzkn\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-flannel\",\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"command\": [\n                            \"/opt/bin/flanneld\"\n                        ],\n                        \"args\": [\n                            \"--ip-masq\",\n                            \"--kube-subnet-mgr\",\n                            \"--iptables-resync=5\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"POD_NAME\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.name\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"POD_NAMESPACE\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.namespace\"\n                                    }\n                                }\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"100Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"run\",\n                                \"mountPath\": \"/run/flannel\"\n                            },\n                            {\n                                \"name\": \"dev-net\",\n                                \"mountPath\": \"/dev/net\"\n                            },\n                            {\n                                \"name\": \"flannel-cfg\",\n                                \"mountPath\": \"/etc/kube-flannel/\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-dhzkn\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_ADMIN\",\n                                    \"NET_RAW\"\n                                ]\n                            },\n                            \"privileged\": false\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"serviceAccountName\": \"flannel\",\n                \"serviceAccount\": \"flannel\",\n                \"nodeName\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"ip-172-20-63-252.ap-northeast-1.compute.internal\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:37Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:38Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:38Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:25Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.63.252\",\n                \"podIP\": \"172.20.63.252\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.63.252\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:32:26Z\",\n                \"initContainerStatuses\": [\n                    {\n                        \"name\": \"install-cni\",\n                        \"state\": {\n                            \"terminated\": {\n                                \"exitCode\": 0,\n                                \"reason\": \"Completed\",\n                                \"startedAt\": \"2021-09-23T16:32:36Z\",\n                                \"finishedAt\": \"2021-09-23T16:32:36Z\",\n                                \"containerID\": \"containerd://ba87495f8f7af3fc958918c0029fc7814333ce03b485bd00e396fd12795f49ee\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"imageID\": \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                        \"containerID\": \"containerd://ba87495f8f7af3fc958918c0029fc7814333ce03b485bd00e396fd12795f49ee\"\n                    }\n                ],\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-flannel\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:32:37Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"imageID\": \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                        \"containerID\": \"containerd://e9932070d927df838a3c47864198e158412b4b05d8a66cda542f64e16d863025\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-9cctk\",\n                \"generateName\": \"kube-flannel-ds-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e7090420-c93a-4aa1-a10b-ead90d2505c9\",\n                \"resourceVersion\": \"697\",\n                \"creationTimestamp\": \"2021-09-23T16:32:33Z\",\n                \"labels\": {\n                    \"app\": \"flannel\",\n                    \"controller-revision-hash\": \"7f578449d6\",\n                    \"pod-template-generation\": \"1\",\n                    \"tier\": \"node\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"kube-flannel-ds\",\n                        \"uid\": \"98b93b87-2c8d-464d-b72d-5786378d4475\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"run\",\n                        \"hostPath\": {\n                            \"path\": \"/run/flannel\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"dev-net\",\n                        \"hostPath\": {\n                            \"path\": \"/dev/net\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"cni\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/cni/net.d\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"flannel-cfg\",\n                        \"configMap\": {\n                            \"name\": \"kube-flannel-cfg\",\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-wb5ck\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"initContainers\": [\n                    {\n                        \"name\": \"install-cni\",\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"command\": [\n                            \"cp\"\n                        ],\n                        \"args\": [\n                            \"-f\",\n                            \"/etc/kube-flannel/cni-conf.json\",\n                            \"/etc/cni/net.d/10-flannel.conflist\"\n                        ],\n                        \"resources\": {},\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"cni\",\n                                \"mountPath\": \"/etc/cni/net.d\"\n                            },\n                            {\n                                \"name\": \"flannel-cfg\",\n                                \"mountPath\": \"/etc/kube-flannel/\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-wb5ck\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-flannel\",\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"command\": [\n                            \"/opt/bin/flanneld\"\n                        ],\n                        \"args\": [\n                            \"--ip-masq\",\n                            \"--kube-subnet-mgr\",\n                            \"--iptables-resync=5\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"POD_NAME\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.name\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"POD_NAMESPACE\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.namespace\"\n                                    }\n                                }\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"100Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"run\",\n                                \"mountPath\": \"/run/flannel\"\n                            },\n                            {\n                                \"name\": \"dev-net\",\n                                \"mountPath\": \"/dev/net\"\n                            },\n                            {\n                                \"name\": \"flannel-cfg\",\n                                \"mountPath\": \"/etc/kube-flannel/\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-wb5ck\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_ADMIN\",\n                                    \"NET_RAW\"\n                                ]\n                            },\n                            \"privileged\": false\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"serviceAccountName\": \"flannel\",\n                \"serviceAccount\": \"flannel\",\n                \"nodeName\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"ip-172-20-43-215.ap-northeast-1.compute.internal\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:43Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:44Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:44Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:33Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.43.215\",\n                \"podIP\": \"172.20.43.215\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.43.215\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:32:34Z\",\n                \"initContainerStatuses\": [\n                    {\n                        \"name\": \"install-cni\",\n                        \"state\": {\n                            \"terminated\": {\n                                \"exitCode\": 0,\n                                \"reason\": \"Completed\",\n                                \"startedAt\": \"2021-09-23T16:32:42Z\",\n                                \"finishedAt\": \"2021-09-23T16:32:42Z\",\n                                \"containerID\": \"containerd://7c97702a7c778a00517195334b8b3249fae868da4d80703692bed7f21b7d6bb2\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"imageID\": \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                        \"containerID\": \"containerd://7c97702a7c778a00517195334b8b3249fae868da4d80703692bed7f21b7d6bb2\"\n                    }\n                ],\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-flannel\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:32:44Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"imageID\": \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                        \"containerID\": \"containerd://7012699bba148a79c76900b0254d72a6422fb53908e88180889fd1c375502969\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-jn9xx\",\n                \"generateName\": \"kube-flannel-ds-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"63019a38-6600-4f16-810d-364cfbb54a62\",\n                \"resourceVersion\": \"693\",\n                \"creationTimestamp\": \"2021-09-23T16:32:31Z\",\n                \"labels\": {\n                    \"app\": \"flannel\",\n                    \"controller-revision-hash\": \"7f578449d6\",\n                    \"pod-template-generation\": \"1\",\n                    \"tier\": \"node\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"kube-flannel-ds\",\n                        \"uid\": \"98b93b87-2c8d-464d-b72d-5786378d4475\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"run\",\n                        \"hostPath\": {\n                            \"path\": \"/run/flannel\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"dev-net\",\n                        \"hostPath\": {\n                            \"path\": \"/dev/net\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"cni\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/cni/net.d\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"flannel-cfg\",\n                        \"configMap\": {\n                            \"name\": \"kube-flannel-cfg\",\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-sgrbg\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"initContainers\": [\n                    {\n                        \"name\": \"install-cni\",\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"command\": [\n                            \"cp\"\n                        ],\n                        \"args\": [\n                            \"-f\",\n                            \"/etc/kube-flannel/cni-conf.json\",\n                            \"/etc/cni/net.d/10-flannel.conflist\"\n                        ],\n                        \"resources\": {},\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"cni\",\n                                \"mountPath\": \"/etc/cni/net.d\"\n                            },\n                            {\n                                \"name\": \"flannel-cfg\",\n                                \"mountPath\": \"/etc/kube-flannel/\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-sgrbg\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-flannel\",\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"command\": [\n                            \"/opt/bin/flanneld\"\n                        ],\n                        \"args\": [\n                            \"--ip-masq\",\n                            \"--kube-subnet-mgr\",\n                            \"--iptables-resync=5\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"POD_NAME\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.name\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"POD_NAMESPACE\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.namespace\"\n                                    }\n                                }\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"100Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"run\",\n                                \"mountPath\": \"/run/flannel\"\n                            },\n                            {\n                                \"name\": \"dev-net\",\n                                \"mountPath\": \"/dev/net\"\n                            },\n                            {\n                                \"name\": \"flannel-cfg\",\n                                \"mountPath\": \"/etc/kube-flannel/\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-sgrbg\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_ADMIN\",\n                                    \"NET_RAW\"\n                                ]\n                            },\n                            \"privileged\": false\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"serviceAccountName\": \"flannel\",\n                \"serviceAccount\": \"flannel\",\n                \"nodeName\": \"ip-172-20-54-72.ap-northeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"ip-172-20-54-72.ap-northeast-1.compute.internal\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:43Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:44Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:44Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:31Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.54.72\",\n                \"podIP\": \"172.20.54.72\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.54.72\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:32:32Z\",\n                \"initContainerStatuses\": [\n                    {\n                        \"name\": \"install-cni\",\n                        \"state\": {\n                            \"terminated\": {\n                                \"exitCode\": 0,\n                                \"reason\": \"Completed\",\n                                \"startedAt\": \"2021-09-23T16:32:42Z\",\n                                \"finishedAt\": \"2021-09-23T16:32:42Z\",\n                                \"containerID\": \"containerd://d2309acf507e813221937a7d78d04bdfac26d333191339884992c1944406abc3\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"imageID\": \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                        \"containerID\": \"containerd://d2309acf507e813221937a7d78d04bdfac26d333191339884992c1944406abc3\"\n                    }\n                ],\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-flannel\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:32:43Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"imageID\": \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                        \"containerID\": \"containerd://de860220dbee3071f7f7b7543a01bdfa46f95772a73171e6dad22cd9b0a931e9\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-lpmtw\",\n                \"generateName\": \"kube-flannel-ds-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d1db4ff4-c3f0-41fb-965a-7309364fddcc\",\n                \"resourceVersion\": \"678\",\n                \"creationTimestamp\": \"2021-09-23T16:32:30Z\",\n                \"labels\": {\n                    \"app\": \"flannel\",\n                    \"controller-revision-hash\": \"7f578449d6\",\n                    \"pod-template-generation\": \"1\",\n                    \"tier\": \"node\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"kube-flannel-ds\",\n                        \"uid\": \"98b93b87-2c8d-464d-b72d-5786378d4475\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"run\",\n                        \"hostPath\": {\n                            \"path\": \"/run/flannel\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"dev-net\",\n                        \"hostPath\": {\n                            \"path\": \"/dev/net\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"cni\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/cni/net.d\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"flannel-cfg\",\n                        \"configMap\": {\n                            \"name\": \"kube-flannel-cfg\",\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-mhp22\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"initContainers\": [\n                    {\n                        \"name\": \"install-cni\",\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"command\": [\n                            \"cp\"\n                        ],\n                        \"args\": [\n                            \"-f\",\n                            \"/etc/kube-flannel/cni-conf.json\",\n                            \"/etc/cni/net.d/10-flannel.conflist\"\n                        ],\n                        \"resources\": {},\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"cni\",\n                                \"mountPath\": \"/etc/cni/net.d\"\n                            },\n                            {\n                                \"name\": \"flannel-cfg\",\n                                \"mountPath\": \"/etc/kube-flannel/\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-mhp22\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-flannel\",\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"command\": [\n                            \"/opt/bin/flanneld\"\n                        ],\n                        \"args\": [\n                            \"--ip-masq\",\n                            \"--kube-subnet-mgr\",\n                            \"--iptables-resync=5\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"POD_NAME\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.name\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"POD_NAMESPACE\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.namespace\"\n                                    }\n                                }\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"100Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"run\",\n                                \"mountPath\": \"/run/flannel\"\n                            },\n                            {\n                                \"name\": \"dev-net\",\n                                \"mountPath\": \"/dev/net\"\n                            },\n                            {\n                                \"name\": \"flannel-cfg\",\n                                \"mountPath\": \"/etc/kube-flannel/\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-mhp22\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_ADMIN\",\n                                    \"NET_RAW\"\n                                ]\n                            },\n                            \"privileged\": false\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"serviceAccountName\": \"flannel\",\n                \"serviceAccount\": \"flannel\",\n                \"nodeName\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"ip-172-20-34-24.ap-northeast-1.compute.internal\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:41Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:42Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:42Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:30Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.34.24\",\n                \"podIP\": \"172.20.34.24\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.34.24\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:32:32Z\",\n                \"initContainerStatuses\": [\n                    {\n                        \"name\": \"install-cni\",\n                        \"state\": {\n                            \"terminated\": {\n                                \"exitCode\": 0,\n                                \"reason\": \"Completed\",\n                                \"startedAt\": \"2021-09-23T16:32:40Z\",\n                                \"finishedAt\": \"2021-09-23T16:32:40Z\",\n                                \"containerID\": \"containerd://d45a585b0f76c8b15c110dd42e9e32890fdc4d6fc0305039652be5491432358d\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"imageID\": \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                        \"containerID\": \"containerd://d45a585b0f76c8b15c110dd42e9e32890fdc4d6fc0305039652be5491432358d\"\n                    }\n                ],\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-flannel\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:32:41Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"imageID\": \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                        \"containerID\": \"containerd://4ba950e828ba61a03cdf689a40955f3e5dd0c7400d98d36e48f3a10a90885d0a\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-xdtzt\",\n                \"generateName\": \"kube-flannel-ds-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"03ca9ab5-98dc-4097-b7bd-f518aa86607a\",\n                \"resourceVersion\": \"476\",\n                \"creationTimestamp\": \"2021-09-23T16:31:23Z\",\n                \"labels\": {\n                    \"app\": \"flannel\",\n                    \"controller-revision-hash\": \"7f578449d6\",\n                    \"pod-template-generation\": \"1\",\n                    \"tier\": \"node\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"DaemonSet\",\n                        \"name\": \"kube-flannel-ds\",\n                        \"uid\": \"98b93b87-2c8d-464d-b72d-5786378d4475\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"run\",\n                        \"hostPath\": {\n                            \"path\": \"/run/flannel\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"dev-net\",\n                        \"hostPath\": {\n                            \"path\": \"/dev/net\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"cni\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/cni/net.d\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"flannel-cfg\",\n                        \"configMap\": {\n                            \"name\": \"kube-flannel-cfg\",\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-vtzzl\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"initContainers\": [\n                    {\n                        \"name\": \"install-cni\",\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"command\": [\n                            \"cp\"\n                        ],\n                        \"args\": [\n                            \"-f\",\n                            \"/etc/kube-flannel/cni-conf.json\",\n                            \"/etc/cni/net.d/10-flannel.conflist\"\n                        ],\n                        \"resources\": {},\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"cni\",\n                                \"mountPath\": \"/etc/cni/net.d\"\n                            },\n                            {\n                                \"name\": \"flannel-cfg\",\n                                \"mountPath\": \"/etc/kube-flannel/\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-vtzzl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-flannel\",\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"command\": [\n                            \"/opt/bin/flanneld\"\n                        ],\n                        \"args\": [\n                            \"--ip-masq\",\n                            \"--kube-subnet-mgr\",\n                            \"--iptables-resync=5\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"POD_NAME\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.name\"\n                                    }\n                                }\n                            },\n                            {\n                                \"name\": \"POD_NAMESPACE\",\n                                \"valueFrom\": {\n                                    \"fieldRef\": {\n                                        \"apiVersion\": \"v1\",\n                                        \"fieldPath\": \"metadata.namespace\"\n                                    }\n                                }\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"100Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"run\",\n                                \"mountPath\": \"/run/flannel\"\n                            },\n                            {\n                                \"name\": \"dev-net\",\n                                \"mountPath\": \"/dev/net\"\n                            },\n                            {\n                                \"name\": \"flannel-cfg\",\n                                \"mountPath\": \"/etc/kube-flannel/\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-vtzzl\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_ADMIN\",\n                                    \"NET_RAW\"\n                                ]\n                            },\n                            \"privileged\": false\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"serviceAccountName\": \"flannel\",\n                \"serviceAccount\": \"flannel\",\n                \"nodeName\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"nodeAffinity\": {\n                        \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                            \"nodeSelectorTerms\": [\n                                {\n                                    \"matchFields\": [\n                                        {\n                                            \"key\": \"metadata.name\",\n                                            \"operator\": \"In\",\n                                            \"values\": [\n                                                \"ip-172-20-42-57.ap-northeast-1.compute.internal\"\n                                            ]\n                                        }\n                                    ]\n                                }\n                            ]\n                        }\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/disk-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/memory-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/pid-pressure\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/network-unavailable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:31:47Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:31:48Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:31:48Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:31:39Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.42.57\",\n                \"podIP\": \"172.20.42.57\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.42.57\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:31:39Z\",\n                \"initContainerStatuses\": [\n                    {\n                        \"name\": \"install-cni\",\n                        \"state\": {\n                            \"terminated\": {\n                                \"exitCode\": 0,\n                                \"reason\": \"Completed\",\n                                \"startedAt\": \"2021-09-23T16:31:46Z\",\n                                \"finishedAt\": \"2021-09-23T16:31:46Z\",\n                                \"containerID\": \"containerd://a29b1c68bf6e1ad8a84473b0b5f41f717daefb06b08825d84f178e6bcc35267b\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"imageID\": \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                        \"containerID\": \"containerd://a29b1c68bf6e1ad8a84473b0b5f41f717daefb06b08825d84f178e6bcc35267b\"\n                    }\n                ],\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-flannel\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:31:47Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                        \"imageID\": \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                        \"containerID\": \"containerd://f2b763c329da831fe75fcd1b82629505698bcafb7dd18aeece9913e48bfb5ec7\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-34-24.ap-northeast-1.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"16dc527b-011e-4d67-b0b1-65c662d9d3d0\",\n                \"resourceVersion\": \"640\",\n                \"creationTimestamp\": \"2021-09-23T16:32:32Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-proxy\",\n                    \"tier\": \"node\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"31aca4323d54b2361b419aa26bb6a713\",\n                    \"kubernetes.io/config.mirror\": \"31aca4323d54b2361b419aa26bb6a713\",\n                    \"kubernetes.io/config.seen\": \"2021-09-23T16:32:30.636993560Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\",\n                        \"uid\": \"20f0e66d-c770-4b7c-b18e-49b17f0d0ef1\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-proxy.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kubeconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-proxy/kubeconfig\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"ssl-certs-hosts\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ca-certificates\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"iptableslock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"command\": [\n                            \"/usr/local/bin/kube-proxy\"\n                        ],\n                        \"args\": [\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--conntrack-max-per-core=131072\",\n                            \"--hostname-override=ip-172-20-34-24.ap-northeast-1.compute.internal\",\n                            \"--kubeconfig=/var/lib/kube-proxy/kubeconfig\",\n                            \"--master=https://api.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\",\n                            \"--oom-score-adj=-998\",\n                            \"--v=2\",\n                            \"--logtostderr=false\",\n                            \"--alsologtostderr\",\n                            \"--log-file=/var/log/kube-proxy.log\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-proxy.log\"\n                            },\n                            {\n                                \"name\": \"kubeconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-proxy/kubeconfig\"\n                            },\n                            {\n                                \"name\": \"modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"ssl-certs-hosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl/certs\"\n                            },\n                            {\n                                \"name\": \"iptableslock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-34-24.ap-northeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:31Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:34Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:34Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:31Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.34.24\",\n                \"podIP\": \"172.20.34.24\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.34.24\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:32:31Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:32:33Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"imageID\": \"sha256:e08abd2be7302b7de4cc9d06bc6045be005c870f93065814da1d761980f7218d\",\n                        \"containerID\": \"containerd://1eca1d5cdf56c549e0dd19d0377edc3ff28288e9c49c706dc792c88e3edb8270\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5efba0a0-41e9-4558-a03d-cb88c4329971\",\n                \"resourceVersion\": \"511\",\n                \"creationTimestamp\": \"2021-09-23T16:31:50Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-proxy\",\n                    \"tier\": \"node\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"245b61638b1a6f6798d27c6578306535\",\n                    \"kubernetes.io/config.mirror\": \"245b61638b1a6f6798d27c6578306535\",\n                    \"kubernetes.io/config.seen\": \"2021-09-23T16:30:07.332096015Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                        \"uid\": \"42a5f8ca-7e32-4b00-8ee8-9d829587a401\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-proxy.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kubeconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-proxy/kubeconfig\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"ssl-certs-hosts\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ca-certificates\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"iptableslock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"command\": [\n                            \"/usr/local/bin/kube-proxy\"\n                        ],\n                        \"args\": [\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--conntrack-max-per-core=131072\",\n                            \"--hostname-override=ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                            \"--kubeconfig=/var/lib/kube-proxy/kubeconfig\",\n                            \"--master=https://127.0.0.1\",\n                            \"--oom-score-adj=-998\",\n                            \"--v=2\",\n                            \"--logtostderr=false\",\n                            \"--alsologtostderr\",\n                            \"--log-file=/var/log/kube-proxy.log\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-proxy.log\"\n                            },\n                            {\n                                \"name\": \"kubeconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-proxy/kubeconfig\"\n                            },\n                            {\n                                \"name\": \"modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"ssl-certs-hosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl/certs\"\n                            },\n                            {\n                                \"name\": \"iptableslock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:08Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:26Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:26Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:08Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.42.57\",\n                \"podIP\": \"172.20.42.57\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.42.57\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:30:08Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:30:24Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"imageID\": \"sha256:e08abd2be7302b7de4cc9d06bc6045be005c870f93065814da1d761980f7218d\",\n                        \"containerID\": \"containerd://a49c143c018f7d518b9e0bc04c12c4df5a14c5233e6eac0bc00c13d9fa67f5bb\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-43-215.ap-northeast-1.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"40f8f404-4cd6-4668-8461-3898f7de0629\",\n                \"resourceVersion\": \"654\",\n                \"creationTimestamp\": \"2021-09-23T16:32:34Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-proxy\",\n                    \"tier\": \"node\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"1f56aa3378d0c76c93caab7f68cd8d3d\",\n                    \"kubernetes.io/config.mirror\": \"1f56aa3378d0c76c93caab7f68cd8d3d\",\n                    \"kubernetes.io/config.seen\": \"2021-09-23T16:32:33.406619542Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\",\n                        \"uid\": \"e3ee3e88-18b3-487b-b4df-ac06ffd7fa73\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-proxy.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kubeconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-proxy/kubeconfig\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"ssl-certs-hosts\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ca-certificates\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"iptableslock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"command\": [\n                            \"/usr/local/bin/kube-proxy\"\n                        ],\n                        \"args\": [\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--conntrack-max-per-core=131072\",\n                            \"--hostname-override=ip-172-20-43-215.ap-northeast-1.compute.internal\",\n                            \"--kubeconfig=/var/lib/kube-proxy/kubeconfig\",\n                            \"--master=https://api.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\",\n                            \"--oom-score-adj=-998\",\n                            \"--v=2\",\n                            \"--logtostderr=false\",\n                            \"--alsologtostderr\",\n                            \"--log-file=/var/log/kube-proxy.log\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-proxy.log\"\n                            },\n                            {\n                                \"name\": \"kubeconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-proxy/kubeconfig\"\n                            },\n                            {\n                                \"name\": \"modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"ssl-certs-hosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl/certs\"\n                            },\n                            {\n                                \"name\": \"iptableslock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-43-215.ap-northeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:34Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:36Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:36Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:34Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.43.215\",\n                \"podIP\": \"172.20.43.215\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.43.215\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:32:34Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:32:36Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"imageID\": \"sha256:e08abd2be7302b7de4cc9d06bc6045be005c870f93065814da1d761980f7218d\",\n                        \"containerID\": \"containerd://455e2c5f9ae6c6418336ecdc4d3e7512f176fce1215533957d9bd2a01b718705\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-54-72.ap-northeast-1.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"92d36f0e-cad8-4db0-a0b6-18438354af5c\",\n                \"resourceVersion\": \"651\",\n                \"creationTimestamp\": \"2021-09-23T16:32:33Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-proxy\",\n                    \"tier\": \"node\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"3db826e0f6bba9859abf1813dc9c91a6\",\n                    \"kubernetes.io/config.mirror\": \"3db826e0f6bba9859abf1813dc9c91a6\",\n                    \"kubernetes.io/config.seen\": \"2021-09-23T16:32:31.452727211Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-54-72.ap-northeast-1.compute.internal\",\n                        \"uid\": \"38dfc56a-a21b-4dfb-9fcf-27118947e0b4\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-proxy.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kubeconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-proxy/kubeconfig\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"ssl-certs-hosts\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ca-certificates\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"iptableslock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"command\": [\n                            \"/usr/local/bin/kube-proxy\"\n                        ],\n                        \"args\": [\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--conntrack-max-per-core=131072\",\n                            \"--hostname-override=ip-172-20-54-72.ap-northeast-1.compute.internal\",\n                            \"--kubeconfig=/var/lib/kube-proxy/kubeconfig\",\n                            \"--master=https://api.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\",\n                            \"--oom-score-adj=-998\",\n                            \"--v=2\",\n                            \"--logtostderr=false\",\n                            \"--alsologtostderr\",\n                            \"--log-file=/var/log/kube-proxy.log\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-proxy.log\"\n                            },\n                            {\n                                \"name\": \"kubeconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-proxy/kubeconfig\"\n                            },\n                            {\n                                \"name\": \"modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"ssl-certs-hosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl/certs\"\n                            },\n                            {\n                                \"name\": \"iptableslock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-54-72.ap-northeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:32Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:36Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:36Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:32Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.54.72\",\n                \"podIP\": \"172.20.54.72\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.54.72\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:32:32Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:32:35Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"imageID\": \"sha256:e08abd2be7302b7de4cc9d06bc6045be005c870f93065814da1d761980f7218d\",\n                        \"containerID\": \"containerd://33369dbaf7af20b2bbb691057f329581f1412a261d5aefd321172a9385159915\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-63-252.ap-northeast-1.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"18a86009-6401-4cac-ad8a-66a15c4b3846\",\n                \"resourceVersion\": \"600\",\n                \"creationTimestamp\": \"2021-09-23T16:32:26Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-proxy\",\n                    \"tier\": \"node\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"8c1884608a63f05f9ef643671c2ecb29\",\n                    \"kubernetes.io/config.mirror\": \"8c1884608a63f05f9ef643671c2ecb29\",\n                    \"kubernetes.io/config.seen\": \"2021-09-23T16:32:25.796874514Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\",\n                        \"uid\": \"692468f8-c0fd-4f1b-ba63-3a5833701dc5\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-proxy.log\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"kubeconfig\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-proxy/kubeconfig\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"modules\",\n                        \"hostPath\": {\n                            \"path\": \"/lib/modules\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"ssl-certs-hosts\",\n                        \"hostPath\": {\n                            \"path\": \"/usr/share/ca-certificates\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"iptableslock\",\n                        \"hostPath\": {\n                            \"path\": \"/run/xtables.lock\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"command\": [\n                            \"/usr/local/bin/kube-proxy\"\n                        ],\n                        \"args\": [\n                            \"--cluster-cidr=100.96.0.0/11\",\n                            \"--conntrack-max-per-core=131072\",\n                            \"--hostname-override=ip-172-20-63-252.ap-northeast-1.compute.internal\",\n                            \"--kubeconfig=/var/lib/kube-proxy/kubeconfig\",\n                            \"--master=https://api.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\",\n                            \"--oom-score-adj=-998\",\n                            \"--v=2\",\n                            \"--logtostderr=false\",\n                            \"--alsologtostderr\",\n                            \"--log-file=/var/log/kube-proxy.log\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-proxy.log\"\n                            },\n                            {\n                                \"name\": \"kubeconfig\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-proxy/kubeconfig\"\n                            },\n                            {\n                                \"name\": \"modules\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/lib/modules\"\n                            },\n                            {\n                                \"name\": \"ssl-certs-hosts\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/ssl/certs\"\n                            },\n                            {\n                                \"name\": \"iptableslock\",\n                                \"mountPath\": \"/run/xtables.lock\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-63-252.ap-northeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-node-critical\",\n                \"priority\": 2000001000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:26Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:30Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:30Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:32:26Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.63.252\",\n                \"podIP\": \"172.20.63.252\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.63.252\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:32:26Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-proxy\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:32:29Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\",\n                        \"imageID\": \"sha256:e08abd2be7302b7de4cc9d06bc6045be005c870f93065814da1d761980f7218d\",\n                        \"containerID\": \"containerd://b6f8816e6b1c8532e784dd113c81b6216c42458ea859035edca028265acf9d70\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"773fa7e6-d8b9-4d29-b0ed-355777737079\",\n                \"resourceVersion\": \"512\",\n                \"creationTimestamp\": \"2021-09-23T16:31:55Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-scheduler\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"f258137e61136ac8b23bfd95e5bfbc7a\",\n                    \"kubernetes.io/config.mirror\": \"f258137e61136ac8b23bfd95e5bfbc7a\",\n                    \"kubernetes.io/config.seen\": \"2021-09-23T16:30:07.332097375Z\",\n                    \"kubernetes.io/config.source\": \"file\",\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                        \"uid\": \"42a5f8ca-7e32-4b00-8ee8-9d829587a401\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"varlibkubescheduler\",\n                        \"hostPath\": {\n                            \"path\": \"/var/lib/kube-scheduler\",\n                            \"type\": \"\"\n                        }\n                    },\n                    {\n                        \"name\": \"logfile\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/kube-scheduler.log\",\n                            \"type\": \"\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"kube-scheduler\",\n                        \"image\": \"k8s.gcr.io/kube-scheduler-amd64:v1.21.5\",\n                        \"command\": [\n                            \"/usr/local/bin/kube-scheduler\"\n                        ],\n                        \"args\": [\n                            \"--config=/var/lib/kube-scheduler/config.yaml\",\n                            \"--leader-elect=true\",\n                            \"--v=2\",\n                            \"--logtostderr=false\",\n                            \"--alsologtostderr\",\n                            \"--log-file=/var/log/kube-scheduler.log\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"varlibkubescheduler\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/lib/kube-scheduler\"\n                            },\n                            {\n                                \"name\": \"logfile\",\n                                \"mountPath\": \"/var/log/kube-scheduler.log\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/healthz\",\n                                \"port\": 10251,\n                                \"host\": \"127.0.0.1\",\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 15,\n                            \"timeoutSeconds\": 15,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-42-57.ap-northeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:08Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:26Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:26Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-09-23T16:30:08Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.42.57\",\n                \"podIP\": \"172.20.42.57\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.42.57\"\n                    }\n                ],\n                \"startTime\": \"2021-09-23T16:30:08Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"kube-scheduler\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-09-23T16:30:24Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kube-scheduler-amd64:v1.21.5\",\n                        \"imageID\": \"sha256:8e60ea3644d6dd6c1ed564f36ab9ef7bf19bfde909a5dcc4d974ac21ea1b3b3e\",\n                        \"containerID\": \"containerd://6d0acd144843183561cbc22d81a48871b7e21f363d44e8c44d1eac3c9638a780\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        }\n    ]\n}\n==== START logs for container coredns of pod kube-system/coredns-5dc785954d-nfmmr ====\n[INFO] plugin/ready: Still waiting on: \"kubernetes\"\n.:53\n[INFO] plugin/reload: Running configuration MD5 = 9e3e34ac93d9bb69126337d32f1195e3\nCoreDNS-1.8.4\nlinux/amd64, go1.16.4, 053c4d5\n==== END logs for container coredns of pod kube-system/coredns-5dc785954d-nfmmr ====\n==== START logs for container coredns of pod kube-system/coredns-5dc785954d-wbcvv ====\n.:53\n[INFO] plugin/reload: Running configuration MD5 = 9e3e34ac93d9bb69126337d32f1195e3\nCoreDNS-1.8.4\nlinux/amd64, go1.16.4, 053c4d5\n==== END logs for container coredns of pod kube-system/coredns-5dc785954d-wbcvv ====\n==== START logs for container autoscaler of pod kube-system/coredns-autoscaler-84d4cfd89c-4mrql ====\nI0923 16:32:51.054151       1 autoscaler.go:49] Scaling Namespace: kube-system, Target: deployment/coredns\nI0923 16:32:51.308733       1 autoscaler_server.go:157] ConfigMap not found: configmaps \"coredns-autoscaler\" not found, will create one with default params\nI0923 16:32:51.312401       1 k8sclient.go:147] Created ConfigMap coredns-autoscaler in namespace kube-system\nI0923 16:32:51.312419       1 plugin.go:50] Set control mode to linear\nI0923 16:32:51.312425       1 linear_controller.go:60] ConfigMap version change (old:  new: 726) - rebuilding params\nI0923 16:32:51.312430       1 linear_controller.go:61] Params from apiserver: \n{\"coresPerReplica\":256,\"nodesPerReplica\":16,\"preventSinglePointFailure\":true}\nI0923 16:32:51.312487       1 linear_controller.go:80] Defaulting min replicas count to 1 for linear controller\nI0923 16:32:51.314326       1 k8sclient.go:272] Cluster status: SchedulableNodes[5], SchedulableCores[10]\nI0923 16:32:51.314340       1 k8sclient.go:273] Replicas are not as expected : updating replicas from 1 to 2\n==== END logs for container autoscaler of pod kube-system/coredns-autoscaler-84d4cfd89c-4mrql ====\n==== START logs for container dns-controller of pod kube-system/dns-controller-56b8dc9b5b-rgnj7 ====\ndns-controller version 0.1\nI0923 16:31:40.413881       1 main.go:199] initializing the watch controllers, namespace: \"\"\nI0923 16:31:40.413910       1 main.go:223] Ingress controller disabled\nI0923 16:31:40.413958       1 dnscontroller.go:108] starting DNS controller\nI0923 16:31:40.413989       1 dnscontroller.go:170] scope not yet ready: node\nI0923 16:31:40.414029       1 pod.go:60] starting pod controller\nI0923 16:31:40.414474       1 service.go:60] starting service controller\nI0923 16:31:40.414927       1 node.go:60] starting node controller\nI0923 16:31:40.436664       1 dnscontroller.go:625] Update desired state: node/ip-172-20-42-57.ap-northeast-1.compute.internal: [{A node/ip-172-20-42-57.ap-northeast-1.compute.internal/internal 172.20.42.57 true} {A node/ip-172-20-42-57.ap-northeast-1.compute.internal/external 13.113.30.195 true} {A node/role=master/internal 172.20.42.57 true} {A node/role=master/external 13.113.30.195 true} {A node/role=master/ ip-172-20-42-57.ap-northeast-1.compute.internal true} {A node/role=master/ ip-172-20-42-57.ap-northeast-1.compute.internal true} {A node/role=master/ ec2-13-113-30-195.ap-northeast-1.compute.amazonaws.com true}]\nI0923 16:31:45.414794       1 dnscache.go:74] querying all DNS zones (no cached results)\nI0923 16:31:56.618811       1 dnscontroller.go:625] Update desired state: pod/kube-system/kops-controller-cdk2g: [{A kops-controller.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io. 172.20.42.57 false}]\nI0923 16:32:01.132186       1 dnscontroller.go:274] Using default TTL of 1m0s\nI0923 16:32:01.132226       1 dnscontroller.go:482] Querying all dnsprovider records for zone \"test-cncf-aws.k8s.io.\"\nI0923 16:32:04.232012       1 dnscontroller.go:585] Adding DNS changes to batch {A kops-controller.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io.} [172.20.42.57]\nI0923 16:32:04.232051       1 dnscontroller.go:323] Applying DNS changeset for zone test-cncf-aws.k8s.io.::ZEMLNXIIWQ0RV\nI0923 16:32:16.263287       1 dnscontroller.go:625] Update desired state: pod/kube-system/kube-apiserver-ip-172-20-42-57.ap-northeast-1.compute.internal: [{_alias api.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io. node/ip-172-20-42-57.ap-northeast-1.compute.internal/external false}]\nI0923 16:32:18.255032       1 dnscontroller.go:625] Update desired state: pod/kube-system/kube-apiserver-ip-172-20-42-57.ap-northeast-1.compute.internal: [{_alias api.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io. node/ip-172-20-42-57.ap-northeast-1.compute.internal/external false} {A api.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io. 172.20.42.57 false}]\nI0923 16:32:19.501902       1 dnscontroller.go:274] Using default TTL of 1m0s\nI0923 16:32:19.501937       1 dnscontroller.go:482] Querying all dnsprovider records for zone \"test-cncf-aws.k8s.io.\"\nI0923 16:32:22.199534       1 dnscontroller.go:585] Adding DNS changes to batch {A api.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io.} [172.20.42.57]\nI0923 16:32:22.199569       1 dnscontroller.go:274] Using default TTL of 1m0s\nI0923 16:32:22.200036       1 dnscontroller.go:585] Adding DNS changes to batch {A api.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io.} [13.113.30.195]\nI0923 16:32:22.200062       1 dnscontroller.go:323] Applying DNS changeset for zone test-cncf-aws.k8s.io.::ZEMLNXIIWQ0RV\nI0923 16:32:25.927415       1 dnscontroller.go:625] Update desired state: node/ip-172-20-63-252.ap-northeast-1.compute.internal: [{A node/ip-172-20-63-252.ap-northeast-1.compute.internal/internal 172.20.63.252 true} {A node/ip-172-20-63-252.ap-northeast-1.compute.internal/external 18.183.255.70 true} {A node/role=node/internal 172.20.63.252 true} {A node/role=node/external 18.183.255.70 true} {A node/role=node/ ip-172-20-63-252.ap-northeast-1.compute.internal true} {A node/role=node/ ip-172-20-63-252.ap-northeast-1.compute.internal true} {A node/role=node/ ec2-18-183-255-70.ap-northeast-1.compute.amazonaws.com true}]\nI0923 16:32:30.839543       1 dnscontroller.go:625] Update desired state: node/ip-172-20-34-24.ap-northeast-1.compute.internal: [{A node/ip-172-20-34-24.ap-northeast-1.compute.internal/internal 172.20.34.24 true} {A node/ip-172-20-34-24.ap-northeast-1.compute.internal/external 18.181.174.104 true} {A node/role=node/internal 172.20.34.24 true} {A node/role=node/external 18.181.174.104 true} {A node/role=node/ ip-172-20-34-24.ap-northeast-1.compute.internal true} {A node/role=node/ ip-172-20-34-24.ap-northeast-1.compute.internal true} {A node/role=node/ ec2-18-181-174-104.ap-northeast-1.compute.amazonaws.com true}]\nI0923 16:32:31.622394       1 dnscontroller.go:625] Update desired state: node/ip-172-20-54-72.ap-northeast-1.compute.internal: [{A node/ip-172-20-54-72.ap-northeast-1.compute.internal/internal 172.20.54.72 true} {A node/ip-172-20-54-72.ap-northeast-1.compute.internal/external 3.112.222.63 true} {A node/role=node/internal 172.20.54.72 true} {A node/role=node/external 3.112.222.63 true} {A node/role=node/ ip-172-20-54-72.ap-northeast-1.compute.internal true} {A node/role=node/ ip-172-20-54-72.ap-northeast-1.compute.internal true} {A node/role=node/ ec2-3-112-222-63.ap-northeast-1.compute.amazonaws.com true}]\nI0923 16:32:33.553819       1 dnscontroller.go:625] Update desired state: node/ip-172-20-43-215.ap-northeast-1.compute.internal: [{A node/ip-172-20-43-215.ap-northeast-1.compute.internal/internal 172.20.43.215 true} {A node/ip-172-20-43-215.ap-northeast-1.compute.internal/external 54.238.117.197 true} {A node/role=node/internal 172.20.43.215 true} {A node/role=node/external 54.238.117.197 true} {A node/role=node/ ip-172-20-43-215.ap-northeast-1.compute.internal true} {A node/role=node/ ip-172-20-43-215.ap-northeast-1.compute.internal true} {A node/role=node/ ec2-54-238-117-197.ap-northeast-1.compute.amazonaws.com true}]\n==== END logs for container dns-controller of pod kube-system/dns-controller-56b8dc9b5b-rgnj7 ====\n==== START logs for container etcd-manager of pod kube-system/etcd-manager-events-ip-172-20-42-57.ap-northeast-1.compute.internal ====\netcd-manager\nI0923 16:30:39.401079    4591 volumes.go:86] AWS API Request: ec2metadata/GetToken\nI0923 16:30:39.401904    4591 volumes.go:86] AWS API Request: ec2metadata/GetDynamicData\nI0923 16:30:39.402471    4591 volumes.go:86] AWS API Request: ec2metadata/GetMetadata\nI0923 16:30:39.402951    4591 volumes.go:86] AWS API Request: ec2metadata/GetMetadata\nI0923 16:30:39.403441    4591 volumes.go:86] AWS API Request: ec2metadata/GetMetadata\nI0923 16:30:39.403916    4591 main.go:305] Mounting available etcd volumes matching tags [k8s.io/etcd/events k8s.io/role/master=1 kubernetes.io/cluster/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io=owned]; nameTag=k8s.io/etcd/events\nI0923 16:30:39.405627    4591 volumes.go:86] AWS API Request: ec2/DescribeVolumes\nI0923 16:30:39.558059    4591 mounter.go:304] Trying to mount master volume: \"vol-09f990227e781d9c5\"\nI0923 16:30:39.558080    4591 volumes.go:331] Trying to attach volume \"vol-09f990227e781d9c5\" at \"/dev/xvdu\"\nI0923 16:30:39.558230    4591 volumes.go:86] AWS API Request: ec2/AttachVolume\nI0923 16:30:40.046168    4591 volumes.go:349] AttachVolume request returned {\n  AttachTime: 2021-09-23 16:30:40.027 +0000 UTC,\n  Device: \"/dev/xvdu\",\n  InstanceId: \"i-0cb466337e23815c6\",\n  State: \"attaching\",\n  VolumeId: \"vol-09f990227e781d9c5\"\n}\nI0923 16:30:40.046633    4591 volumes.go:86] AWS API Request: ec2/DescribeVolumes\nI0923 16:30:40.178094    4591 mounter.go:318] Currently attached volumes: [0xc0000d6380]\nI0923 16:30:40.178171    4591 mounter.go:72] Master volume \"vol-09f990227e781d9c5\" is attached at \"/dev/xvdu\"\nI0923 16:30:40.178234    4591 mounter.go:86] Doing safe-format-and-mount of /dev/xvdu to /mnt/master-vol-09f990227e781d9c5\nI0923 16:30:40.178255    4591 volumes.go:234] volume vol-09f990227e781d9c5 not mounted at /rootfs/dev/xvdu\nI0923 16:30:40.178291    4591 volumes.go:263] nvme path not found \"/rootfs/dev/disk/by-id/nvme-Amazon_Elastic_Block_Store_vol09f990227e781d9c5\"\nI0923 16:30:40.178307    4591 volumes.go:251] volume vol-09f990227e781d9c5 not mounted at nvme-Amazon_Elastic_Block_Store_vol09f990227e781d9c5\nI0923 16:30:40.178319    4591 mounter.go:121] Waiting for volume \"vol-09f990227e781d9c5\" to be mounted\nI0923 16:30:41.178418    4591 mounter.go:125] Found volume \"vol-09f990227e781d9c5\" mounted at device \"/dev/xvdu\"\nI0923 16:30:41.179008    4591 mounter.go:171] Creating mount directory \"/rootfs/mnt/master-vol-09f990227e781d9c5\"\nI0923 16:30:41.179061    4591 mounter.go:176] Mounting device \"/dev/xvdu\" on \"/mnt/master-vol-09f990227e781d9c5\"\nI0923 16:30:41.179086    4591 mount_linux.go:446] Attempting to determine if disk \"/dev/xvdu\" is formatted using blkid with args: ([-p -s TYPE -s PTTYPE -o export /dev/xvdu])\nI0923 16:30:41.179120    4591 nsenter.go:132] Running nsenter command: nsenter [--mount=/rootfs/proc/1/ns/mnt -- blkid -p -s TYPE -s PTTYPE -o export /dev/xvdu]\nI0923 16:30:41.194354    4591 mount_linux.go:449] Output: \"\"\nI0923 16:30:41.194374    4591 mount_linux.go:408] Disk \"/dev/xvdu\" appears to be unformatted, attempting to format as type: \"ext4\" with options: [-F -m0 /dev/xvdu]\nI0923 16:30:41.194396    4591 nsenter.go:132] Running nsenter command: nsenter [--mount=/rootfs/proc/1/ns/mnt -- mkfs.ext4 -F -m0 /dev/xvdu]\nI0923 16:30:41.631116    4591 mount_linux.go:418] Disk successfully formatted (mkfs): ext4 - /dev/xvdu /mnt/master-vol-09f990227e781d9c5\nI0923 16:30:41.631135    4591 mount_linux.go:436] Attempting to mount disk /dev/xvdu in ext4 format at /mnt/master-vol-09f990227e781d9c5\nI0923 16:30:41.631153    4591 nsenter.go:80] nsenter mount /dev/xvdu /mnt/master-vol-09f990227e781d9c5 ext4 [defaults]\nI0923 16:30:41.631178    4591 nsenter.go:132] Running nsenter command: nsenter [--mount=/rootfs/proc/1/ns/mnt -- /bin/systemd-run --description=Kubernetes transient mount for /mnt/master-vol-09f990227e781d9c5 --scope -- /bin/mount -t ext4 -o defaults /dev/xvdu /mnt/master-vol-09f990227e781d9c5]\nI0923 16:30:41.735274    4591 nsenter.go:84] Output of mounting /dev/xvdu to /mnt/master-vol-09f990227e781d9c5: Running scope as unit run-4720.scope.\nI0923 16:30:41.735304    4591 mount_linux.go:446] Attempting to determine if disk \"/dev/xvdu\" is formatted using blkid with args: ([-p -s TYPE -s PTTYPE -o export /dev/xvdu])\nI0923 16:30:41.735344    4591 nsenter.go:132] Running nsenter command: nsenter [--mount=/rootfs/proc/1/ns/mnt -- blkid -p -s TYPE -s PTTYPE -o export /dev/xvdu]\nI0923 16:30:41.750916    4591 mount_linux.go:449] Output: \"DEVNAME=/dev/xvdu\\nTYPE=ext4\\n\"\nI0923 16:30:41.750949    4591 resizefs_linux.go:53] ResizeFS.Resize - Expanding mounted volume /dev/xvdu\nI0923 16:30:41.750964    4591 nsenter.go:132] Running nsenter command: nsenter [--mount=/rootfs/proc/1/ns/mnt -- resize2fs /dev/xvdu]\nI0923 16:30:41.764240    4591 resizefs_linux.go:68] Device /dev/xvdu resized successfully\nI0923 16:30:41.778985    4591 mount_linux.go:202] Cannot run systemd-run, assuming non-systemd OS\nI0923 16:30:41.778998    4591 mount_linux.go:203] systemd-run output: Failed to request invocation ID for scope: Unknown property or interface.\n, failed with: exit status 1\nI0923 16:30:41.781068    4591 mounter.go:224] mounting inside container: /rootfs/dev/xvdu -> /rootfs/mnt/master-vol-09f990227e781d9c5\nI0923 16:30:41.781083    4591 mount_linux.go:175] Mounting cmd (mount) with arguments ( /rootfs/dev/xvdu /rootfs/mnt/master-vol-09f990227e781d9c5)\nI0923 16:30:41.784413    4591 mounter.go:94] mounted master volume \"vol-09f990227e781d9c5\" on /mnt/master-vol-09f990227e781d9c5\nI0923 16:30:41.784434    4591 main.go:320] discovered IP address: 172.20.42.57\nI0923 16:30:41.784439    4591 main.go:325] Setting data dir to /rootfs/mnt/master-vol-09f990227e781d9c5\nI0923 16:30:42.282608    4591 certs.go:183] generating certificate for \"etcd-manager-server-etcd-events-a\"\nI0923 16:30:42.454835    4591 certs.go:183] generating certificate for \"etcd-manager-client-etcd-events-a\"\nI0923 16:30:42.464449    4591 server.go:87] starting GRPC server using TLS, ServerName=\"etcd-manager-server-etcd-events-a\"\nI0923 16:30:42.465098    4591 main.go:474] peerClientIPs: [172.20.42.57]\nI0923 16:30:42.671477    4591 certs.go:183] generating certificate for \"etcd-manager-etcd-events-a\"\nI0923 16:30:42.674480    4591 server.go:105] GRPC server listening on \"172.20.42.57:3997\"\nI0923 16:30:42.674825    4591 volumes.go:86] AWS API Request: ec2/DescribeVolumes\nI0923 16:30:43.036106    4591 volumes.go:86] AWS API Request: ec2/DescribeInstances\nI0923 16:30:43.236338    4591 peers.go:115] found new candidate peer from discovery: etcd-events-a [{172.20.42.57 0} {172.20.42.57 0}]\nI0923 16:30:43.236382    4591 hosts.go:84] hosts update: primary=map[], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:30:43.236627    4591 peers.go:295] connecting to peer \"etcd-events-a\" with TLS policy, servername=\"etcd-manager-server-etcd-events-a\"\nI0923 16:30:44.675591    4591 controller.go:189] starting controller iteration\nI0923 16:30:44.676031    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:30:44.676204    4591 commands.go:41] refreshing commands\nI0923 16:30:44.676301    4591 s3context.go:334] product_uuid is \"ec2b1966-9c15-d1fa-1c29-c51a302d06c1\", assuming running on EC2\nI0923 16:30:44.677954    4591 s3context.go:166] got region from metadata: \"ap-northeast-1\"\nI0923 16:30:44.729608    4591 s3context.go:213] found bucket in region \"us-west-1\"\nI0923 16:30:45.292730    4591 vfs.go:120] listed commands in s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control: 0 commands\nI0923 16:30:45.292753    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-spec\"\nI0923 16:30:55.414672    4591 controller.go:189] starting controller iteration\nI0923 16:30:55.414702    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:30:55.415016    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:30:55.415201    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:30:55.415619    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > }\nI0923 16:30:55.415695    4591 controller.go:303] etcd cluster members: map[]\nI0923 16:30:55.415710    4591 controller.go:641] sending member map to all peers: \nI0923 16:30:55.415925    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:30:55.415943    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:30:55.878265    4591 controller.go:359] detected that there is no existing cluster\nI0923 16:30:55.878319    4591 commands.go:41] refreshing commands\nI0923 16:30:56.074004    4591 vfs.go:120] listed commands in s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control: 0 commands\nI0923 16:30:56.074027    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-spec\"\nI0923 16:30:56.195953    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:30:56.196208    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:30:56.196229    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:30:56.196285    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:30:56.196390    4591 newcluster.go:136] starting new etcd cluster with [etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > }]\nI0923 16:30:56.196698    4591 newcluster.go:153] JoinClusterResponse: \nI0923 16:30:56.197526    4591 etcdserver.go:556] starting etcd with state new_cluster:true cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" quarantined:true \nI0923 16:30:56.197570    4591 etcdserver.go:565] starting etcd with datadir /rootfs/mnt/master-vol-09f990227e781d9c5/data/1GMjY1jGv9xkxFHdigrSTQ\nI0923 16:30:56.198091    4591 pki.go:59] adding peerClientIPs [172.20.42.57]\nI0923 16:30:56.198141    4591 pki.go:67] generating peer keypair for etcd: {CommonName:etcd-events-a Organization:[] AltNames:{DNSNames:[etcd-events-a etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io] IPs:[172.20.42.57 127.0.0.1]} Usages:[2 1]}\nI0923 16:30:56.249998    4591 certs.go:183] generating certificate for \"etcd-events-a\"\nI0923 16:30:56.251986    4591 pki.go:110] building client-serving certificate: {CommonName:etcd-events-a Organization:[] AltNames:{DNSNames:[etcd-events-a etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io] IPs:[127.0.0.1]} Usages:[1 2]}\nI0923 16:30:56.496694    4591 certs.go:183] generating certificate for \"etcd-events-a\"\nI0923 16:30:56.884786    4591 certs.go:183] generating certificate for \"etcd-events-a\"\nI0923 16:30:56.887810    4591 etcdprocess.go:203] executing command /opt/etcd-v3.4.13-linux-amd64/etcd [/opt/etcd-v3.4.13-linux-amd64/etcd]\nI0923 16:30:56.888861    4591 newcluster.go:171] JoinClusterResponse: \nI0923 16:30:56.888907    4591 s3fs.go:199] Writing file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-spec\"\nI0923 16:30:56.888920    4591 s3context.go:241] Checking default bucket encryption for \"k8s-kops-prow\"\n2021-09-23 16:30:56.895534 I | pkg/flags: recognized and used environment variable ETCD_ADVERTISE_CLIENT_URLS=https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\n2021-09-23 16:30:56.895725 I | pkg/flags: recognized and used environment variable ETCD_CERT_FILE=/rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/clients/server.crt\n2021-09-23 16:30:56.895796 I | pkg/flags: recognized and used environment variable ETCD_CLIENT_CERT_AUTH=true\n2021-09-23 16:30:56.895887 I | pkg/flags: recognized and used environment variable ETCD_DATA_DIR=/rootfs/mnt/master-vol-09f990227e781d9c5/data/1GMjY1jGv9xkxFHdigrSTQ\n2021-09-23 16:30:56.895966 I | pkg/flags: recognized and used environment variable ETCD_ENABLE_V2=false\n2021-09-23 16:30:56.896059 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_ADVERTISE_PEER_URLS=https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\n2021-09-23 16:30:56.896123 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER=etcd-events-a=https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\n2021-09-23 16:30:56.896199 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER_STATE=new\n2021-09-23 16:30:56.896267 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER_TOKEN=1GMjY1jGv9xkxFHdigrSTQ\n2021-09-23 16:30:56.896357 I | pkg/flags: recognized and used environment variable ETCD_KEY_FILE=/rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/clients/server.key\n2021-09-23 16:30:56.896433 I | pkg/flags: recognized and used environment variable ETCD_LISTEN_CLIENT_URLS=https://0.0.0.0:3995\n2021-09-23 16:30:56.896510 I | pkg/flags: recognized and used environment variable ETCD_LISTEN_PEER_URLS=https://0.0.0.0:2381\n2021-09-23 16:30:56.896579 I | pkg/flags: recognized and used environment variable ETCD_LOG_OUTPUTS=stdout\n2021-09-23 16:30:56.896677 I | pkg/flags: recognized and used environment variable ETCD_LOGGER=zap\n2021-09-23 16:30:56.896757 I | pkg/flags: recognized and used environment variable ETCD_NAME=etcd-events-a\n2021-09-23 16:30:56.896840 I | pkg/flags: recognized and used environment variable ETCD_PEER_CERT_FILE=/rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/peers/me.crt\n2021-09-23 16:30:56.896907 I | pkg/flags: recognized and used environment variable ETCD_PEER_CLIENT_CERT_AUTH=true\n2021-09-23 16:30:56.896982 I | pkg/flags: recognized and used environment variable ETCD_PEER_KEY_FILE=/rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/peers/me.key\n2021-09-23 16:30:56.897048 I | pkg/flags: recognized and used environment variable ETCD_PEER_TRUSTED_CA_FILE=/rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/peers/ca.crt\n2021-09-23 16:30:56.897129 I | pkg/flags: recognized and used environment variable ETCD_TRUSTED_CA_FILE=/rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/clients/ca.crt\n2021-09-23 16:30:56.897213 W | pkg/flags: unrecognized environment variable ETCD_LISTEN_METRICS_URLS=\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.897Z\",\"caller\":\"embed/etcd.go:117\",\"msg\":\"configuring peer listeners\",\"listen-peer-urls\":[\"https://0.0.0.0:2381\"]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.897Z\",\"caller\":\"embed/etcd.go:468\",\"msg\":\"starting with peer TLS\",\"tls-info\":\"cert = /rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/peers/me.crt, key = /rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/peers/me.key, trusted-ca = /rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/peers/ca.crt, client-cert-auth = true, crl-file = \",\"cipher-suites\":[]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.898Z\",\"caller\":\"embed/etcd.go:127\",\"msg\":\"configuring client listeners\",\"listen-client-urls\":[\"https://0.0.0.0:3995\"]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.900Z\",\"caller\":\"embed/etcd.go:302\",\"msg\":\"starting an etcd server\",\"etcd-version\":\"3.4.13\",\"git-sha\":\"ae9734ed2\",\"go-version\":\"go1.12.17\",\"go-os\":\"linux\",\"go-arch\":\"amd64\",\"max-cpu-set\":2,\"max-cpu-available\":2,\"member-initialized\":false,\"name\":\"etcd-events-a\",\"data-dir\":\"/rootfs/mnt/master-vol-09f990227e781d9c5/data/1GMjY1jGv9xkxFHdigrSTQ\",\"wal-dir\":\"\",\"wal-dir-dedicated\":\"\",\"member-dir\":\"/rootfs/mnt/master-vol-09f990227e781d9c5/data/1GMjY1jGv9xkxFHdigrSTQ/member\",\"force-new-cluster\":false,\"heartbeat-interval\":\"100ms\",\"election-timeout\":\"1s\",\"initial-election-tick-advance\":true,\"snapshot-count\":100000,\"snapshot-catchup-entries\":5000,\"initial-advertise-peer-urls\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"listen-peer-urls\":[\"https://0.0.0.0:2381\"],\"advertise-client-urls\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\"],\"listen-client-urls\":[\"https://0.0.0.0:3995\"],\"listen-metrics-urls\":[],\"cors\":[\"*\"],\"host-whitelist\":[\"*\"],\"initial-cluster\":\"etcd-events-a=https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\",\"initial-cluster-state\":\"new\",\"initial-cluster-token\":\"1GMjY1jGv9xkxFHdigrSTQ\",\"quota-size-bytes\":2147483648,\"pre-vote\":false,\"initial-corrupt-check\":false,\"corrupt-check-time-interval\":\"0s\",\"auto-compaction-mode\":\"periodic\",\"auto-compaction-retention\":\"0s\",\"auto-compaction-interval\":\"0s\",\"discovery-url\":\"\",\"discovery-proxy\":\"\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.904Z\",\"caller\":\"etcdserver/backend.go:80\",\"msg\":\"opened backend db\",\"path\":\"/rootfs/mnt/master-vol-09f990227e781d9c5/data/1GMjY1jGv9xkxFHdigrSTQ/member/snap/db\",\"took\":\"3.669646ms\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.905Z\",\"caller\":\"netutil/netutil.go:112\",\"msg\":\"resolved URL Host\",\"url\":\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\",\"host\":\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\",\"resolved-addr\":\"172.20.42.57:2381\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.905Z\",\"caller\":\"netutil/netutil.go:112\",\"msg\":\"resolved URL Host\",\"url\":\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\",\"host\":\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\",\"resolved-addr\":\"172.20.42.57:2381\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.918Z\",\"caller\":\"etcdserver/raft.go:486\",\"msg\":\"starting local member\",\"local-member-id\":\"d3e3bb311dd21802\",\"cluster-id\":\"9ac7545a84c4d9df\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.918Z\",\"caller\":\"raft/raft.go:1530\",\"msg\":\"d3e3bb311dd21802 switched to configuration voters=()\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.918Z\",\"caller\":\"raft/raft.go:700\",\"msg\":\"d3e3bb311dd21802 became follower at term 0\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.918Z\",\"caller\":\"raft/raft.go:383\",\"msg\":\"newRaft d3e3bb311dd21802 [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.918Z\",\"caller\":\"raft/raft.go:700\",\"msg\":\"d3e3bb311dd21802 became follower at term 1\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.918Z\",\"caller\":\"raft/raft.go:1530\",\"msg\":\"d3e3bb311dd21802 switched to configuration voters=(15268252981344212994)\"}\n{\"level\":\"warn\",\"ts\":\"2021-09-23T16:30:56.921Z\",\"caller\":\"auth/store.go:1366\",\"msg\":\"simple token is not cryptographically signed\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.924Z\",\"caller\":\"etcdserver/quota.go:98\",\"msg\":\"enabled backend quota with default value\",\"quota-name\":\"v3-applier\",\"quota-size-bytes\":2147483648,\"quota-size\":\"2.1 GB\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.928Z\",\"caller\":\"etcdserver/server.go:803\",\"msg\":\"starting etcd server\",\"local-member-id\":\"d3e3bb311dd21802\",\"local-server-version\":\"3.4.13\",\"cluster-version\":\"to_be_decided\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.929Z\",\"caller\":\"etcdserver/server.go:669\",\"msg\":\"started as single-node; fast-forwarding election ticks\",\"local-member-id\":\"d3e3bb311dd21802\",\"forward-ticks\":9,\"forward-duration\":\"900ms\",\"election-ticks\":10,\"election-timeout\":\"1s\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.929Z\",\"caller\":\"raft/raft.go:1530\",\"msg\":\"d3e3bb311dd21802 switched to configuration voters=(15268252981344212994)\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.930Z\",\"caller\":\"membership/cluster.go:392\",\"msg\":\"added member\",\"cluster-id\":\"9ac7545a84c4d9df\",\"local-member-id\":\"d3e3bb311dd21802\",\"added-peer-id\":\"d3e3bb311dd21802\",\"added-peer-peer-urls\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.931Z\",\"caller\":\"embed/etcd.go:711\",\"msg\":\"starting with client TLS\",\"tls-info\":\"cert = /rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/clients/server.crt, key = /rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/clients/server.key, trusted-ca = /rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/clients/ca.crt, client-cert-auth = true, crl-file = \",\"cipher-suites\":[]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.932Z\",\"caller\":\"embed/etcd.go:579\",\"msg\":\"serving peer traffic\",\"address\":\"[::]:2381\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:56.932Z\",\"caller\":\"embed/etcd.go:244\",\"msg\":\"now serving peer/client/metrics\",\"local-member-id\":\"d3e3bb311dd21802\",\"initial-advertise-peer-urls\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"listen-peer-urls\":[\"https://0.0.0.0:2381\"],\"advertise-client-urls\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\"],\"listen-client-urls\":[\"https://0.0.0.0:3995\"],\"listen-metrics-urls\":[]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.018Z\",\"caller\":\"raft/raft.go:923\",\"msg\":\"d3e3bb311dd21802 is starting a new election at term 1\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.018Z\",\"caller\":\"raft/raft.go:713\",\"msg\":\"d3e3bb311dd21802 became candidate at term 2\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.018Z\",\"caller\":\"raft/raft.go:824\",\"msg\":\"d3e3bb311dd21802 received MsgVoteResp from d3e3bb311dd21802 at term 2\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.019Z\",\"caller\":\"raft/raft.go:765\",\"msg\":\"d3e3bb311dd21802 became leader at term 2\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.019Z\",\"caller\":\"raft/node.go:325\",\"msg\":\"raft.node: d3e3bb311dd21802 elected leader d3e3bb311dd21802 at term 2\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.019Z\",\"caller\":\"etcdserver/server.go:2528\",\"msg\":\"setting up initial cluster version\",\"cluster-version\":\"3.4\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.020Z\",\"caller\":\"membership/cluster.go:558\",\"msg\":\"set initial cluster version\",\"cluster-id\":\"9ac7545a84c4d9df\",\"local-member-id\":\"d3e3bb311dd21802\",\"cluster-version\":\"3.4\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.020Z\",\"caller\":\"api/capability.go:76\",\"msg\":\"enabled capabilities for version\",\"cluster-version\":\"3.4\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.020Z\",\"caller\":\"etcdserver/server.go:2560\",\"msg\":\"cluster version is updated\",\"cluster-version\":\"3.4\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.020Z\",\"caller\":\"etcdserver/server.go:2037\",\"msg\":\"published local member to cluster through raft\",\"local-member-id\":\"d3e3bb311dd21802\",\"local-member-attributes\":\"{Name:etcd-events-a ClientURLs:[https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995]}\",\"request-path\":\"/0/members/d3e3bb311dd21802/attributes\",\"cluster-id\":\"9ac7545a84c4d9df\",\"publish-timeout\":\"7s\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.021Z\",\"caller\":\"embed/serve.go:191\",\"msg\":\"serving client traffic securely\",\"address\":\"[::]:3995\"}\nI0923 16:30:57.233335    4591 s3fs.go:199] Writing file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:30:57.366579    4591 controller.go:189] starting controller iteration\nI0923 16:30:57.366606    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:30:57.366915    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:30:57.367040    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:30:57.367517    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995]\nI0923 16:30:57.381203    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" quarantined:true > }\nI0923 16:30:57.381338    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:30:57.381367    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:30:57.381627    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:30:57.381643    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:30:57.381720    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:30:57.381889    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:30:57.381919    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:30:57.506233    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:30:57.507549    4591 backup.go:134] performing snapshot save to /tmp/414320169/snapshot.db.gz\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.514Z\",\"caller\":\"clientv3/maintenance.go:200\",\"msg\":\"opened snapshot stream; downloading\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.515Z\",\"caller\":\"v3rpc/maintenance.go:139\",\"msg\":\"sending database snapshot to client\",\"total-bytes\":20480,\"size\":\"20 kB\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.515Z\",\"caller\":\"v3rpc/maintenance.go:177\",\"msg\":\"sending database sha256 checksum to client\",\"total-bytes\":20480,\"checksum-size\":32}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.516Z\",\"caller\":\"v3rpc/maintenance.go:191\",\"msg\":\"successfully sent database snapshot to client\",\"total-bytes\":20480,\"size\":\"20 kB\",\"took\":\"now\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.516Z\",\"caller\":\"clientv3/maintenance.go:208\",\"msg\":\"completed snapshot read; closing\"}\nI0923 16:30:57.517020    4591 s3fs.go:199] Writing file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/2021-09-23T16:30:57Z-000001/etcd.backup.gz\"\nI0923 16:30:57.648391    4591 s3fs.go:199] Writing file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/2021-09-23T16:30:57Z-000001/_etcd_backup.meta\"\nI0923 16:30:57.777954    4591 backup.go:159] backup complete: name:\"2021-09-23T16:30:57Z-000001\" \nI0923 16:30:57.778585    4591 controller.go:937] backup response: name:\"2021-09-23T16:30:57Z-000001\" \nI0923 16:30:57.778731    4591 controller.go:576] took backup: name:\"2021-09-23T16:30:57Z-000001\" \nI0923 16:30:57.911533    4591 vfs.go:118] listed backups in s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events: [2021-09-23T16:30:57Z-000001]\nI0923 16:30:57.911559    4591 cleanup.go:166] retaining backup \"2021-09-23T16:30:57Z-000001\"\nI0923 16:30:57.911583    4591 restore.go:98] Setting quarantined state to false\nI0923 16:30:57.911937    4591 etcdserver.go:393] Reconfigure request: header:<leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" cluster_name:\"etcd-events\" > \nI0923 16:30:57.911981    4591 etcdserver.go:436] Stopping etcd for reconfigure request: header:<leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" cluster_name:\"etcd-events\" > \nI0923 16:30:57.911993    4591 etcdserver.go:640] killing etcd with datadir /rootfs/mnt/master-vol-09f990227e781d9c5/data/1GMjY1jGv9xkxFHdigrSTQ\nI0923 16:30:57.912174    4591 etcdprocess.go:131] Waiting for etcd to exit\nI0923 16:30:58.013121    4591 etcdprocess.go:131] Waiting for etcd to exit\nI0923 16:30:58.013139    4591 etcdprocess.go:136] Exited etcd: signal: killed\nI0923 16:30:58.013391    4591 etcdserver.go:443] updated cluster state: cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" \nI0923 16:30:58.013539    4591 etcdserver.go:448] Starting etcd version \"3.4.13\"\nI0923 16:30:58.013553    4591 etcdserver.go:556] starting etcd with state cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" \nI0923 16:30:58.013590    4591 etcdserver.go:565] starting etcd with datadir /rootfs/mnt/master-vol-09f990227e781d9c5/data/1GMjY1jGv9xkxFHdigrSTQ\nI0923 16:30:58.013673    4591 pki.go:59] adding peerClientIPs [172.20.42.57]\nI0923 16:30:58.013694    4591 pki.go:67] generating peer keypair for etcd: {CommonName:etcd-events-a Organization:[] AltNames:{DNSNames:[etcd-events-a etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io] IPs:[172.20.42.57 127.0.0.1]} Usages:[2 1]}\nI0923 16:30:58.013949    4591 certs.go:122] existing certificate not valid after 2023-09-23T16:30:56Z; will regenerate\nI0923 16:30:58.013965    4591 certs.go:183] generating certificate for \"etcd-events-a\"\nI0923 16:30:58.016044    4591 pki.go:110] building client-serving certificate: {CommonName:etcd-events-a Organization:[] AltNames:{DNSNames:[etcd-events-a etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io] IPs:[127.0.0.1]} Usages:[1 2]}\nI0923 16:30:58.016229    4591 certs.go:122] existing certificate not valid after 2023-09-23T16:30:56Z; will regenerate\nI0923 16:30:58.016242    4591 certs.go:183] generating certificate for \"etcd-events-a\"\nI0923 16:30:58.122272    4591 certs.go:183] generating certificate for \"etcd-events-a\"\nI0923 16:30:58.124192    4591 etcdprocess.go:203] executing command /opt/etcd-v3.4.13-linux-amd64/etcd [/opt/etcd-v3.4.13-linux-amd64/etcd]\nI0923 16:30:58.124659    4591 restore.go:116] ReconfigureResponse: \nI0923 16:30:58.125815    4591 controller.go:189] starting controller iteration\nI0923 16:30:58.125838    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:30:58.126241    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:30:58.126358    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:30:58.126927    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\n2021-09-23 16:30:58.131479 I | pkg/flags: recognized and used environment variable ETCD_ADVERTISE_CLIENT_URLS=https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\n2021-09-23 16:30:58.131517 I | pkg/flags: recognized and used environment variable ETCD_CERT_FILE=/rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/clients/server.crt\n2021-09-23 16:30:58.131524 I | pkg/flags: recognized and used environment variable ETCD_CLIENT_CERT_AUTH=true\n2021-09-23 16:30:58.131535 I | pkg/flags: recognized and used environment variable ETCD_DATA_DIR=/rootfs/mnt/master-vol-09f990227e781d9c5/data/1GMjY1jGv9xkxFHdigrSTQ\n2021-09-23 16:30:58.131546 I | pkg/flags: recognized and used environment variable ETCD_ENABLE_V2=false\n2021-09-23 16:30:58.131570 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_ADVERTISE_PEER_URLS=https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\n2021-09-23 16:30:58.131576 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER=etcd-events-a=https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\n2021-09-23 16:30:58.131584 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER_STATE=existing\n2021-09-23 16:30:58.131591 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER_TOKEN=1GMjY1jGv9xkxFHdigrSTQ\n2021-09-23 16:30:58.131596 I | pkg/flags: recognized and used environment variable ETCD_KEY_FILE=/rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/clients/server.key\n2021-09-23 16:30:58.131604 I | pkg/flags: recognized and used environment variable ETCD_LISTEN_CLIENT_URLS=https://0.0.0.0:4002\n2021-09-23 16:30:58.131613 I | pkg/flags: recognized and used environment variable ETCD_LISTEN_PEER_URLS=https://0.0.0.0:2381\n2021-09-23 16:30:58.131619 I | pkg/flags: recognized and used environment variable ETCD_LOG_OUTPUTS=stdout\n2021-09-23 16:30:58.131627 I | pkg/flags: recognized and used environment variable ETCD_LOGGER=zap\n2021-09-23 16:30:58.131636 I | pkg/flags: recognized and used environment variable ETCD_NAME=etcd-events-a\n2021-09-23 16:30:58.131649 I | pkg/flags: recognized and used environment variable ETCD_PEER_CERT_FILE=/rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/peers/me.crt\n2021-09-23 16:30:58.131654 I | pkg/flags: recognized and used environment variable ETCD_PEER_CLIENT_CERT_AUTH=true\n2021-09-23 16:30:58.131662 I | pkg/flags: recognized and used environment variable ETCD_PEER_KEY_FILE=/rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/peers/me.key\n2021-09-23 16:30:58.131667 I | pkg/flags: recognized and used environment variable ETCD_PEER_TRUSTED_CA_FILE=/rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/peers/ca.crt\n2021-09-23 16:30:58.131681 I | pkg/flags: recognized and used environment variable ETCD_TRUSTED_CA_FILE=/rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/clients/ca.crt\n2021-09-23 16:30:58.131692 W | pkg/flags: unrecognized environment variable ETCD_LISTEN_METRICS_URLS=\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.131Z\",\"caller\":\"etcdmain/etcd.go:134\",\"msg\":\"server has been already initialized\",\"data-dir\":\"/rootfs/mnt/master-vol-09f990227e781d9c5/data/1GMjY1jGv9xkxFHdigrSTQ\",\"dir-type\":\"member\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.131Z\",\"caller\":\"embed/etcd.go:117\",\"msg\":\"configuring peer listeners\",\"listen-peer-urls\":[\"https://0.0.0.0:2381\"]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.131Z\",\"caller\":\"embed/etcd.go:468\",\"msg\":\"starting with peer TLS\",\"tls-info\":\"cert = /rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/peers/me.crt, key = /rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/peers/me.key, trusted-ca = /rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/peers/ca.crt, client-cert-auth = true, crl-file = \",\"cipher-suites\":[]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.132Z\",\"caller\":\"embed/etcd.go:127\",\"msg\":\"configuring client listeners\",\"listen-client-urls\":[\"https://0.0.0.0:4002\"]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.132Z\",\"caller\":\"embed/etcd.go:302\",\"msg\":\"starting an etcd server\",\"etcd-version\":\"3.4.13\",\"git-sha\":\"ae9734ed2\",\"go-version\":\"go1.12.17\",\"go-os\":\"linux\",\"go-arch\":\"amd64\",\"max-cpu-set\":2,\"max-cpu-available\":2,\"member-initialized\":true,\"name\":\"etcd-events-a\",\"data-dir\":\"/rootfs/mnt/master-vol-09f990227e781d9c5/data/1GMjY1jGv9xkxFHdigrSTQ\",\"wal-dir\":\"\",\"wal-dir-dedicated\":\"\",\"member-dir\":\"/rootfs/mnt/master-vol-09f990227e781d9c5/data/1GMjY1jGv9xkxFHdigrSTQ/member\",\"force-new-cluster\":false,\"heartbeat-interval\":\"100ms\",\"election-timeout\":\"1s\",\"initial-election-tick-advance\":true,\"snapshot-count\":100000,\"snapshot-catchup-entries\":5000,\"initial-advertise-peer-urls\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"listen-peer-urls\":[\"https://0.0.0.0:2381\"],\"advertise-client-urls\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"listen-client-urls\":[\"https://0.0.0.0:4002\"],\"listen-metrics-urls\":[],\"cors\":[\"*\"],\"host-whitelist\":[\"*\"],\"initial-cluster\":\"\",\"initial-cluster-state\":\"existing\",\"initial-cluster-token\":\"\",\"quota-size-bytes\":2147483648,\"pre-vote\":false,\"initial-corrupt-check\":false,\"corrupt-check-time-interval\":\"0s\",\"auto-compaction-mode\":\"periodic\",\"auto-compaction-retention\":\"0s\",\"auto-compaction-interval\":\"0s\",\"discovery-url\":\"\",\"discovery-proxy\":\"\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.132Z\",\"caller\":\"etcdserver/backend.go:80\",\"msg\":\"opened backend db\",\"path\":\"/rootfs/mnt/master-vol-09f990227e781d9c5/data/1GMjY1jGv9xkxFHdigrSTQ/member/snap/db\",\"took\":\"131.29µs\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.133Z\",\"caller\":\"etcdserver/raft.go:536\",\"msg\":\"restarting local member\",\"cluster-id\":\"9ac7545a84c4d9df\",\"local-member-id\":\"d3e3bb311dd21802\",\"commit-index\":4}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.133Z\",\"caller\":\"raft/raft.go:1530\",\"msg\":\"d3e3bb311dd21802 switched to configuration voters=()\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.133Z\",\"caller\":\"raft/raft.go:700\",\"msg\":\"d3e3bb311dd21802 became follower at term 2\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.133Z\",\"caller\":\"raft/raft.go:383\",\"msg\":\"newRaft d3e3bb311dd21802 [peers: [], term: 2, commit: 4, applied: 0, lastindex: 4, lastterm: 2]\"}\n{\"level\":\"warn\",\"ts\":\"2021-09-23T16:30:58.134Z\",\"caller\":\"auth/store.go:1366\",\"msg\":\"simple token is not cryptographically signed\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.136Z\",\"caller\":\"etcdserver/quota.go:98\",\"msg\":\"enabled backend quota with default value\",\"quota-name\":\"v3-applier\",\"quota-size-bytes\":2147483648,\"quota-size\":\"2.1 GB\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.137Z\",\"caller\":\"etcdserver/server.go:803\",\"msg\":\"starting etcd server\",\"local-member-id\":\"d3e3bb311dd21802\",\"local-server-version\":\"3.4.13\",\"cluster-version\":\"to_be_decided\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.137Z\",\"caller\":\"etcdserver/server.go:691\",\"msg\":\"starting initial election tick advance\",\"election-ticks\":10}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.138Z\",\"caller\":\"raft/raft.go:1530\",\"msg\":\"d3e3bb311dd21802 switched to configuration voters=(15268252981344212994)\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.138Z\",\"caller\":\"membership/cluster.go:392\",\"msg\":\"added member\",\"cluster-id\":\"9ac7545a84c4d9df\",\"local-member-id\":\"d3e3bb311dd21802\",\"added-peer-id\":\"d3e3bb311dd21802\",\"added-peer-peer-urls\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.138Z\",\"caller\":\"membership/cluster.go:558\",\"msg\":\"set initial cluster version\",\"cluster-id\":\"9ac7545a84c4d9df\",\"local-member-id\":\"d3e3bb311dd21802\",\"cluster-version\":\"3.4\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.138Z\",\"caller\":\"api/capability.go:76\",\"msg\":\"enabled capabilities for version\",\"cluster-version\":\"3.4\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.140Z\",\"caller\":\"embed/etcd.go:711\",\"msg\":\"starting with client TLS\",\"tls-info\":\"cert = /rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/clients/server.crt, key = /rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/clients/server.key, trusted-ca = /rootfs/mnt/master-vol-09f990227e781d9c5/pki/1GMjY1jGv9xkxFHdigrSTQ/clients/ca.crt, client-cert-auth = true, crl-file = \",\"cipher-suites\":[]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.140Z\",\"caller\":\"embed/etcd.go:244\",\"msg\":\"now serving peer/client/metrics\",\"local-member-id\":\"d3e3bb311dd21802\",\"initial-advertise-peer-urls\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"listen-peer-urls\":[\"https://0.0.0.0:2381\"],\"advertise-client-urls\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"listen-client-urls\":[\"https://0.0.0.0:4002\"],\"listen-metrics-urls\":[]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.140Z\",\"caller\":\"embed/etcd.go:579\",\"msg\":\"serving peer traffic\",\"address\":\"[::]:2381\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.634Z\",\"caller\":\"raft/raft.go:923\",\"msg\":\"d3e3bb311dd21802 is starting a new election at term 2\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.634Z\",\"caller\":\"raft/raft.go:713\",\"msg\":\"d3e3bb311dd21802 became candidate at term 3\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.634Z\",\"caller\":\"raft/raft.go:824\",\"msg\":\"d3e3bb311dd21802 received MsgVoteResp from d3e3bb311dd21802 at term 3\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.634Z\",\"caller\":\"raft/raft.go:765\",\"msg\":\"d3e3bb311dd21802 became leader at term 3\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.634Z\",\"caller\":\"raft/node.go:325\",\"msg\":\"raft.node: d3e3bb311dd21802 elected leader d3e3bb311dd21802 at term 3\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.637Z\",\"caller\":\"etcdserver/server.go:2037\",\"msg\":\"published local member to cluster through raft\",\"local-member-id\":\"d3e3bb311dd21802\",\"local-member-attributes\":\"{Name:etcd-events-a ClientURLs:[https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]}\",\"request-path\":\"/0/members/d3e3bb311dd21802/attributes\",\"cluster-id\":\"9ac7545a84c4d9df\",\"publish-timeout\":\"7s\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.638Z\",\"caller\":\"embed/serve.go:191\",\"msg\":\"serving client traffic securely\",\"address\":\"[::]:4002\"}\nI0923 16:30:59.653937    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:30:59.654034    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:30:59.654175    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:30:59.654408    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:30:59.654428    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:30:59.654507    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:30:59.654647    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:30:59.654761    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:30:59.774866    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:30:59.775064    4591 controller.go:557] controller loop complete\nI0923 16:31:09.776921    4591 controller.go:189] starting controller iteration\nI0923 16:31:09.777034    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:31:09.777348    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:31:09.777493    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:31:09.778180    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:31:09.792824    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:31:09.792924    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:31:09.792978    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:31:09.793292    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:09.793309    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:09.793464    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:31:09.793611    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:31:09.793627    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:31:10.254684    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:31:10.254758    4591 controller.go:557] controller loop complete\nI0923 16:31:20.256397    4591 controller.go:189] starting controller iteration\nI0923 16:31:20.256426    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:31:20.257019    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:31:20.257236    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:31:20.257965    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:31:20.269733    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:31:20.269837    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:31:20.269861    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:31:20.270241    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:20.270307    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:20.270407    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:31:20.270556    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:31:20.270576    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:31:20.745447    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:31:20.745587    4591 controller.go:557] controller loop complete\nI0923 16:31:30.747492    4591 controller.go:189] starting controller iteration\nI0923 16:31:30.747593    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:31:30.747953    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:31:30.748096    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:31:30.748638    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:31:30.762877    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:31:30.762967    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:31:30.763063    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:31:30.763392    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:30.763409    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:30.763481    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:31:30.763636    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:31:30.763651    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:31:31.230796    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:31:31.230890    4591 controller.go:557] controller loop complete\nI0923 16:31:41.232423    4591 controller.go:189] starting controller iteration\nI0923 16:31:41.232509    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:31:41.232839    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:31:41.233018    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:31:41.233553    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:31:41.245576    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:31:41.245773    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:31:41.245868    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:31:41.246126    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:41.246144    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:41.246272    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:31:41.246423    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:31:41.246504    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:31:41.700075    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:31:41.700148    4591 controller.go:557] controller loop complete\nI0923 16:31:43.239477    4591 volumes.go:86] AWS API Request: ec2/DescribeVolumes\nI0923 16:31:43.402433    4591 volumes.go:86] AWS API Request: ec2/DescribeInstances\nI0923 16:31:43.459400    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:43.459581    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:31:51.701983    4591 controller.go:189] starting controller iteration\nI0923 16:31:51.702065    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:31:51.702472    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:31:51.702599    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:31:51.703168    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:31:51.715144    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:31:51.715237    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:31:51.715375    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:31:51.715624    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:51.715724    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:51.715853    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:31:51.715993    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:31:51.716007    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:31:52.617137    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:31:52.617205    4591 controller.go:557] controller loop complete\nI0923 16:32:02.619109    4591 controller.go:189] starting controller iteration\nI0923 16:32:02.619138    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:32:02.619541    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:32:02.619745    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:32:02.620540    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:32:02.634873    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:32:02.635203    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:32:02.635231    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:32:02.635569    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:02.635585    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:02.635677    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:32:02.635824    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:32:02.635876    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:32:03.126491    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:32:03.126561    4591 controller.go:557] controller loop complete\nI0923 16:32:13.127753    4591 controller.go:189] starting controller iteration\nI0923 16:32:13.127790    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:32:13.128202    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:32:13.128443    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:32:13.128929    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:32:13.141015    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:32:13.141109    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:32:13.141442    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:32:13.141730    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:13.141748    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:13.141876    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:32:13.142057    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:32:13.142178    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:32:13.600442    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:32:13.600575    4591 controller.go:557] controller loop complete\nI0923 16:32:23.602482    4591 controller.go:189] starting controller iteration\nI0923 16:32:23.602589    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:32:23.602885    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:32:23.603071    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:32:23.603659    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:32:23.615609    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:32:23.616034    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:32:23.616064    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:32:23.616654    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:23.616673    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:23.616739    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:32:23.616957    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:32:23.616975    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:32:24.076764    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:32:24.076848    4591 controller.go:557] controller loop complete\nI0923 16:32:34.078037    4591 controller.go:189] starting controller iteration\nI0923 16:32:34.078066    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:32:34.078461    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:32:34.078621    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:32:34.079094    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:32:34.090671    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:32:34.090761    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:32:34.090781    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:32:34.091179    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:34.091197    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:34.091250    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:32:34.091466    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:32:34.091481    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:32:34.551171    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:32:34.551242    4591 controller.go:557] controller loop complete\nI0923 16:32:43.460320    4591 volumes.go:86] AWS API Request: ec2/DescribeVolumes\nI0923 16:32:43.595303    4591 volumes.go:86] AWS API Request: ec2/DescribeInstances\nI0923 16:32:43.646619    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:43.646801    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:32:44.552806    4591 controller.go:189] starting controller iteration\nI0923 16:32:44.552838    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:32:44.553224    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:32:44.553451    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:32:44.554131    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:32:44.569802    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:32:44.569921    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:32:44.570179    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:32:44.570433    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:44.570451    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:44.570561    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:32:44.570676    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:32:44.570693    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:32:45.024059    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:32:45.024205    4591 controller.go:557] controller loop complete\nI0923 16:32:55.026133    4591 controller.go:189] starting controller iteration\nI0923 16:32:55.026218    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:32:55.026566    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:32:55.026779    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:32:55.027203    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:32:55.038786    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:32:55.038881    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:32:55.038918    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:32:55.039191    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:55.039210    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:55.039333    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:32:55.039461    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:32:55.039476    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:32:55.496971    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:32:55.497215    4591 controller.go:557] controller loop complete\nI0923 16:33:05.498941    4591 controller.go:189] starting controller iteration\nI0923 16:33:05.499106    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:33:05.499394    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:33:05.499573    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:33:05.500219    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:33:05.511620    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:33:05.511723    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:33:05.511755    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:33:05.511931    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:05.511949    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:05.512017    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:33:05.512263    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:33:05.512366    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:33:05.972015    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:33:05.972180    4591 controller.go:557] controller loop complete\nI0923 16:33:15.973418    4591 controller.go:189] starting controller iteration\nI0923 16:33:15.973449    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:33:15.973839    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:33:15.974068    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:33:15.974618    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:33:15.986667    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:33:15.986850    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:33:15.986917    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:33:15.987193    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:15.987209    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:15.987393    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:33:15.987533    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:33:15.987551    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:33:16.445932    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:33:16.446036    4591 controller.go:557] controller loop complete\nI0923 16:33:26.447860    4591 controller.go:189] starting controller iteration\nI0923 16:33:26.447890    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:33:26.448372    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:33:26.448617    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:33:26.449270    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:33:26.467197    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:33:26.467337    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:33:26.467372    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:33:26.467677    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:26.467695    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:26.467763    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:33:26.467936    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:33:26.467953    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:33:26.929753    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:33:26.929846    4591 controller.go:557] controller loop complete\nI0923 16:33:36.934151    4591 controller.go:189] starting controller iteration\nI0923 16:33:36.934243    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:33:36.934585    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:33:36.934721    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:33:36.935112    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:33:36.951203    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:33:36.951288    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:33:36.951306    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:33:36.951489    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:36.951501    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:36.951551    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:33:36.951615    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:33:36.951627    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:33:37.411966    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:33:37.412121    4591 controller.go:557] controller loop complete\nI0923 16:33:43.647956    4591 volumes.go:86] AWS API Request: ec2/DescribeVolumes\nI0923 16:33:43.770193    4591 volumes.go:86] AWS API Request: ec2/DescribeInstances\nI0923 16:33:43.821209    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:43.821366    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:33:47.414021    4591 controller.go:189] starting controller iteration\nI0923 16:33:47.414137    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:33:47.414429    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:33:47.414555    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:33:47.415651    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:33:47.439258    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:33:47.439346    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:33:47.439417    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:33:47.439704    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:47.439722    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:47.439790    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:33:47.439923    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:33:47.439942    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:33:47.889783    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:33:47.889853    4591 controller.go:557] controller loop complete\nI0923 16:33:57.891281    4591 controller.go:189] starting controller iteration\nI0923 16:33:57.891310    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:33:57.891706    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:33:57.891954    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:33:57.892481    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:33:57.904468    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:33:57.904604    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:33:57.904742    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:33:57.905061    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:57.905112    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:57.905216    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:33:57.905346    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:33:57.905448    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:33:58.358394    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:33:58.358554    4591 controller.go:557] controller loop complete\nI0923 16:34:08.360200    4591 controller.go:189] starting controller iteration\nI0923 16:34:08.360229    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:34:08.360498    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:34:08.360678    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:34:08.361662    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:34:08.374577    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:34:08.374657    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:34:08.374679    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:34:08.374873    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:08.374890    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:08.374942    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:34:08.375024    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:34:08.375040    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:34:08.832655    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:34:08.832797    4591 controller.go:557] controller loop complete\nI0923 16:34:18.834457    4591 controller.go:189] starting controller iteration\nI0923 16:34:18.834545    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:34:18.834911    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:34:18.835149    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:34:18.835739    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:34:18.848090    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:34:18.848172    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:34:18.848189    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:34:18.848399    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:18.848413    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:18.848466    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:34:18.848551    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:34:18.848564    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:34:19.309331    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:34:19.309537    4591 controller.go:557] controller loop complete\nI0923 16:34:29.311127    4591 controller.go:189] starting controller iteration\nI0923 16:34:29.311157    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:34:29.311405    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:34:29.311530    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:34:29.312470    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:34:29.325566    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:34:29.325642    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:34:29.325782    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:34:29.325983    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:29.326003    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:29.326071    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:34:29.326288    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:34:29.326304    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:34:29.813405    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:34:29.813475    4591 controller.go:557] controller loop complete\nI0923 16:34:39.814621    4591 controller.go:189] starting controller iteration\nI0923 16:34:39.814652    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:34:39.815001    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:34:39.815187    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:34:39.815603    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:34:39.830013    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:34:39.830128    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:34:39.830281    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:34:39.830529    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:39.830554    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:39.830679    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:34:39.830794    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:34:39.830841    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:34:40.282899    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:34:40.283074    4591 controller.go:557] controller loop complete\nI0923 16:34:43.822121    4591 volumes.go:86] AWS API Request: ec2/DescribeVolumes\nI0923 16:34:43.914247    4591 volumes.go:86] AWS API Request: ec2/DescribeInstances\nI0923 16:34:44.059322    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:44.059459    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:34:50.285086    4591 controller.go:189] starting controller iteration\nI0923 16:34:50.285117    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:34:50.285512    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:34:50.285737    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:34:50.286351    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:34:50.298614    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:34:50.298826    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:34:50.298859    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:34:50.299035    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:50.299052    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:50.299109    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:34:50.299194    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:34:50.299211    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:34:50.753423    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:34:50.753642    4591 controller.go:557] controller loop complete\nI0923 16:35:00.754841    4591 controller.go:189] starting controller iteration\nI0923 16:35:00.754871    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:35:00.755279    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:35:00.755466    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:35:00.756473    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:35:00.769217    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:35:00.769296    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:35:00.769361    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:35:00.769640    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:35:00.769657    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:35:00.769851    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:35:00.769974    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:35:00.769991    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:35:01.221920    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:35:01.222046    4591 controller.go:557] controller loop complete\nI0923 16:35:11.223922    4591 controller.go:189] starting controller iteration\nI0923 16:35:11.223953    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:35:11.224373    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:35:11.224616    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:35:11.225197    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:35:11.238014    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:35:11.238273    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:35:11.238298    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:35:11.238594    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:35:11.238612    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:35:11.238753    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:35:11.238876    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:35:11.238892    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:35:11.681982    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:35:11.682058    4591 controller.go:557] controller loop complete\nI0923 16:35:21.683254    4591 controller.go:189] starting controller iteration\nI0923 16:35:21.683286    4591 controller.go:266] Broadcasting leadership assertion with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:35:21.683671    4591 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > leadership_token:\"d9g4sdGC65vIxxuWzMF5QA\" healthy:<id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" > > \nI0923 16:35:21.683895    4591 controller.go:295] I am leader with token \"d9g4sdGC65vIxxuWzMF5QA\"\nI0923 16:35:21.684834    4591 controller.go:705] base client OK for etcd for client urls [https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002]\nI0923 16:35:21.699365    4591 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-events-a\" endpoints:\"172.20.42.57:3997\" }, info=cluster_name:\"etcd-events\" node_configuration:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" > etcd_state:<cluster:<cluster_token:\"1GMjY1jGv9xkxFHdigrSTQ\" nodes:<name:\"etcd-events-a\" peer_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\" client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\" quarantined_client_urls:\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3995\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:35:21.699558    4591 controller.go:303] etcd cluster members: map[15268252981344212994:{\"name\":\"etcd-events-a\",\"peerURLs\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2381\"],\"endpoints\":[\"https://etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4002\"],\"ID\":\"15268252981344212994\"}]\nI0923 16:35:21.699647    4591 controller.go:641] sending member map to all peers: members:<name:\"etcd-events-a\" dns:\"etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:35:21.699922    4591 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:35:21.699940    4591 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-events-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:35:21.700130    4591 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:35:21.700308    4591 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:35:21.700400    4591 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/events/control/etcd-cluster-created\"\nI0923 16:35:22.173481    4591 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:35:22.173553    4591 controller.go:557] controller loop complete\n==== END logs for container etcd-manager of pod kube-system/etcd-manager-events-ip-172-20-42-57.ap-northeast-1.compute.internal ====\n==== START logs for container etcd-manager of pod kube-system/etcd-manager-main-ip-172-20-42-57.ap-northeast-1.compute.internal ====\netcd-manager\nI0923 16:30:39.358660    4558 volumes.go:86] AWS API Request: ec2metadata/GetToken\nI0923 16:30:39.359479    4558 volumes.go:86] AWS API Request: ec2metadata/GetDynamicData\nI0923 16:30:39.360186    4558 volumes.go:86] AWS API Request: ec2metadata/GetMetadata\nI0923 16:30:39.360722    4558 volumes.go:86] AWS API Request: ec2metadata/GetMetadata\nI0923 16:30:39.361230    4558 volumes.go:86] AWS API Request: ec2metadata/GetMetadata\nI0923 16:30:39.361763    4558 main.go:305] Mounting available etcd volumes matching tags [k8s.io/etcd/main k8s.io/role/master=1 kubernetes.io/cluster/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io=owned]; nameTag=k8s.io/etcd/main\nI0923 16:30:39.363651    4558 volumes.go:86] AWS API Request: ec2/DescribeVolumes\nI0923 16:30:39.544872    4558 mounter.go:304] Trying to mount master volume: \"vol-034df1f7c2ffce916\"\nI0923 16:30:39.544891    4558 volumes.go:331] Trying to attach volume \"vol-034df1f7c2ffce916\" at \"/dev/xvdu\"\nI0923 16:30:39.545019    4558 volumes.go:86] AWS API Request: ec2/AttachVolume\nW0923 16:30:39.887617    4558 volumes.go:343] Invalid value '/dev/xvdu' for unixDevice. Attachment point /dev/xvdu is already in use\nI0923 16:30:39.887632    4558 volumes.go:331] Trying to attach volume \"vol-034df1f7c2ffce916\" at \"/dev/xvdv\"\nI0923 16:30:39.887776    4558 volumes.go:86] AWS API Request: ec2/AttachVolume\nI0923 16:30:40.414337    4558 volumes.go:349] AttachVolume request returned {\n  AttachTime: 2021-09-23 16:30:40.394 +0000 UTC,\n  Device: \"/dev/xvdv\",\n  InstanceId: \"i-0cb466337e23815c6\",\n  State: \"attaching\",\n  VolumeId: \"vol-034df1f7c2ffce916\"\n}\nI0923 16:30:40.414810    4558 volumes.go:86] AWS API Request: ec2/DescribeVolumes\nI0923 16:30:40.563252    4558 mounter.go:318] Currently attached volumes: [0xc0000fbf80]\nI0923 16:30:40.563440    4558 mounter.go:72] Master volume \"vol-034df1f7c2ffce916\" is attached at \"/dev/xvdv\"\nI0923 16:30:40.563559    4558 mounter.go:86] Doing safe-format-and-mount of /dev/xvdv to /mnt/master-vol-034df1f7c2ffce916\nI0923 16:30:40.563646    4558 volumes.go:234] volume vol-034df1f7c2ffce916 not mounted at /rootfs/dev/xvdv\nI0923 16:30:40.564093    4558 volumes.go:263] nvme path not found \"/rootfs/dev/disk/by-id/nvme-Amazon_Elastic_Block_Store_vol034df1f7c2ffce916\"\nI0923 16:30:40.564199    4558 volumes.go:251] volume vol-034df1f7c2ffce916 not mounted at nvme-Amazon_Elastic_Block_Store_vol034df1f7c2ffce916\nI0923 16:30:40.564290    4558 mounter.go:121] Waiting for volume \"vol-034df1f7c2ffce916\" to be mounted\nI0923 16:30:41.564432    4558 mounter.go:125] Found volume \"vol-034df1f7c2ffce916\" mounted at device \"/dev/xvdv\"\nI0923 16:30:41.565071    4558 mounter.go:171] Creating mount directory \"/rootfs/mnt/master-vol-034df1f7c2ffce916\"\nI0923 16:30:41.565128    4558 mounter.go:176] Mounting device \"/dev/xvdv\" on \"/mnt/master-vol-034df1f7c2ffce916\"\nI0923 16:30:41.565142    4558 mount_linux.go:446] Attempting to determine if disk \"/dev/xvdv\" is formatted using blkid with args: ([-p -s TYPE -s PTTYPE -o export /dev/xvdv])\nI0923 16:30:41.565165    4558 nsenter.go:132] Running nsenter command: nsenter [--mount=/rootfs/proc/1/ns/mnt -- blkid -p -s TYPE -s PTTYPE -o export /dev/xvdv]\nI0923 16:30:41.579283    4558 mount_linux.go:449] Output: \"\"\nI0923 16:30:41.579303    4558 mount_linux.go:408] Disk \"/dev/xvdv\" appears to be unformatted, attempting to format as type: \"ext4\" with options: [-F -m0 /dev/xvdv]\nI0923 16:30:41.579336    4558 nsenter.go:132] Running nsenter command: nsenter [--mount=/rootfs/proc/1/ns/mnt -- mkfs.ext4 -F -m0 /dev/xvdv]\nI0923 16:30:41.959537    4558 mount_linux.go:418] Disk successfully formatted (mkfs): ext4 - /dev/xvdv /mnt/master-vol-034df1f7c2ffce916\nI0923 16:30:41.959559    4558 mount_linux.go:436] Attempting to mount disk /dev/xvdv in ext4 format at /mnt/master-vol-034df1f7c2ffce916\nI0923 16:30:41.959574    4558 nsenter.go:80] nsenter mount /dev/xvdv /mnt/master-vol-034df1f7c2ffce916 ext4 [defaults]\nI0923 16:30:41.959615    4558 nsenter.go:132] Running nsenter command: nsenter [--mount=/rootfs/proc/1/ns/mnt -- /bin/systemd-run --description=Kubernetes transient mount for /mnt/master-vol-034df1f7c2ffce916 --scope -- /bin/mount -t ext4 -o defaults /dev/xvdv /mnt/master-vol-034df1f7c2ffce916]\nI0923 16:30:41.986820    4558 nsenter.go:84] Output of mounting /dev/xvdv to /mnt/master-vol-034df1f7c2ffce916: Running scope as unit run-4775.scope.\nI0923 16:30:41.986842    4558 mount_linux.go:446] Attempting to determine if disk \"/dev/xvdv\" is formatted using blkid with args: ([-p -s TYPE -s PTTYPE -o export /dev/xvdv])\nI0923 16:30:41.986865    4558 nsenter.go:132] Running nsenter command: nsenter [--mount=/rootfs/proc/1/ns/mnt -- blkid -p -s TYPE -s PTTYPE -o export /dev/xvdv]\nI0923 16:30:41.995519    4558 mount_linux.go:449] Output: \"DEVNAME=/dev/xvdv\\nTYPE=ext4\\n\"\nI0923 16:30:41.995538    4558 resizefs_linux.go:53] ResizeFS.Resize - Expanding mounted volume /dev/xvdv\nI0923 16:30:41.995549    4558 nsenter.go:132] Running nsenter command: nsenter [--mount=/rootfs/proc/1/ns/mnt -- resize2fs /dev/xvdv]\nI0923 16:30:42.003916    4558 resizefs_linux.go:68] Device /dev/xvdv resized successfully\nI0923 16:30:42.019339    4558 mount_linux.go:202] Cannot run systemd-run, assuming non-systemd OS\nI0923 16:30:42.019373    4558 mount_linux.go:203] systemd-run output: Failed to request invocation ID for scope: Unknown property or interface.\n, failed with: exit status 1\nI0923 16:30:42.028351    4558 mounter.go:224] mounting inside container: /rootfs/dev/xvdv -> /rootfs/mnt/master-vol-034df1f7c2ffce916\nI0923 16:30:42.028521    4558 mount_linux.go:175] Mounting cmd (mount) with arguments ( /rootfs/dev/xvdv /rootfs/mnt/master-vol-034df1f7c2ffce916)\nI0923 16:30:42.032308    4558 mounter.go:94] mounted master volume \"vol-034df1f7c2ffce916\" on /mnt/master-vol-034df1f7c2ffce916\nI0923 16:30:42.032476    4558 main.go:320] discovered IP address: 172.20.42.57\nI0923 16:30:42.032576    4558 main.go:325] Setting data dir to /rootfs/mnt/master-vol-034df1f7c2ffce916\nI0923 16:30:42.295072    4558 certs.go:183] generating certificate for \"etcd-manager-server-etcd-a\"\nI0923 16:30:42.632117    4558 certs.go:183] generating certificate for \"etcd-manager-client-etcd-a\"\nI0923 16:30:42.637873    4558 server.go:87] starting GRPC server using TLS, ServerName=\"etcd-manager-server-etcd-a\"\nI0923 16:30:42.638720    4558 main.go:474] peerClientIPs: [172.20.42.57]\nI0923 16:30:42.892023    4558 certs.go:183] generating certificate for \"etcd-manager-etcd-a\"\nI0923 16:30:42.893925    4558 server.go:105] GRPC server listening on \"172.20.42.57:3996\"\nI0923 16:30:42.894293    4558 volumes.go:86] AWS API Request: ec2/DescribeVolumes\nI0923 16:30:43.031311    4558 volumes.go:86] AWS API Request: ec2/DescribeInstances\nI0923 16:30:43.159250    4558 peers.go:115] found new candidate peer from discovery: etcd-a [{172.20.42.57 0} {172.20.42.57 0}]\nI0923 16:30:43.159289    4558 hosts.go:84] hosts update: primary=map[], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:30:43.159945    4558 peers.go:295] connecting to peer \"etcd-a\" with TLS policy, servername=\"etcd-manager-server-etcd-a\"\nI0923 16:30:44.894905    4558 controller.go:189] starting controller iteration\nI0923 16:30:44.895258    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:30:44.895523    4558 commands.go:41] refreshing commands\nI0923 16:30:44.895688    4558 s3context.go:334] product_uuid is \"ec2b1966-9c15-d1fa-1c29-c51a302d06c1\", assuming running on EC2\nI0923 16:30:44.897189    4558 s3context.go:166] got region from metadata: \"ap-northeast-1\"\nI0923 16:30:44.927897    4558 s3context.go:213] found bucket in region \"us-west-1\"\nI0923 16:30:45.392314    4558 vfs.go:120] listed commands in s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control: 0 commands\nI0923 16:30:45.392337    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-spec\"\nI0923 16:30:55.527512    4558 controller.go:189] starting controller iteration\nI0923 16:30:55.527540    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:30:55.527740    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:30:55.527853    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:30:55.528107    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > }\nI0923 16:30:55.528165    4558 controller.go:303] etcd cluster members: map[]\nI0923 16:30:55.528182    4558 controller.go:641] sending member map to all peers: \nI0923 16:30:55.528371    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:30:55.528388    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:30:55.986198    4558 controller.go:359] detected that there is no existing cluster\nI0923 16:30:55.986252    4558 commands.go:41] refreshing commands\nI0923 16:30:56.180880    4558 vfs.go:120] listed commands in s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control: 0 commands\nI0923 16:30:56.180902    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-spec\"\nI0923 16:30:56.298582    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:30:56.298858    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:30:56.298895    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:30:56.298964    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:30:56.299082    4558 newcluster.go:136] starting new etcd cluster with [etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > }]\nI0923 16:30:56.299459    4558 newcluster.go:153] JoinClusterResponse: \nI0923 16:30:56.300072    4558 etcdserver.go:556] starting etcd with state new_cluster:true cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" quarantined:true \nI0923 16:30:56.300134    4558 etcdserver.go:565] starting etcd with datadir /rootfs/mnt/master-vol-034df1f7c2ffce916/data/rY5EfurKlEvgkbJkSWDksQ\nI0923 16:30:56.300682    4558 pki.go:59] adding peerClientIPs [172.20.42.57]\nI0923 16:30:56.300732    4558 pki.go:67] generating peer keypair for etcd: {CommonName:etcd-a Organization:[] AltNames:{DNSNames:[etcd-a etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io] IPs:[172.20.42.57 127.0.0.1]} Usages:[2 1]}\nI0923 16:30:56.697508    4558 certs.go:183] generating certificate for \"etcd-a\"\nI0923 16:30:56.700664    4558 pki.go:110] building client-serving certificate: {CommonName:etcd-a Organization:[] AltNames:{DNSNames:[etcd-a etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io] IPs:[127.0.0.1]} Usages:[1 2]}\nI0923 16:30:56.875639    4558 certs.go:183] generating certificate for \"etcd-a\"\nI0923 16:30:57.237405    4558 certs.go:183] generating certificate for \"etcd-a\"\nI0923 16:30:57.239618    4558 etcdprocess.go:203] executing command /opt/etcd-v3.4.13-linux-amd64/etcd [/opt/etcd-v3.4.13-linux-amd64/etcd]\nI0923 16:30:57.241810    4558 newcluster.go:171] JoinClusterResponse: \nI0923 16:30:57.241869    4558 s3fs.go:199] Writing file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-spec\"\nI0923 16:30:57.241885    4558 s3context.go:241] Checking default bucket encryption for \"k8s-kops-prow\"\n2021-09-23 16:30:57.247963 I | pkg/flags: recognized and used environment variable ETCD_ADVERTISE_CLIENT_URLS=https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\n2021-09-23 16:30:57.247995 I | pkg/flags: recognized and used environment variable ETCD_CERT_FILE=/rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/clients/server.crt\n2021-09-23 16:30:57.248002 I | pkg/flags: recognized and used environment variable ETCD_CLIENT_CERT_AUTH=true\n2021-09-23 16:30:57.248012 I | pkg/flags: recognized and used environment variable ETCD_DATA_DIR=/rootfs/mnt/master-vol-034df1f7c2ffce916/data/rY5EfurKlEvgkbJkSWDksQ\n2021-09-23 16:30:57.248023 I | pkg/flags: recognized and used environment variable ETCD_ENABLE_V2=false\n2021-09-23 16:30:57.248048 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_ADVERTISE_PEER_URLS=https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\n2021-09-23 16:30:57.248056 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER=etcd-a=https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\n2021-09-23 16:30:57.248060 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER_STATE=new\n2021-09-23 16:30:57.248066 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER_TOKEN=rY5EfurKlEvgkbJkSWDksQ\n2021-09-23 16:30:57.248072 I | pkg/flags: recognized and used environment variable ETCD_KEY_FILE=/rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/clients/server.key\n2021-09-23 16:30:57.248080 I | pkg/flags: recognized and used environment variable ETCD_LISTEN_CLIENT_URLS=https://0.0.0.0:3994\n2021-09-23 16:30:57.248089 I | pkg/flags: recognized and used environment variable ETCD_LISTEN_PEER_URLS=https://0.0.0.0:2380\n2021-09-23 16:30:57.248097 I | pkg/flags: recognized and used environment variable ETCD_LOG_OUTPUTS=stdout\n2021-09-23 16:30:57.248104 I | pkg/flags: recognized and used environment variable ETCD_LOGGER=zap\n2021-09-23 16:30:57.248120 I | pkg/flags: recognized and used environment variable ETCD_NAME=etcd-a\n2021-09-23 16:30:57.248128 I | pkg/flags: recognized and used environment variable ETCD_PEER_CERT_FILE=/rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/peers/me.crt\n2021-09-23 16:30:57.248133 I | pkg/flags: recognized and used environment variable ETCD_PEER_CLIENT_CERT_AUTH=true\n2021-09-23 16:30:57.248141 I | pkg/flags: recognized and used environment variable ETCD_PEER_KEY_FILE=/rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/peers/me.key\n2021-09-23 16:30:57.248149 I | pkg/flags: recognized and used environment variable ETCD_PEER_TRUSTED_CA_FILE=/rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/peers/ca.crt\n2021-09-23 16:30:57.248164 I | pkg/flags: recognized and used environment variable ETCD_TRUSTED_CA_FILE=/rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/clients/ca.crt\n2021-09-23 16:30:57.248178 W | pkg/flags: unrecognized environment variable ETCD_LISTEN_METRICS_URLS=\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.248Z\",\"caller\":\"embed/etcd.go:117\",\"msg\":\"configuring peer listeners\",\"listen-peer-urls\":[\"https://0.0.0.0:2380\"]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.248Z\",\"caller\":\"embed/etcd.go:468\",\"msg\":\"starting with peer TLS\",\"tls-info\":\"cert = /rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/peers/me.crt, key = /rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/peers/me.key, trusted-ca = /rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/peers/ca.crt, client-cert-auth = true, crl-file = \",\"cipher-suites\":[]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.248Z\",\"caller\":\"embed/etcd.go:127\",\"msg\":\"configuring client listeners\",\"listen-client-urls\":[\"https://0.0.0.0:3994\"]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.248Z\",\"caller\":\"embed/etcd.go:302\",\"msg\":\"starting an etcd server\",\"etcd-version\":\"3.4.13\",\"git-sha\":\"ae9734ed2\",\"go-version\":\"go1.12.17\",\"go-os\":\"linux\",\"go-arch\":\"amd64\",\"max-cpu-set\":2,\"max-cpu-available\":2,\"member-initialized\":false,\"name\":\"etcd-a\",\"data-dir\":\"/rootfs/mnt/master-vol-034df1f7c2ffce916/data/rY5EfurKlEvgkbJkSWDksQ\",\"wal-dir\":\"\",\"wal-dir-dedicated\":\"\",\"member-dir\":\"/rootfs/mnt/master-vol-034df1f7c2ffce916/data/rY5EfurKlEvgkbJkSWDksQ/member\",\"force-new-cluster\":false,\"heartbeat-interval\":\"100ms\",\"election-timeout\":\"1s\",\"initial-election-tick-advance\":true,\"snapshot-count\":100000,\"snapshot-catchup-entries\":5000,\"initial-advertise-peer-urls\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"listen-peer-urls\":[\"https://0.0.0.0:2380\"],\"advertise-client-urls\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\"],\"listen-client-urls\":[\"https://0.0.0.0:3994\"],\"listen-metrics-urls\":[],\"cors\":[\"*\"],\"host-whitelist\":[\"*\"],\"initial-cluster\":\"etcd-a=https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\",\"initial-cluster-state\":\"new\",\"initial-cluster-token\":\"rY5EfurKlEvgkbJkSWDksQ\",\"quota-size-bytes\":2147483648,\"pre-vote\":false,\"initial-corrupt-check\":false,\"corrupt-check-time-interval\":\"0s\",\"auto-compaction-mode\":\"periodic\",\"auto-compaction-retention\":\"0s\",\"auto-compaction-interval\":\"0s\",\"discovery-url\":\"\",\"discovery-proxy\":\"\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.252Z\",\"caller\":\"etcdserver/backend.go:80\",\"msg\":\"opened backend db\",\"path\":\"/rootfs/mnt/master-vol-034df1f7c2ffce916/data/rY5EfurKlEvgkbJkSWDksQ/member/snap/db\",\"took\":\"3.096446ms\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.252Z\",\"caller\":\"netutil/netutil.go:112\",\"msg\":\"resolved URL Host\",\"url\":\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\",\"host\":\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\",\"resolved-addr\":\"172.20.42.57:2380\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.252Z\",\"caller\":\"netutil/netutil.go:112\",\"msg\":\"resolved URL Host\",\"url\":\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\",\"host\":\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\",\"resolved-addr\":\"172.20.42.57:2380\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.257Z\",\"caller\":\"etcdserver/raft.go:486\",\"msg\":\"starting local member\",\"local-member-id\":\"6233f5351f303ed\",\"cluster-id\":\"1d360b954d5157c8\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.258Z\",\"caller\":\"raft/raft.go:1530\",\"msg\":\"6233f5351f303ed switched to configuration voters=()\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.258Z\",\"caller\":\"raft/raft.go:700\",\"msg\":\"6233f5351f303ed became follower at term 0\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.258Z\",\"caller\":\"raft/raft.go:383\",\"msg\":\"newRaft 6233f5351f303ed [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.258Z\",\"caller\":\"raft/raft.go:700\",\"msg\":\"6233f5351f303ed became follower at term 1\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.258Z\",\"caller\":\"raft/raft.go:1530\",\"msg\":\"6233f5351f303ed switched to configuration voters=(442266815502156781)\"}\n{\"level\":\"warn\",\"ts\":\"2021-09-23T16:30:57.260Z\",\"caller\":\"auth/store.go:1366\",\"msg\":\"simple token is not cryptographically signed\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.263Z\",\"caller\":\"etcdserver/quota.go:98\",\"msg\":\"enabled backend quota with default value\",\"quota-name\":\"v3-applier\",\"quota-size-bytes\":2147483648,\"quota-size\":\"2.1 GB\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.265Z\",\"caller\":\"etcdserver/server.go:803\",\"msg\":\"starting etcd server\",\"local-member-id\":\"6233f5351f303ed\",\"local-server-version\":\"3.4.13\",\"cluster-version\":\"to_be_decided\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.266Z\",\"caller\":\"etcdserver/server.go:669\",\"msg\":\"started as single-node; fast-forwarding election ticks\",\"local-member-id\":\"6233f5351f303ed\",\"forward-ticks\":9,\"forward-duration\":\"900ms\",\"election-ticks\":10,\"election-timeout\":\"1s\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.267Z\",\"caller\":\"raft/raft.go:1530\",\"msg\":\"6233f5351f303ed switched to configuration voters=(442266815502156781)\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.267Z\",\"caller\":\"embed/etcd.go:711\",\"msg\":\"starting with client TLS\",\"tls-info\":\"cert = /rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/clients/server.crt, key = /rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/clients/server.key, trusted-ca = /rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/clients/ca.crt, client-cert-auth = true, crl-file = \",\"cipher-suites\":[]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.267Z\",\"caller\":\"membership/cluster.go:392\",\"msg\":\"added member\",\"cluster-id\":\"1d360b954d5157c8\",\"local-member-id\":\"6233f5351f303ed\",\"added-peer-id\":\"6233f5351f303ed\",\"added-peer-peer-urls\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.267Z\",\"caller\":\"embed/etcd.go:244\",\"msg\":\"now serving peer/client/metrics\",\"local-member-id\":\"6233f5351f303ed\",\"initial-advertise-peer-urls\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"listen-peer-urls\":[\"https://0.0.0.0:2380\"],\"advertise-client-urls\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\"],\"listen-client-urls\":[\"https://0.0.0.0:3994\"],\"listen-metrics-urls\":[]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:57.267Z\",\"caller\":\"embed/etcd.go:579\",\"msg\":\"serving peer traffic\",\"address\":\"[::]:2380\"}\nI0923 16:30:57.481684    4558 s3fs.go:199] Writing file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:30:57.620372    4558 controller.go:189] starting controller iteration\nI0923 16:30:57.620398    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:30:57.620762    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:30:57.620939    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:30:57.621686    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994]\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.258Z\",\"caller\":\"raft/raft.go:923\",\"msg\":\"6233f5351f303ed is starting a new election at term 1\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.258Z\",\"caller\":\"raft/raft.go:713\",\"msg\":\"6233f5351f303ed became candidate at term 2\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.258Z\",\"caller\":\"raft/raft.go:824\",\"msg\":\"6233f5351f303ed received MsgVoteResp from 6233f5351f303ed at term 2\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.258Z\",\"caller\":\"raft/raft.go:765\",\"msg\":\"6233f5351f303ed became leader at term 2\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.258Z\",\"caller\":\"raft/node.go:325\",\"msg\":\"raft.node: 6233f5351f303ed elected leader 6233f5351f303ed at term 2\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.258Z\",\"caller\":\"etcdserver/server.go:2528\",\"msg\":\"setting up initial cluster version\",\"cluster-version\":\"3.4\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.259Z\",\"caller\":\"membership/cluster.go:558\",\"msg\":\"set initial cluster version\",\"cluster-id\":\"1d360b954d5157c8\",\"local-member-id\":\"6233f5351f303ed\",\"cluster-version\":\"3.4\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.259Z\",\"caller\":\"api/capability.go:76\",\"msg\":\"enabled capabilities for version\",\"cluster-version\":\"3.4\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.259Z\",\"caller\":\"etcdserver/server.go:2560\",\"msg\":\"cluster version is updated\",\"cluster-version\":\"3.4\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.259Z\",\"caller\":\"etcdserver/server.go:2037\",\"msg\":\"published local member to cluster through raft\",\"local-member-id\":\"6233f5351f303ed\",\"local-member-attributes\":\"{Name:etcd-a ClientURLs:[https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994]}\",\"request-path\":\"/0/members/6233f5351f303ed/attributes\",\"cluster-id\":\"1d360b954d5157c8\",\"publish-timeout\":\"7s\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.260Z\",\"caller\":\"embed/serve.go:191\",\"msg\":\"serving client traffic securely\",\"address\":\"[::]:3994\"}\nI0923 16:30:58.277544    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" quarantined:true > }\nI0923 16:30:58.277667    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\"],\"ID\":\"442266815502156781\"}]\nI0923 16:30:58.277742    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:30:58.278024    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:30:58.278068    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:30:58.278154    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:30:58.278312    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:30:58.278343    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:30:58.433037    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:30:58.433714    4558 backup.go:134] performing snapshot save to /tmp/600443827/snapshot.db.gz\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.439Z\",\"caller\":\"clientv3/maintenance.go:200\",\"msg\":\"opened snapshot stream; downloading\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.439Z\",\"caller\":\"v3rpc/maintenance.go:139\",\"msg\":\"sending database snapshot to client\",\"total-bytes\":20480,\"size\":\"20 kB\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.439Z\",\"caller\":\"v3rpc/maintenance.go:177\",\"msg\":\"sending database sha256 checksum to client\",\"total-bytes\":20480,\"checksum-size\":32}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.440Z\",\"caller\":\"v3rpc/maintenance.go:191\",\"msg\":\"successfully sent database snapshot to client\",\"total-bytes\":20480,\"size\":\"20 kB\",\"took\":\"now\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:58.443Z\",\"caller\":\"clientv3/maintenance.go:208\",\"msg\":\"completed snapshot read; closing\"}\nI0923 16:30:58.444369    4558 s3fs.go:199] Writing file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/2021-09-23T16:30:58Z-000001/etcd.backup.gz\"\nI0923 16:30:58.633555    4558 s3fs.go:199] Writing file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/2021-09-23T16:30:58Z-000001/_etcd_backup.meta\"\nI0923 16:30:58.779505    4558 backup.go:159] backup complete: name:\"2021-09-23T16:30:58Z-000001\" \nI0923 16:30:58.780049    4558 controller.go:937] backup response: name:\"2021-09-23T16:30:58Z-000001\" \nI0923 16:30:58.780068    4558 controller.go:576] took backup: name:\"2021-09-23T16:30:58Z-000001\" \nI0923 16:30:58.907611    4558 vfs.go:118] listed backups in s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main: [2021-09-23T16:30:58Z-000001]\nI0923 16:30:58.907636    4558 cleanup.go:166] retaining backup \"2021-09-23T16:30:58Z-000001\"\nI0923 16:30:58.907661    4558 restore.go:98] Setting quarantined state to false\nI0923 16:30:58.907936    4558 etcdserver.go:393] Reconfigure request: header:<leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" cluster_name:\"etcd\" > \nI0923 16:30:58.907984    4558 etcdserver.go:436] Stopping etcd for reconfigure request: header:<leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" cluster_name:\"etcd\" > \nI0923 16:30:58.907996    4558 etcdserver.go:640] killing etcd with datadir /rootfs/mnt/master-vol-034df1f7c2ffce916/data/rY5EfurKlEvgkbJkSWDksQ\nI0923 16:30:58.908148    4558 etcdprocess.go:131] Waiting for etcd to exit\nI0923 16:30:59.008319    4558 etcdprocess.go:131] Waiting for etcd to exit\nI0923 16:30:59.008337    4558 etcdprocess.go:136] Exited etcd: signal: killed\nI0923 16:30:59.008528    4558 etcdserver.go:443] updated cluster state: cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" \nI0923 16:30:59.008699    4558 etcdserver.go:448] Starting etcd version \"3.4.13\"\nI0923 16:30:59.008713    4558 etcdserver.go:556] starting etcd with state cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" \nI0923 16:30:59.008752    4558 etcdserver.go:565] starting etcd with datadir /rootfs/mnt/master-vol-034df1f7c2ffce916/data/rY5EfurKlEvgkbJkSWDksQ\nI0923 16:30:59.008873    4558 pki.go:59] adding peerClientIPs [172.20.42.57]\nI0923 16:30:59.008894    4558 pki.go:67] generating peer keypair for etcd: {CommonName:etcd-a Organization:[] AltNames:{DNSNames:[etcd-a etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io] IPs:[172.20.42.57 127.0.0.1]} Usages:[2 1]}\nI0923 16:30:59.009218    4558 certs.go:122] existing certificate not valid after 2023-09-23T16:30:56Z; will regenerate\nI0923 16:30:59.009238    4558 certs.go:183] generating certificate for \"etcd-a\"\nI0923 16:30:59.011362    4558 pki.go:110] building client-serving certificate: {CommonName:etcd-a Organization:[] AltNames:{DNSNames:[etcd-a etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io] IPs:[127.0.0.1]} Usages:[1 2]}\nI0923 16:30:59.011549    4558 certs.go:122] existing certificate not valid after 2023-09-23T16:30:56Z; will regenerate\nI0923 16:30:59.011562    4558 certs.go:183] generating certificate for \"etcd-a\"\nI0923 16:30:59.436870    4558 certs.go:183] generating certificate for \"etcd-a\"\nI0923 16:30:59.438764    4558 etcdprocess.go:203] executing command /opt/etcd-v3.4.13-linux-amd64/etcd [/opt/etcd-v3.4.13-linux-amd64/etcd]\nI0923 16:30:59.439909    4558 restore.go:116] ReconfigureResponse: \nI0923 16:30:59.441063    4558 controller.go:189] starting controller iteration\nI0923 16:30:59.441084    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:30:59.441312    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:30:59.441433    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:30:59.441949    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\n2021-09-23 16:30:59.446156 I | pkg/flags: recognized and used environment variable ETCD_ADVERTISE_CLIENT_URLS=https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\n2021-09-23 16:30:59.446186 I | pkg/flags: recognized and used environment variable ETCD_CERT_FILE=/rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/clients/server.crt\n2021-09-23 16:30:59.446291 I | pkg/flags: recognized and used environment variable ETCD_CLIENT_CERT_AUTH=true\n2021-09-23 16:30:59.446302 I | pkg/flags: recognized and used environment variable ETCD_DATA_DIR=/rootfs/mnt/master-vol-034df1f7c2ffce916/data/rY5EfurKlEvgkbJkSWDksQ\n2021-09-23 16:30:59.446383 I | pkg/flags: recognized and used environment variable ETCD_ENABLE_V2=false\n2021-09-23 16:30:59.446408 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_ADVERTISE_PEER_URLS=https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\n2021-09-23 16:30:59.446414 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER=etcd-a=https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\n2021-09-23 16:30:59.446470 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER_STATE=existing\n2021-09-23 16:30:59.446488 I | pkg/flags: recognized and used environment variable ETCD_INITIAL_CLUSTER_TOKEN=rY5EfurKlEvgkbJkSWDksQ\n2021-09-23 16:30:59.446517 I | pkg/flags: recognized and used environment variable ETCD_KEY_FILE=/rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/clients/server.key\n2021-09-23 16:30:59.446526 I | pkg/flags: recognized and used environment variable ETCD_LISTEN_CLIENT_URLS=https://0.0.0.0:4001\n2021-09-23 16:30:59.446534 I | pkg/flags: recognized and used environment variable ETCD_LISTEN_PEER_URLS=https://0.0.0.0:2380\n2021-09-23 16:30:59.446541 I | pkg/flags: recognized and used environment variable ETCD_LOG_OUTPUTS=stdout\n2021-09-23 16:30:59.446550 I | pkg/flags: recognized and used environment variable ETCD_LOGGER=zap\n2021-09-23 16:30:59.446558 I | pkg/flags: recognized and used environment variable ETCD_NAME=etcd-a\n2021-09-23 16:30:59.446567 I | pkg/flags: recognized and used environment variable ETCD_PEER_CERT_FILE=/rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/peers/me.crt\n2021-09-23 16:30:59.446608 I | pkg/flags: recognized and used environment variable ETCD_PEER_CLIENT_CERT_AUTH=true\n2021-09-23 16:30:59.446618 I | pkg/flags: recognized and used environment variable ETCD_PEER_KEY_FILE=/rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/peers/me.key\n2021-09-23 16:30:59.446631 I | pkg/flags: recognized and used environment variable ETCD_PEER_TRUSTED_CA_FILE=/rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/peers/ca.crt\n2021-09-23 16:30:59.446659 I | pkg/flags: recognized and used environment variable ETCD_TRUSTED_CA_FILE=/rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/clients/ca.crt\n2021-09-23 16:30:59.446672 W | pkg/flags: unrecognized environment variable ETCD_LISTEN_METRICS_URLS=\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.446Z\",\"caller\":\"etcdmain/etcd.go:134\",\"msg\":\"server has been already initialized\",\"data-dir\":\"/rootfs/mnt/master-vol-034df1f7c2ffce916/data/rY5EfurKlEvgkbJkSWDksQ\",\"dir-type\":\"member\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.446Z\",\"caller\":\"embed/etcd.go:117\",\"msg\":\"configuring peer listeners\",\"listen-peer-urls\":[\"https://0.0.0.0:2380\"]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.446Z\",\"caller\":\"embed/etcd.go:468\",\"msg\":\"starting with peer TLS\",\"tls-info\":\"cert = /rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/peers/me.crt, key = /rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/peers/me.key, trusted-ca = /rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/peers/ca.crt, client-cert-auth = true, crl-file = \",\"cipher-suites\":[]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.447Z\",\"caller\":\"embed/etcd.go:127\",\"msg\":\"configuring client listeners\",\"listen-client-urls\":[\"https://0.0.0.0:4001\"]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.447Z\",\"caller\":\"embed/etcd.go:302\",\"msg\":\"starting an etcd server\",\"etcd-version\":\"3.4.13\",\"git-sha\":\"ae9734ed2\",\"go-version\":\"go1.12.17\",\"go-os\":\"linux\",\"go-arch\":\"amd64\",\"max-cpu-set\":2,\"max-cpu-available\":2,\"member-initialized\":true,\"name\":\"etcd-a\",\"data-dir\":\"/rootfs/mnt/master-vol-034df1f7c2ffce916/data/rY5EfurKlEvgkbJkSWDksQ\",\"wal-dir\":\"\",\"wal-dir-dedicated\":\"\",\"member-dir\":\"/rootfs/mnt/master-vol-034df1f7c2ffce916/data/rY5EfurKlEvgkbJkSWDksQ/member\",\"force-new-cluster\":false,\"heartbeat-interval\":\"100ms\",\"election-timeout\":\"1s\",\"initial-election-tick-advance\":true,\"snapshot-count\":100000,\"snapshot-catchup-entries\":5000,\"initial-advertise-peer-urls\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"listen-peer-urls\":[\"https://0.0.0.0:2380\"],\"advertise-client-urls\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"listen-client-urls\":[\"https://0.0.0.0:4001\"],\"listen-metrics-urls\":[],\"cors\":[\"*\"],\"host-whitelist\":[\"*\"],\"initial-cluster\":\"\",\"initial-cluster-state\":\"existing\",\"initial-cluster-token\":\"\",\"quota-size-bytes\":2147483648,\"pre-vote\":false,\"initial-corrupt-check\":false,\"corrupt-check-time-interval\":\"0s\",\"auto-compaction-mode\":\"periodic\",\"auto-compaction-retention\":\"0s\",\"auto-compaction-interval\":\"0s\",\"discovery-url\":\"\",\"discovery-proxy\":\"\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.447Z\",\"caller\":\"etcdserver/backend.go:80\",\"msg\":\"opened backend db\",\"path\":\"/rootfs/mnt/master-vol-034df1f7c2ffce916/data/rY5EfurKlEvgkbJkSWDksQ/member/snap/db\",\"took\":\"101.663µs\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.448Z\",\"caller\":\"etcdserver/raft.go:536\",\"msg\":\"restarting local member\",\"cluster-id\":\"1d360b954d5157c8\",\"local-member-id\":\"6233f5351f303ed\",\"commit-index\":4}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.449Z\",\"caller\":\"raft/raft.go:1530\",\"msg\":\"6233f5351f303ed switched to configuration voters=()\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.449Z\",\"caller\":\"raft/raft.go:700\",\"msg\":\"6233f5351f303ed became follower at term 2\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.449Z\",\"caller\":\"raft/raft.go:383\",\"msg\":\"newRaft 6233f5351f303ed [peers: [], term: 2, commit: 4, applied: 0, lastindex: 4, lastterm: 2]\"}\n{\"level\":\"warn\",\"ts\":\"2021-09-23T16:30:59.450Z\",\"caller\":\"auth/store.go:1366\",\"msg\":\"simple token is not cryptographically signed\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.452Z\",\"caller\":\"etcdserver/quota.go:98\",\"msg\":\"enabled backend quota with default value\",\"quota-name\":\"v3-applier\",\"quota-size-bytes\":2147483648,\"quota-size\":\"2.1 GB\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.453Z\",\"caller\":\"etcdserver/server.go:803\",\"msg\":\"starting etcd server\",\"local-member-id\":\"6233f5351f303ed\",\"local-server-version\":\"3.4.13\",\"cluster-version\":\"to_be_decided\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.454Z\",\"caller\":\"etcdserver/server.go:691\",\"msg\":\"starting initial election tick advance\",\"election-ticks\":10}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.455Z\",\"caller\":\"raft/raft.go:1530\",\"msg\":\"6233f5351f303ed switched to configuration voters=(442266815502156781)\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.455Z\",\"caller\":\"membership/cluster.go:392\",\"msg\":\"added member\",\"cluster-id\":\"1d360b954d5157c8\",\"local-member-id\":\"6233f5351f303ed\",\"added-peer-id\":\"6233f5351f303ed\",\"added-peer-peer-urls\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.455Z\",\"caller\":\"membership/cluster.go:558\",\"msg\":\"set initial cluster version\",\"cluster-id\":\"1d360b954d5157c8\",\"local-member-id\":\"6233f5351f303ed\",\"cluster-version\":\"3.4\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.455Z\",\"caller\":\"api/capability.go:76\",\"msg\":\"enabled capabilities for version\",\"cluster-version\":\"3.4\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.456Z\",\"caller\":\"embed/etcd.go:711\",\"msg\":\"starting with client TLS\",\"tls-info\":\"cert = /rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/clients/server.crt, key = /rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/clients/server.key, trusted-ca = /rootfs/mnt/master-vol-034df1f7c2ffce916/pki/rY5EfurKlEvgkbJkSWDksQ/clients/ca.crt, client-cert-auth = true, crl-file = \",\"cipher-suites\":[]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.456Z\",\"caller\":\"embed/etcd.go:244\",\"msg\":\"now serving peer/client/metrics\",\"local-member-id\":\"6233f5351f303ed\",\"initial-advertise-peer-urls\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"listen-peer-urls\":[\"https://0.0.0.0:2380\"],\"advertise-client-urls\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"listen-client-urls\":[\"https://0.0.0.0:4001\"],\"listen-metrics-urls\":[]}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:30:59.456Z\",\"caller\":\"embed/etcd.go:579\",\"msg\":\"serving peer traffic\",\"address\":\"[::]:2380\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:31:01.249Z\",\"caller\":\"raft/raft.go:923\",\"msg\":\"6233f5351f303ed is starting a new election at term 2\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:31:01.249Z\",\"caller\":\"raft/raft.go:713\",\"msg\":\"6233f5351f303ed became candidate at term 3\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:31:01.249Z\",\"caller\":\"raft/raft.go:824\",\"msg\":\"6233f5351f303ed received MsgVoteResp from 6233f5351f303ed at term 3\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:31:01.249Z\",\"caller\":\"raft/raft.go:765\",\"msg\":\"6233f5351f303ed became leader at term 3\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:31:01.250Z\",\"caller\":\"raft/node.go:325\",\"msg\":\"raft.node: 6233f5351f303ed elected leader 6233f5351f303ed at term 3\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:31:01.252Z\",\"caller\":\"etcdserver/server.go:2037\",\"msg\":\"published local member to cluster through raft\",\"local-member-id\":\"6233f5351f303ed\",\"local-member-attributes\":\"{Name:etcd-a ClientURLs:[https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]}\",\"request-path\":\"/0/members/6233f5351f303ed/attributes\",\"cluster-id\":\"1d360b954d5157c8\",\"publish-timeout\":\"7s\"}\n{\"level\":\"info\",\"ts\":\"2021-09-23T16:31:01.253Z\",\"caller\":\"embed/serve.go:191\",\"msg\":\"serving client traffic securely\",\"address\":\"[::]:4001\"}\nI0923 16:31:01.275390    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:31:01.275540    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:31:01.275582    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:31:01.275780    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:01.275795    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:01.275851    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:31:01.275947    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:31:01.275960    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:31:01.399152    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:31:01.399223    4558 controller.go:557] controller loop complete\nI0923 16:31:11.402334    4558 controller.go:189] starting controller iteration\nI0923 16:31:11.402433    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:31:11.402734    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:31:11.402864    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:31:11.403498    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:31:11.415614    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:31:11.415694    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:31:11.415711    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:31:11.416000    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:11.416092    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:11.416213    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:31:11.416348    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:31:11.416365    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:31:11.869340    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:31:11.869412    4558 controller.go:557] controller loop complete\nI0923 16:31:21.871104    4558 controller.go:189] starting controller iteration\nI0923 16:31:21.871132    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:31:21.871474    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:31:21.871598    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:31:21.872286    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:31:21.891376    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:31:21.891586    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:31:21.891617    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:31:21.891912    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:21.891930    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:21.891980    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:31:21.892156    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:31:21.892173    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:31:22.362040    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:31:22.362183    4558 controller.go:557] controller loop complete\nI0923 16:31:32.364249    4558 controller.go:189] starting controller iteration\nI0923 16:31:32.364341    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:31:32.364711    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:31:32.365035    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:31:32.365673    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:31:32.377561    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:31:32.377668    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:31:32.377888    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:31:32.378142    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:32.378197    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:32.378306    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:31:32.378471    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:31:32.378488    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:31:32.831043    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:31:32.831244    4558 controller.go:557] controller loop complete\nI0923 16:31:42.833176    4558 controller.go:189] starting controller iteration\nI0923 16:31:42.833263    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:31:42.833596    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:31:42.833791    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:31:42.834568    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:31:42.849272    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:31:42.849620    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:31:42.849677    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:31:42.850022    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:42.850039    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:42.850187    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:31:42.850338    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:31:42.850355    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:31:43.163325    4558 volumes.go:86] AWS API Request: ec2/DescribeVolumes\nI0923 16:31:43.309528    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:31:43.309604    4558 controller.go:557] controller loop complete\nI0923 16:31:43.376108    4558 volumes.go:86] AWS API Request: ec2/DescribeInstances\nI0923 16:31:43.441954    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:43.442032    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:31:53.311273    4558 controller.go:189] starting controller iteration\nI0923 16:31:53.311303    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:31:53.311706    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:31:53.311884    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:31:53.312280    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:31:53.325722    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:31:53.325816    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:31:53.325834    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:31:53.326138    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:53.326159    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:31:53.326312    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:31:53.326397    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:31:53.326408    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:31:53.812758    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:31:53.812896    4558 controller.go:557] controller loop complete\nI0923 16:32:03.815057    4558 controller.go:189] starting controller iteration\nI0923 16:32:03.815087    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:32:03.815480    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:32:03.815696    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:32:03.816359    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:32:03.830244    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:32:03.830348    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:32:03.830368    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:32:03.830734    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:03.830751    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:03.830895    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:32:03.831024    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:32:03.831040    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:32:04.294079    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:32:04.294174    4558 controller.go:557] controller loop complete\nI0923 16:32:14.296322    4558 controller.go:189] starting controller iteration\nI0923 16:32:14.296413    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:32:14.296750    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:32:14.296972    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:32:14.297543    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:32:14.309785    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:32:14.310018    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:32:14.310063    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:32:14.310325    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:14.310343    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:14.310384    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:32:14.310606    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:32:14.310681    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:32:14.776905    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:32:14.777116    4558 controller.go:557] controller loop complete\nI0923 16:32:24.778400    4558 controller.go:189] starting controller iteration\nI0923 16:32:24.778431    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:32:24.778862    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:32:24.779057    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:32:24.779632    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:32:24.793629    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:32:24.793780    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:32:24.793858    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:32:24.794093    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:24.794131    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:24.794272    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:32:24.794392    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:32:24.794417    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:32:25.254340    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:32:25.254411    4558 controller.go:557] controller loop complete\nI0923 16:32:35.255801    4558 controller.go:189] starting controller iteration\nI0923 16:32:35.255832    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:32:35.256198    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:32:35.256367    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:32:35.256734    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:32:35.269109    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:32:35.269200    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:32:35.269341    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:32:35.269604    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:35.269620    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:35.269699    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:32:35.269811    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:32:35.269873    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:32:35.728651    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:32:35.728831    4558 controller.go:557] controller loop complete\nI0923 16:32:43.442701    4558 volumes.go:86] AWS API Request: ec2/DescribeVolumes\nI0923 16:32:43.579768    4558 volumes.go:86] AWS API Request: ec2/DescribeInstances\nI0923 16:32:43.635021    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:43.635268    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:32:45.730890    4558 controller.go:189] starting controller iteration\nI0923 16:32:45.730921    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:32:45.731334    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:32:45.731464    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:32:45.732245    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:32:45.746696    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:32:45.746791    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:32:45.746810    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:32:45.747073    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:45.747104    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:45.747172    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:32:45.747305    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:32:45.747322    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:32:46.204765    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:32:46.204893    4558 controller.go:557] controller loop complete\nI0923 16:32:56.206411    4558 controller.go:189] starting controller iteration\nI0923 16:32:56.206487    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:32:56.206884    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:32:56.207070    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:32:56.207443    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:32:56.220135    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:32:56.220219    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:32:56.220406    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:32:56.220582    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:56.220593    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:32:56.220636    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:32:56.220695    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:32:56.220715    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:32:56.683255    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:32:56.683324    4558 controller.go:557] controller loop complete\nI0923 16:33:06.684910    4558 controller.go:189] starting controller iteration\nI0923 16:33:06.684940    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:33:06.685274    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:33:06.685515    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:33:06.686038    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:33:06.697975    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:33:06.698248    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:33:06.698309    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:33:06.698500    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:06.698518    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:06.698570    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:33:06.698650    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:33:06.698663    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:33:07.154501    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:33:07.154575    4558 controller.go:557] controller loop complete\nI0923 16:33:17.156276    4558 controller.go:189] starting controller iteration\nI0923 16:33:17.156373    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:33:17.156744    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:33:17.156956    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:33:17.157715    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:33:17.169762    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:33:17.169854    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:33:17.169917    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:33:17.170186    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:17.170203    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:17.170311    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:33:17.170440    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:33:17.170486    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:33:17.626267    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:33:17.626338    4558 controller.go:557] controller loop complete\nI0923 16:33:27.628327    4558 controller.go:189] starting controller iteration\nI0923 16:33:27.628359    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:33:27.628737    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:33:27.628959    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:33:27.629639    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:33:27.648593    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:33:27.648875    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:33:27.648921    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:33:27.649262    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:27.649281    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:27.649380    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:33:27.649532    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:33:27.649568    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:33:28.102614    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:33:28.102683    4558 controller.go:557] controller loop complete\nI0923 16:33:38.104820    4558 controller.go:189] starting controller iteration\nI0923 16:33:38.104848    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:33:38.105127    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:33:38.105323    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:33:38.105789    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:33:38.117566    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:33:38.117643    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:33:38.117662    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:33:38.117852    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:38.117866    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:38.117920    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:33:38.118000    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:33:38.118015    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:33:38.572908    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:33:38.573036    4558 controller.go:557] controller loop complete\nI0923 16:33:43.636287    4558 volumes.go:86] AWS API Request: ec2/DescribeVolumes\nI0923 16:33:43.760630    4558 volumes.go:86] AWS API Request: ec2/DescribeInstances\nI0923 16:33:43.817287    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:43.817376    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:33:48.574228    4558 controller.go:189] starting controller iteration\nI0923 16:33:48.574259    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:33:48.574660    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:33:48.574778    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:33:48.575305    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:33:48.586997    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:33:48.587218    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:33:48.587269    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:33:48.587562    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:48.587582    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:48.587680    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:33:48.587820    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:33:48.587876    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:33:49.028890    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:33:49.029010    4558 controller.go:557] controller loop complete\nI0923 16:33:59.030596    4558 controller.go:189] starting controller iteration\nI0923 16:33:59.030625    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:33:59.030934    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:33:59.031085    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:33:59.031561    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:33:59.045778    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:33:59.045874    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:33:59.045904    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:33:59.046139    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:59.046155    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:33:59.046211    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:33:59.046289    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:33:59.046305    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:33:59.503905    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:33:59.503976    4558 controller.go:557] controller loop complete\nI0923 16:34:09.505513    4558 controller.go:189] starting controller iteration\nI0923 16:34:09.505545    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:34:09.505883    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:34:09.506110    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:34:09.506534    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:34:09.517872    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:34:09.517999    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:34:09.518283    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:34:09.518531    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:09.518550    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:09.518802    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:34:09.518953    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:34:09.518970    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:34:09.970455    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:34:09.970599    4558 controller.go:557] controller loop complete\nI0923 16:34:19.972042    4558 controller.go:189] starting controller iteration\nI0923 16:34:19.972140    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:34:19.972468    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:34:19.972691    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:34:19.973360    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:34:19.985136    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:34:19.985644    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:34:19.985670    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:34:19.986138    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:19.986155    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:19.986216    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:34:19.986470    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:34:19.986491    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:34:20.452434    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:34:20.452578    4558 controller.go:557] controller loop complete\nI0923 16:34:30.454308    4558 controller.go:189] starting controller iteration\nI0923 16:34:30.454340    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:34:30.454812    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:34:30.455036    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:34:30.455536    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:34:30.467547    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:34:30.467645    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:34:30.467663    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:34:30.468026    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:30.468044    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:30.468091    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:34:30.468173    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:34:30.468200    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:34:30.926343    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:34:30.926563    4558 controller.go:557] controller loop complete\nI0923 16:34:40.927881    4558 controller.go:189] starting controller iteration\nI0923 16:34:40.927914    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:34:40.928153    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:34:40.928278    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:34:40.928883    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:34:40.945055    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:34:40.945194    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:34:40.945214    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:34:40.945592    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:40.945609    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:40.945696    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:34:40.945866    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:34:40.945946    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:34:41.402008    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:34:41.402082    4558 controller.go:557] controller loop complete\nI0923 16:34:43.817967    4558 volumes.go:86] AWS API Request: ec2/DescribeVolumes\nI0923 16:34:43.895952    4558 volumes.go:86] AWS API Request: ec2/DescribeInstances\nI0923 16:34:44.045617    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:44.045844    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:34:51.403450    4558 controller.go:189] starting controller iteration\nI0923 16:34:51.403530    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:34:51.403886    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:34:51.404126    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:34:51.404594    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:34:51.416235    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:34:51.416330    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:34:51.416367    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:34:51.416642    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:51.416667    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:34:51.416917    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:34:51.417094    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:34:51.417112    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:34:51.877499    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:34:51.877571    4558 controller.go:557] controller loop complete\nI0923 16:35:01.878801    4558 controller.go:189] starting controller iteration\nI0923 16:35:01.878831    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:35:01.879229    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:35:01.879455    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:35:01.880090    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:35:01.894121    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:35:01.894210    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:35:01.894230    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:35:01.894418    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:35:01.894432    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:35:01.894483    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:35:01.894564    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:35:01.894576    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:35:02.339948    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:35:02.340079    4558 controller.go:557] controller loop complete\nI0923 16:35:12.341411    4558 controller.go:189] starting controller iteration\nI0923 16:35:12.341441    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:35:12.341842    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:35:12.342022    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:35:12.342700    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:35:12.354423    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:35:12.354517    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:35:12.354535    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:35:12.354722    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:35:12.354736    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:35:12.354805    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:35:12.354963    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:35:12.355042    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:35:12.804747    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:35:12.804818    4558 controller.go:557] controller loop complete\nI0923 16:35:22.806211    4558 controller.go:189] starting controller iteration\nI0923 16:35:22.806241    4558 controller.go:266] Broadcasting leadership assertion with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:35:22.806667    4558 leadership.go:37] Got LeaderNotification view:<leader:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > leadership_token:\"wrQHbZv7oNDhW_AJtyFCBg\" healthy:<id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" > > \nI0923 16:35:22.806865    4558 controller.go:295] I am leader with token \"wrQHbZv7oNDhW_AJtyFCBg\"\nI0923 16:35:22.807934    4558 controller.go:705] base client OK for etcd for client urls [https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001]\nI0923 16:35:22.820987    4558 controller.go:302] etcd cluster state: etcdClusterState\n  members:\n    {\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}\n  peers:\n    etcdClusterPeerInfo{peer=peer{id:\"etcd-a\" endpoints:\"172.20.42.57:3996\" }, info=cluster_name:\"etcd\" node_configuration:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" > etcd_state:<cluster:<cluster_token:\"rY5EfurKlEvgkbJkSWDksQ\" nodes:<name:\"etcd-a\" peer_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\" client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\" quarantined_client_urls:\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:3994\" tls_enabled:true > > etcd_version:\"3.4.13\" > }\nI0923 16:35:22.821181    4558 controller.go:303] etcd cluster members: map[442266815502156781:{\"name\":\"etcd-a\",\"peerURLs\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:2380\"],\"endpoints\":[\"https://etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:4001\"],\"ID\":\"442266815502156781\"}]\nI0923 16:35:22.821307    4558 controller.go:641] sending member map to all peers: members:<name:\"etcd-a\" dns:\"etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\" addresses:\"172.20.42.57\" > \nI0923 16:35:22.821533    4558 etcdserver.go:248] updating hosts: map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:35:22.821549    4558 hosts.go:84] hosts update: primary=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]], fallbacks=map[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io:[172.20.42.57 172.20.42.57]], final=map[172.20.42.57:[etcd-a.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io]]\nI0923 16:35:22.821627    4558 hosts.go:181] skipping update of unchanged /etc/hosts\nI0923 16:35:22.821745    4558 commands.go:38] not refreshing commands - TTL not hit\nI0923 16:35:22.821830    4558 s3fs.go:290] Reading file \"s3://k8s-kops-prow/e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/backups/etcd/main/control/etcd-cluster-created\"\nI0923 16:35:23.277040    4558 controller.go:395] spec member_count:1 etcd_version:\"3.4.13\" \nI0923 16:35:23.277115    4558 controller.go:557] controller loop complete\n==== END logs for container etcd-manager of pod kube-system/etcd-manager-main-ip-172-20-42-57.ap-northeast-1.compute.internal ====\n==== START logs for container kops-controller of pod kube-system/kops-controller-cdk2g ====\nI0923 16:31:58.031938       1 deleg.go:130] controller-runtime/metrics \"msg\"=\"metrics server is starting to listen\"  \"addr\"=\":0\"\nI0923 16:31:58.034057       1 deleg.go:130] setup \"msg\"=\"starting manager\"  \nI0923 16:31:58.034312       1 leaderelection.go:243] attempting to acquire leader lease kube-system/kops-controller-leader...\nI0923 16:31:58.034580       1 internal.go:393] controller-runtime/manager \"msg\"=\"starting metrics server\"  \"path\"=\"/metrics\"\nE0923 16:31:58.043797       1 event.go:329] Could not construct reference to: '&v1.Lease{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"kops-controller-leader\", GenerateName:\"\", Namespace:\"kube-system\", SelfLink:\"\", UID:\"37611a70-b080-4b39-80cb-9a13549a1a0e\", ResourceVersion:\"504\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63768011518, loc:(*time.Location)(0x45ea8c0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:\"\", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:\"kops-controller\", Operation:\"Update\", APIVersion:\"coordination.k8s.io/v1\", Time:(*v1.Time)(0xc00031b710), FieldsType:\"FieldsV1\", FieldsV1:(*v1.FieldsV1)(0xc00031b770)}}}, Spec:v1.LeaseSpec{HolderIdentity:(*string)(nil), LeaseDurationSeconds:(*int32)(nil), AcquireTime:(*v1.MicroTime)(nil), RenewTime:(*v1.MicroTime)(nil), LeaseTransitions:(*int32)(nil)}}' due to: 'no kind is registered for the type v1.Lease in scheme \"cmd/kops-controller/main.go:48\"'. Will not report event: 'Normal' 'LeaderElection' 'ip-172-20-42-57.ap-northeast-1.compute.internal_f97ad562-7cc6-4486-a992-363daacbbde4 became leader'\nI0923 16:31:58.043859       1 leaderelection.go:253] successfully acquired lease kube-system/kops-controller-leader\nI0923 16:31:58.043980       1 recorder.go:104] controller-runtime/manager/events \"msg\"=\"Normal\"  \"message\"=\"ip-172-20-42-57.ap-northeast-1.compute.internal_f97ad562-7cc6-4486-a992-363daacbbde4 became leader\" \"object\"={\"kind\":\"ConfigMap\",\"namespace\":\"kube-system\",\"name\":\"kops-controller-leader\",\"uid\":\"6b686c9e-670f-423a-9d98-756e93c3d4aa\",\"apiVersion\":\"v1\",\"resourceVersion\":\"503\"} \"reason\"=\"LeaderElection\"\nI0923 16:31:58.044567       1 controller.go:165] controller-runtime/manager/controller/node \"msg\"=\"Starting EventSource\" \"reconciler group\"=\"\" \"reconciler kind\"=\"Node\" \"source\"={\"Type\":{\"metadata\":{\"creationTimestamp\":null},\"spec\":{},\"status\":{\"daemonEndpoints\":{\"kubeletEndpoint\":{\"Port\":0}},\"nodeInfo\":{\"machineID\":\"\",\"systemUUID\":\"\",\"bootID\":\"\",\"kernelVersion\":\"\",\"osImage\":\"\",\"containerRuntimeVersion\":\"\",\"kubeletVersion\":\"\",\"kubeProxyVersion\":\"\",\"operatingSystem\":\"\",\"architecture\":\"\"}}}}\nI0923 16:31:58.044601       1 controller.go:173] controller-runtime/manager/controller/node \"msg\"=\"Starting Controller\" \"reconciler group\"=\"\" \"reconciler kind\"=\"Node\" \nI0923 16:31:58.044861       1 reflector.go:219] Starting reflector *v1.Node (10h52m51.665433924s) from pkg/cache/internal/informers_map.go:241\nI0923 16:31:58.145569       1 controller.go:207] controller-runtime/manager/controller/node \"msg\"=\"Starting workers\" \"reconciler group\"=\"\" \"reconciler kind\"=\"Node\" \"worker count\"=1\nI0923 16:31:58.217691       1 node_controller.go:142] sending patch for node \"ip-172-20-42-57.ap-northeast-1.compute.internal\": \"{\\\"metadata\\\":{\\\"labels\\\":{\\\"kops.k8s.io/instancegroup\\\":\\\"master-ap-northeast-1a\\\"}}}\"\nI0923 16:32:20.048172       1 server.go:167] bootstrap 172.20.63.252:60554 ip-172-20-63-252.ap-northeast-1.compute.internal success\nI0923 16:32:24.757845       1 server.go:167] bootstrap 172.20.34.24:33672 ip-172-20-34-24.ap-northeast-1.compute.internal success\nI0923 16:32:25.846594       1 server.go:167] bootstrap 172.20.54.72:44248 ip-172-20-54-72.ap-northeast-1.compute.internal success\nI0923 16:32:25.967774       1 node_controller.go:142] sending patch for node \"ip-172-20-63-252.ap-northeast-1.compute.internal\": \"{\\\"metadata\\\":{\\\"labels\\\":{\\\"kops.k8s.io/instancegroup\\\":\\\"nodes-ap-northeast-1a\\\",\\\"kubernetes.io/role\\\":\\\"node\\\",\\\"node-role.kubernetes.io/node\\\":\\\"\\\"}}}\"\nI0923 16:32:27.695669       1 server.go:167] bootstrap 172.20.43.215:45716 ip-172-20-43-215.ap-northeast-1.compute.internal success\nI0923 16:32:30.908384       1 node_controller.go:142] sending patch for node \"ip-172-20-34-24.ap-northeast-1.compute.internal\": \"{\\\"metadata\\\":{\\\"labels\\\":{\\\"kops.k8s.io/instancegroup\\\":\\\"nodes-ap-northeast-1a\\\",\\\"kubernetes.io/role\\\":\\\"node\\\",\\\"node-role.kubernetes.io/node\\\":\\\"\\\"}}}\"\nI0923 16:32:31.673146       1 node_controller.go:142] sending patch for node \"ip-172-20-54-72.ap-northeast-1.compute.internal\": \"{\\\"metadata\\\":{\\\"labels\\\":{\\\"kops.k8s.io/instancegroup\\\":\\\"nodes-ap-northeast-1a\\\",\\\"kubernetes.io/role\\\":\\\"node\\\",\\\"node-role.kubernetes.io/node\\\":\\\"\\\"}}}\"\nI0923 16:32:33.600113       1 node_controller.go:142] sending patch for node \"ip-172-20-43-215.ap-northeast-1.compute.internal\": \"{\\\"metadata\\\":{\\\"labels\\\":{\\\"kops.k8s.io/instancegroup\\\":\\\"nodes-ap-northeast-1a\\\",\\\"kubernetes.io/role\\\":\\\"node\\\",\\\"node-role.kubernetes.io/node\\\":\\\"\\\"}}}\"\n==== END logs for container kops-controller of pod kube-system/kops-controller-cdk2g ====\n==== START logs for container kube-apiserver of pod kube-system/kube-apiserver-ip-172-20-42-57.ap-northeast-1.compute.internal ====\nFlag --insecure-port has been deprecated, This flag has no effect now and will be removed in v1.24.\nI0923 16:30:53.313890       1 flags.go:59] FLAG: --add-dir-header=\"false\"\nI0923 16:30:53.313988       1 flags.go:59] FLAG: --address=\"127.0.0.1\"\nI0923 16:30:53.313997       1 flags.go:59] FLAG: --admission-control=\"[]\"\nI0923 16:30:53.314005       1 flags.go:59] FLAG: --admission-control-config-file=\"\"\nI0923 16:30:53.314011       1 flags.go:59] FLAG: --advertise-address=\"<nil>\"\nI0923 16:30:53.314016       1 flags.go:59] FLAG: --allow-metric-labels=\"[]\"\nI0923 16:30:53.314026       1 flags.go:59] FLAG: --allow-privileged=\"true\"\nI0923 16:30:53.314032       1 flags.go:59] FLAG: --alsologtostderr=\"true\"\nI0923 16:30:53.314036       1 flags.go:59] FLAG: --anonymous-auth=\"false\"\nI0923 16:30:53.314041       1 flags.go:59] FLAG: --api-audiences=\"[kubernetes.svc.default]\"\nI0923 16:30:53.314047       1 flags.go:59] FLAG: --apiserver-count=\"1\"\nI0923 16:30:53.314053       1 flags.go:59] FLAG: --audit-log-batch-buffer-size=\"10000\"\nI0923 16:30:53.314058       1 flags.go:59] FLAG: --audit-log-batch-max-size=\"1\"\nI0923 16:30:53.314063       1 flags.go:59] FLAG: --audit-log-batch-max-wait=\"0s\"\nI0923 16:30:53.314069       1 flags.go:59] FLAG: --audit-log-batch-throttle-burst=\"0\"\nI0923 16:30:53.314073       1 flags.go:59] FLAG: --audit-log-batch-throttle-enable=\"false\"\nI0923 16:30:53.314078       1 flags.go:59] FLAG: --audit-log-batch-throttle-qps=\"0\"\nI0923 16:30:53.314085       1 flags.go:59] FLAG: --audit-log-compress=\"false\"\nI0923 16:30:53.314090       1 flags.go:59] FLAG: --audit-log-format=\"json\"\nI0923 16:30:53.314094       1 flags.go:59] FLAG: --audit-log-maxage=\"0\"\nI0923 16:30:53.314123       1 flags.go:59] FLAG: --audit-log-maxbackup=\"0\"\nI0923 16:30:53.314128       1 flags.go:59] FLAG: --audit-log-maxsize=\"0\"\nI0923 16:30:53.314133       1 flags.go:59] FLAG: --audit-log-mode=\"blocking\"\nI0923 16:30:53.314138       1 flags.go:59] FLAG: --audit-log-path=\"\"\nI0923 16:30:53.314143       1 flags.go:59] FLAG: --audit-log-truncate-enabled=\"false\"\nI0923 16:30:53.314151       1 flags.go:59] FLAG: --audit-log-truncate-max-batch-size=\"10485760\"\nI0923 16:30:53.314159       1 flags.go:59] FLAG: --audit-log-truncate-max-event-size=\"102400\"\nI0923 16:30:53.314164       1 flags.go:59] FLAG: --audit-log-version=\"audit.k8s.io/v1\"\nI0923 16:30:53.314169       1 flags.go:59] FLAG: --audit-policy-file=\"\"\nI0923 16:30:53.314174       1 flags.go:59] FLAG: --audit-webhook-batch-buffer-size=\"10000\"\nI0923 16:30:53.314179       1 flags.go:59] FLAG: --audit-webhook-batch-initial-backoff=\"10s\"\nI0923 16:30:53.314184       1 flags.go:59] FLAG: --audit-webhook-batch-max-size=\"400\"\nI0923 16:30:53.314189       1 flags.go:59] FLAG: --audit-webhook-batch-max-wait=\"30s\"\nI0923 16:30:53.314194       1 flags.go:59] FLAG: --audit-webhook-batch-throttle-burst=\"15\"\nI0923 16:30:53.314199       1 flags.go:59] FLAG: --audit-webhook-batch-throttle-enable=\"true\"\nI0923 16:30:53.314204       1 flags.go:59] FLAG: --audit-webhook-batch-throttle-qps=\"10\"\nI0923 16:30:53.314210       1 flags.go:59] FLAG: --audit-webhook-config-file=\"\"\nI0923 16:30:53.314215       1 flags.go:59] FLAG: --audit-webhook-initial-backoff=\"10s\"\nI0923 16:30:53.314219       1 flags.go:59] FLAG: --audit-webhook-mode=\"batch\"\nI0923 16:30:53.314224       1 flags.go:59] FLAG: --audit-webhook-truncate-enabled=\"false\"\nI0923 16:30:53.314229       1 flags.go:59] FLAG: --audit-webhook-truncate-max-batch-size=\"10485760\"\nI0923 16:30:53.314235       1 flags.go:59] FLAG: --audit-webhook-truncate-max-event-size=\"102400\"\nI0923 16:30:53.314241       1 flags.go:59] FLAG: --audit-webhook-version=\"audit.k8s.io/v1\"\nI0923 16:30:53.314246       1 flags.go:59] FLAG: --authentication-token-webhook-cache-ttl=\"2m0s\"\nI0923 16:30:53.314252       1 flags.go:59] FLAG: --authentication-token-webhook-config-file=\"\"\nI0923 16:30:53.314257       1 flags.go:59] FLAG: --authentication-token-webhook-version=\"v1beta1\"\nI0923 16:30:53.314262       1 flags.go:59] FLAG: --authorization-mode=\"[Node,RBAC]\"\nI0923 16:30:53.314272       1 flags.go:59] FLAG: --authorization-policy-file=\"\"\nI0923 16:30:53.314276       1 flags.go:59] FLAG: --authorization-webhook-cache-authorized-ttl=\"5m0s\"\nI0923 16:30:53.314285       1 flags.go:59] FLAG: --authorization-webhook-cache-unauthorized-ttl=\"30s\"\nI0923 16:30:53.314290       1 flags.go:59] FLAG: --authorization-webhook-config-file=\"\"\nI0923 16:30:53.314295       1 flags.go:59] FLAG: --authorization-webhook-version=\"v1beta1\"\nI0923 16:30:53.314300       1 flags.go:59] FLAG: --bind-address=\"0.0.0.0\"\nI0923 16:30:53.314305       1 flags.go:59] FLAG: --cert-dir=\"/var/run/kubernetes\"\nI0923 16:30:53.314311       1 flags.go:59] FLAG: --client-ca-file=\"/srv/kubernetes/ca.crt\"\nI0923 16:30:53.314316       1 flags.go:59] FLAG: --cloud-config=\"/etc/kubernetes/cloud.config\"\nI0923 16:30:53.314321       1 flags.go:59] FLAG: --cloud-provider=\"aws\"\nI0923 16:30:53.314326       1 flags.go:59] FLAG: --cloud-provider-gce-l7lb-src-cidrs=\"130.211.0.0/22,35.191.0.0/16\"\nI0923 16:30:53.314335       1 flags.go:59] FLAG: --cloud-provider-gce-lb-src-cidrs=\"130.211.0.0/22,209.85.152.0/22,209.85.204.0/22,35.191.0.0/16\"\nI0923 16:30:53.314343       1 flags.go:59] FLAG: --contention-profiling=\"false\"\nI0923 16:30:53.314348       1 flags.go:59] FLAG: --cors-allowed-origins=\"[]\"\nI0923 16:30:53.314354       1 flags.go:59] FLAG: --default-not-ready-toleration-seconds=\"300\"\nI0923 16:30:53.314359       1 flags.go:59] FLAG: --default-unreachable-toleration-seconds=\"300\"\nI0923 16:30:53.314364       1 flags.go:59] FLAG: --default-watch-cache-size=\"100\"\nI0923 16:30:53.314372       1 flags.go:59] FLAG: --delete-collection-workers=\"1\"\nI0923 16:30:53.314378       1 flags.go:59] FLAG: --deserialization-cache-size=\"0\"\nI0923 16:30:53.314383       1 flags.go:59] FLAG: --disable-admission-plugins=\"[]\"\nI0923 16:30:53.314392       1 flags.go:59] FLAG: --disabled-metrics=\"[]\"\nI0923 16:30:53.314397       1 flags.go:59] FLAG: --egress-selector-config-file=\"\"\nI0923 16:30:53.314401       1 flags.go:59] FLAG: --enable-admission-plugins=\"[NamespaceLifecycle,LimitRanger,ServiceAccount,PersistentVolumeLabel,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,NodeRestriction,ResourceQuota]\"\nI0923 16:30:53.314414       1 flags.go:59] FLAG: --enable-aggregator-routing=\"false\"\nI0923 16:30:53.314419       1 flags.go:59] FLAG: --enable-bootstrap-token-auth=\"false\"\nI0923 16:30:53.314424       1 flags.go:59] FLAG: --enable-garbage-collector=\"true\"\nI0923 16:30:53.314429       1 flags.go:59] FLAG: --enable-logs-handler=\"true\"\nI0923 16:30:53.314433       1 flags.go:59] FLAG: --enable-priority-and-fairness=\"true\"\nI0923 16:30:53.314438       1 flags.go:59] FLAG: --enable-swagger-ui=\"false\"\nI0923 16:30:53.314442       1 flags.go:59] FLAG: --encryption-provider-config=\"\"\nI0923 16:30:53.314447       1 flags.go:59] FLAG: --endpoint-reconciler-type=\"lease\"\nI0923 16:30:53.314451       1 flags.go:59] FLAG: --etcd-cafile=\"/etc/kubernetes/pki/kube-apiserver/etcd-ca.crt\"\nI0923 16:30:53.314457       1 flags.go:59] FLAG: --etcd-certfile=\"/etc/kubernetes/pki/kube-apiserver/etcd-client.crt\"\nI0923 16:30:53.314462       1 flags.go:59] FLAG: --etcd-compaction-interval=\"5m0s\"\nI0923 16:30:53.314467       1 flags.go:59] FLAG: --etcd-count-metric-poll-period=\"1m0s\"\nI0923 16:30:53.314472       1 flags.go:59] FLAG: --etcd-db-metric-poll-interval=\"30s\"\nI0923 16:30:53.314477       1 flags.go:59] FLAG: --etcd-healthcheck-timeout=\"2s\"\nI0923 16:30:53.314482       1 flags.go:59] FLAG: --etcd-keyfile=\"/etc/kubernetes/pki/kube-apiserver/etcd-client.key\"\nI0923 16:30:53.314487       1 flags.go:59] FLAG: --etcd-prefix=\"/registry\"\nI0923 16:30:53.314492       1 flags.go:59] FLAG: --etcd-servers=\"[https://127.0.0.1:4001]\"\nI0923 16:30:53.314498       1 flags.go:59] FLAG: --etcd-servers-overrides=\"[/events#https://127.0.0.1:4002]\"\nI0923 16:30:53.314506       1 flags.go:59] FLAG: --event-ttl=\"1h0m0s\"\nI0923 16:30:53.314511       1 flags.go:59] FLAG: --experimental-encryption-provider-config=\"\"\nI0923 16:30:53.314515       1 flags.go:59] FLAG: --experimental-logging-sanitization=\"false\"\nI0923 16:30:53.314519       1 flags.go:59] FLAG: --external-hostname=\"\"\nI0923 16:30:53.314524       1 flags.go:59] FLAG: --feature-gates=\"\"\nI0923 16:30:53.314534       1 flags.go:59] FLAG: --goaway-chance=\"0\"\nI0923 16:30:53.314543       1 flags.go:59] FLAG: --help=\"false\"\nI0923 16:30:53.314547       1 flags.go:59] FLAG: --http2-max-streams-per-connection=\"0\"\nI0923 16:30:53.314552       1 flags.go:59] FLAG: --identity-lease-duration-seconds=\"3600\"\nI0923 16:30:53.314557       1 flags.go:59] FLAG: --identity-lease-renew-interval-seconds=\"10\"\nI0923 16:30:53.314562       1 flags.go:59] FLAG: --insecure-bind-address=\"127.0.0.1\"\nI0923 16:30:53.314567       1 flags.go:59] FLAG: --insecure-port=\"0\"\nI0923 16:30:53.314572       1 flags.go:59] FLAG: --kubelet-certificate-authority=\"\"\nI0923 16:30:53.314576       1 flags.go:59] FLAG: --kubelet-client-certificate=\"/srv/kubernetes/kubelet-api.crt\"\nI0923 16:30:53.314582       1 flags.go:59] FLAG: --kubelet-client-key=\"/srv/kubernetes/kubelet-api.key\"\nI0923 16:30:53.314589       1 flags.go:59] FLAG: --kubelet-https=\"true\"\nI0923 16:30:53.314594       1 flags.go:59] FLAG: --kubelet-port=\"10250\"\nI0923 16:30:53.314600       1 flags.go:59] FLAG: --kubelet-preferred-address-types=\"[InternalIP,Hostname,ExternalIP]\"\nI0923 16:30:53.314606       1 flags.go:59] FLAG: --kubelet-read-only-port=\"10255\"\nI0923 16:30:53.314611       1 flags.go:59] FLAG: --kubelet-timeout=\"5s\"\nI0923 16:30:53.314616       1 flags.go:59] FLAG: --kubernetes-service-node-port=\"0\"\nI0923 16:30:53.314620       1 flags.go:59] FLAG: --lease-reuse-duration-seconds=\"60\"\nI0923 16:30:53.314625       1 flags.go:59] FLAG: --livez-grace-period=\"0s\"\nI0923 16:30:53.314629       1 flags.go:59] FLAG: --log-backtrace-at=\":0\"\nI0923 16:30:53.314638       1 flags.go:59] FLAG: --log-dir=\"\"\nI0923 16:30:53.314644       1 flags.go:59] FLAG: --log-file=\"/var/log/kube-apiserver.log\"\nI0923 16:30:53.314649       1 flags.go:59] FLAG: --log-file-max-size=\"1800\"\nI0923 16:30:53.314654       1 flags.go:59] FLAG: --log-flush-frequency=\"5s\"\nI0923 16:30:53.314658       1 flags.go:59] FLAG: --logging-format=\"text\"\nI0923 16:30:53.314663       1 flags.go:59] FLAG: --logtostderr=\"false\"\nI0923 16:30:53.314668       1 flags.go:59] FLAG: --master-service-namespace=\"default\"\nI0923 16:30:53.314673       1 flags.go:59] FLAG: --max-connection-bytes-per-sec=\"0\"\nI0923 16:30:53.314677       1 flags.go:59] FLAG: --max-mutating-requests-inflight=\"200\"\nI0923 16:30:53.314682       1 flags.go:59] FLAG: --max-requests-inflight=\"400\"\nI0923 16:30:53.314687       1 flags.go:59] FLAG: --min-request-timeout=\"1800\"\nI0923 16:30:53.314692       1 flags.go:59] FLAG: --oidc-ca-file=\"\"\nI0923 16:30:53.314697       1 flags.go:59] FLAG: --oidc-client-id=\"\"\nI0923 16:30:53.314701       1 flags.go:59] FLAG: --oidc-groups-claim=\"\"\nI0923 16:30:53.314706       1 flags.go:59] FLAG: --oidc-groups-prefix=\"\"\nI0923 16:30:53.314711       1 flags.go:59] FLAG: --oidc-issuer-url=\"\"\nI0923 16:30:53.314715       1 flags.go:59] FLAG: --oidc-required-claim=\"\"\nI0923 16:30:53.314724       1 flags.go:59] FLAG: --oidc-signing-algs=\"[RS256]\"\nI0923 16:30:53.314732       1 flags.go:59] FLAG: --oidc-username-claim=\"sub\"\nI0923 16:30:53.314737       1 flags.go:59] FLAG: --oidc-username-prefix=\"\"\nI0923 16:30:53.314741       1 flags.go:59] FLAG: --one-output=\"false\"\nI0923 16:30:53.314746       1 flags.go:59] FLAG: --permit-address-sharing=\"false\"\nI0923 16:30:53.314753       1 flags.go:59] FLAG: --permit-port-sharing=\"false\"\nI0923 16:30:53.314757       1 flags.go:59] FLAG: --port=\"0\"\nI0923 16:30:53.314762       1 flags.go:59] FLAG: --profiling=\"true\"\nI0923 16:30:53.314767       1 flags.go:59] FLAG: --proxy-client-cert-file=\"/srv/kubernetes/apiserver-aggregator.crt\"\nI0923 16:30:53.314772       1 flags.go:59] FLAG: --proxy-client-key-file=\"/srv/kubernetes/apiserver-aggregator.key\"\nI0923 16:30:53.314778       1 flags.go:59] FLAG: --request-timeout=\"1m0s\"\nI0923 16:30:53.314784       1 flags.go:59] FLAG: --requestheader-allowed-names=\"[aggregator]\"\nI0923 16:30:53.314793       1 flags.go:59] FLAG: --requestheader-client-ca-file=\"/srv/kubernetes/apiserver-aggregator-ca.crt\"\nI0923 16:30:53.314799       1 flags.go:59] FLAG: --requestheader-extra-headers-prefix=\"[X-Remote-Extra-]\"\nI0923 16:30:53.314839       1 flags.go:59] FLAG: --requestheader-group-headers=\"[X-Remote-Group]\"\nI0923 16:30:53.314845       1 flags.go:59] FLAG: --requestheader-username-headers=\"[X-Remote-User]\"\nI0923 16:30:53.314853       1 flags.go:59] FLAG: --runtime-config=\"\"\nI0923 16:30:53.314859       1 flags.go:59] FLAG: --secure-port=\"443\"\nI0923 16:30:53.314864       1 flags.go:59] FLAG: --service-account-api-audiences=\"[kubernetes.svc.default]\"\nI0923 16:30:53.314870       1 flags.go:59] FLAG: --service-account-extend-token-expiration=\"true\"\nI0923 16:30:53.314875       1 flags.go:59] FLAG: --service-account-issuer=\"https://api.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io\"\nI0923 16:30:53.314881       1 flags.go:59] FLAG: --service-account-jwks-uri=\"https://api.internal.e2e-03ab2660c9-58f2d.test-cncf-aws.k8s.io/openid/v1/jwks\"\nI0923 16:30:53.314888       1 flags.go:59] FLAG: --service-account-key-file=\"[/srv/kubernetes/service-account.key]\"\nI0923 16:30:53.314897       1 flags.go:59] FLAG: --service-account-lookup=\"true\"\nI0923 16:30:53.314902       1 flags.go:59] FLAG: --service-account-max-token-expiration=\"0s\"\nI0923 16:30:53.314907       1 flags.go:59] FLAG: --service-account-signing-key-file=\"/srv/kubernetes/service-account.key\"\nI0923 16:30:53.314912       1 flags.go:59] FLAG: --service-cluster-ip-range=\"100.64.0.0/13\"\nI0923 16:30:53.314917       1 flags.go:59] FLAG: --service-node-port-range=\"30000-32767\"\nI0923 16:30:53.314924       1 flags.go:59] FLAG: --show-hidden-metrics-for-version=\"\"\nI0923 16:30:53.314929       1 flags.go:59] FLAG: --shutdown-delay-duration=\"0s\"\nI0923 16:30:53.314933       1 flags.go:59] FLAG: --skip-headers=\"false\"\nI0923 16:30:53.314938       1 flags.go:59] FLAG: --skip-log-headers=\"false\"\nI0923 16:30:53.314942       1 flags.go:59] FLAG: --ssh-keyfile=\"\"\nI0923 16:30:53.314947       1 flags.go:59] FLAG: --ssh-user=\"\"\nI0923 16:30:53.314951       1 flags.go:59] FLAG: --stderrthreshold=\"2\"\nI0923 16:30:53.314956       1 flags.go:59] FLAG: --storage-backend=\"etcd3\"\nI0923 16:30:53.314961       1 flags.go:59] FLAG: --storage-media-type=\"application/vnd.kubernetes.protobuf\"\nI0923 16:30:53.314966       1 flags.go:59] FLAG: --strict-transport-security-directives=\"[]\"\nI0923 16:30:53.314971       1 flags.go:59] FLAG: --target-ram-mb=\"0\"\nI0923 16:30:53.314976       1 flags.go:59] FLAG: --tls-cert-file=\"/srv/kubernetes/server.crt\"\nI0923 16:30:53.314981       1 flags.go:59] FLAG: --tls-cipher-suites=\"[]\"\nI0923 16:30:53.314988       1 flags.go:59] FLAG: --tls-min-version=\"\"\nI0923 16:30:53.314992       1 flags.go:59] FLAG: --tls-private-key-file=\"/srv/kubernetes/server.key\"\nI0923 16:30:53.314997       1 flags.go:59] FLAG: --tls-sni-cert-key=\"[]\"\nI0923 16:30:53.315003       1 flags.go:59] FLAG: --token-auth-file=\"\"\nI0923 16:30:53.315008       1 flags.go:59] FLAG: --v=\"2\"\nI0923 16:30:53.315012       1 flags.go:59] FLAG: --version=\"false\"\nI0923 16:30:53.315020       1 flags.go:59] FLAG: --vmodule=\"\"\nI0923 16:30:53.315025       1 flags.go:59] FLAG: --watch-cache=\"true\"\nI0923 16:30:53.315030       1 flags.go:59] FLAG: --watch-cache-sizes=\"[]\"\nI0923 16:30:53.315307       1 server.go:629] external host was not specified, using 172.20.42.57\nI0923 16:30:53.315616       1 server.go:181] Version: v1.21.5\nI0923 16:30:53.318510       1 dynamic_serving_content.go:111] Loaded a new cert/key pair for \"serving-cert::/srv/kubernetes/server.crt::/srv/kubernetes/server.key\"\nI0923 16:30:53.636436       1 dynamic_cafile_content.go:129] Loaded a new CA Bundle and Verifier for \"client-ca-bundle::/srv/kubernetes/ca.crt\"\nI0923 16:30:53.636543       1 dynamic_cafile_content.go:129] Loaded a new CA Bundle and Verifier for \"request-header::/srv/kubernetes/apiserver-aggregator-ca.crt\"\nI0923 16:30:53.636930       1 shared_informer.go:240] Waiting for caches to sync for node_authorizer\nW0923 16:30:53.637430       1 admission.go:78] PersistentVolumeLabel admission controller is deprecated. Please remove this controller from your configuration files and scripts.\nI0923 16:30:53.637853       1 plugins.go:158] Loaded 13 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,PersistentVolumeLabel,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.\nI0923 16:30:53.637865       1 plugins.go:161] Loaded 10 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota.\nI0923 16:30:53.637898       1 apf_controller.go:195] NewTestableController \"Controller\" with serverConcurrencyLimit=600, requestWaitLimit=15s, name=Controller, asFieldManager=\"api-priority-and-fairness-config-consumer-v1\"\nI0923 16:30:53.638202       1 dynamic_cafile_content.go:129] Loaded a new CA Bundle and Verifier for \"client-ca-bundle::/srv/kubernetes/ca.crt\"\nI0923 16:30:53.638309       1 dynamic_cafile_content.go:129] Loaded a new CA Bundle and Verifier for \"request-header::/srv/kubernetes/apiserver-aggregator-ca.crt\"\nW0923 16:30:53.638800       1 admission.go:78] PersistentVolumeLabel admission controller is deprecated. Please remove this controller from your configuration files and scripts.\nI0923 16:30:53.639119       1 plugins.go:158] Loaded 13 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,PersistentVolumeLabel,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.\nI0923 16:30:53.639132       1 plugins.go:161] Loaded 10 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota.\nI0923 16:30:53.641026       1 client.go:360] parsed scheme: \"endpoint\"\nI0923 16:30:53.641059       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:4001  <nil> 0 <nil>}]\nW0923 16:30:53.641288       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:4001  <nil> 0 <nil>}. Err :connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:4001: connect: connection refused\". Reconnecting...\nI0923 16:30:54.636990       1 client.go:360] parsed scheme: \"endpoint\"\nI0923 16:30:54.637038       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:4001  <nil> 0 <nil>}]\nW0923 16:30:54.637614       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:4001  <nil> 0 <nil>}. Err :connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:4001: connect: connection refused\". Reconnecting...\nW0923 16:30:54.641731       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:4001  <nil> 0 <nil>}. Err :connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:4001: connect: connection refused\". Reconnecting...\nW0923 16:30:55.638413       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:4001  <nil> 0 <nil>}. Err :connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:4001: connect: connection refused\". Reconnecting...\nW0923 16:30:56.420299       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:4001  <nil> 0 <nil>}. Err :connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:4001: connect: connection refused\". Reconnecting...\nW0923 16:30:57.510891       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:4001  <nil> 0 <nil>}. Err :connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:4001: connect: connection refused\". Reconnecting...\nW0923 16:30:59.153764       1 clientconn.go:1223] grpc: addrConn.createTransport failed to connect to {https://127.0.0.1:4001  <nil> 0 <nil>}. Err :connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:4001: connect: connection refused\". Reconnecting...\nI0923 16:31:03.337142       1 client.go:360] parsed scheme: \"endpoint\"\nI0923 16:31:03.337340       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:4001  <nil> 0 <nil>}]\nI0923 16:31:03.343520       1 store.go:1428] Monitoring customresourcedefinitions.apiextensions.k8s.io count at <storage-prefix>//apiextensions.k8s.io/customresourcedefinitions\nI0923 16:31:03.343778       1 client.go:360] parsed scheme: \"passthrough\"\nI0923 16:31:03.343809       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:4001  <nil> 0 <nil>}] <nil> <nil>}\nI0923 16:31:03.343823       1 clientconn.go:948] ClientConn switching balancer to \"pick_first\"\nI0923 16:31:03.344030       1 balancer_conn_wrappers.go:78] pickfirstBalancer: HandleSubConnStateChange: 0xc000d50a10, {CONNECTING <nil>}\nI0923 16:31:03.344872       1 client.go:360] parsed scheme: \"endpoint\"\nI0923 16:31:03.344957       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:4001  <nil> 0 <nil>}]\nI0923 16:31:03.350873       1 balancer_conn_wrappers.go:78] pickfirstBalancer: HandleSubConnStateChange: 0xc000d50a10, {READY <nil>}\nI0923 16:31:03.352570       1 cacher.go:405] cacher (*apiextensions.CustomResourceDefinition): initialized\nI0923 16:31:03.352852       1 controlbuf.go:508] transport: loopyWriter.run returning. connection error: desc = \"transport is closing\"\nI0923 16:31:03.354020       1 store.go:1428] Monitoring customresourcedefinitions.apiextensions.k8s.io count at <storage-prefix>//apiextensions.k8s.io/customresourcedefinitions\nI0923 16:31:03.355091       1 cacher.go:405] cacher (*apiextensions.CustomResourceDefinition): initialized\nI0923 16:31:03.383596       1 instance.go:283] Using reconciler: lease\nI0923 16:31:03.384053       1 client.go:360] parsed scheme: \"endpoint\"\nI0923 16:31:03.384101       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:4001  <nil> 0 <nil>}]\nI0923 16:31:03.391015       1 client.go:360] parsed scheme: \"endpoint\"\nI0923 16:31:03.391058       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:4001  <nil> 0 <nil>}]\nI0923 16:31:03.397063       1 store.go:1428] Monitoring podtemplates count at <storage-prefix>//podtemplates\nI0923 16:31:03.397669       1 client.go:360] parsed scheme: \"endpoint\"\nI0923 16:31:03.397692       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:4002  <nil> 0 <nil>}]\nI0923 16:31:03.398728       1 cacher.go:405] cacher (*core.PodTemplate): initialized\nI0923 16:31:03.404341       1 client.go:360] parsed scheme: \"endpoint\"\nI0923 16:31:03.404446       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:4002  <nil> 0 <nil>}]\nI0923 16:31:03.409697       1 store.go:1428] Monitoring events count at <storage-prefix>//events\nI0923 16:31:03.409884       1 client.go:360] parsed scheme: \"passthrough\"\nI0923 16:31:03.409977       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:4002  <nil> 0 <nil>}] <nil> <nil>}\nI0923 16:31:03.410054       1 clientconn.go:948] ClientConn switching balancer to \"pick_first\"\nI0923 16:31:03.410247       1 balancer_conn_wrappers.go:78] pickfirstBalancer: HandleSubConnStateChange: 0xc001787200, {CONNECTING <nil>}\nI0923 16:31:03.410374       1 client.go:360] parsed scheme: \"endpoint\"\nI0923 16:31:03.410403       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:4001  <nil> 0 <nil>}]\nI0923 16:31:03.419019       1 balancer_conn_wrappers.go:78] pickfirstBalancer: HandleSubConnStateChange: 0xc001787200, {READY <nil>}\nI0923 16:31:03.420317       1 controlbuf.go:508] transport: loopyWriter.run returning. connection error: desc = \"transport is closing\"\nI0923 16:31:03.420592       1 store.go:1428] Monitoring limitranges count at <storage-prefix>//limitranges\nI0923 16:31:03.421134       1 client.go:360] parsed scheme: \"endpoint\"\nI0923 16:31:03.421200       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:4001  <nil> 0 <nil>}]\nI0923 16:31:03.424131       1 cacher.go:405] cacher (*core.LimitRange): initialized\nI0923 16:31:03.427184       1 store.go:1428] Monitoring resourcequotas count at <storage-prefix>//resourcequotas\nI0923 16:31:03.427596       1 client.go:360] parsed scheme: \"endpoint\"\nI0923 16:31:03.427617       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:4001  <nil> 0 <nil>}]\nI0923 16:31:03.428780       1 cacher.go:405] cacher (*core.ResourceQuota): initialized\nI0923 16:31:03.434309       1 store.go:1428] Monitoring secrets count at <storage-prefix>//secrets\nI0923 16:31:03.435031       1 cacher.go:405] cacher (*core.Secret): initialized\nI0923 16:31:03.435594       1 client.go:360] parsed scheme: \"endpoint\"\nI0923 16:31:03.435617       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:4001  <nil> 0 <nil>}]\nI0923 16:31:03.440988       1 store.go:1428] Monitoring persistentvolumes count at <storage-prefix>//persistentvolumes\nI0923 16:31:03.441378       1 client.go:360] parsed scheme: \"endpoint\"\nI0923 16:31:03.441405       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:4001  <nil> 0 <nil>}]\nI0923 16:31:03.442515       1 cacher.go:405] cacher (*core.PersistentVolume): initialized\nI0923 16:31:03.447814       1 store.go:1428] Monitoring persistentvolumeclaims count at <storage-prefix>//persistentvolumeclaims\nI0923 16:31:03.448526       1 client.go:360] parsed scheme: \"endpoint\"\nI0923 16:31:03.448791       1 cacher.go:405] cacher (*core.PersistentVolumeClaim): initialized\nI0923 16:31:03.449079       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:4001  <nil> 0 <nil>}]\nI0923 16:31:03.461439       1 store.go:1428] Monitoring configmaps count at <storage-prefix>//configmaps\nI0923 16:31:03.461960       1 client.go:360] parsed scheme: \"endpoint\"\nI0923 16:31:03.462002       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:4001  <nil> 0 <nil>}]\nI0923 16:31:03.463160       1 cacher.go:405] cacher (*core.ConfigMap): initialized\nI0923 16:31:03.467525       1 store.go:1428] Monitoring namespaces count at <storage-prefix>//namespaces\nI0923 16:31:03.467956       1 client.go:360] parsed scheme: \"endpoint\"\nI0923 16:31:03.467992       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:4001  <nil> 0 <nil>}]\nI0923 16:31:03.472965       1 cacher.go:405] cacher (*core.Namespace): initialized\nI0923 16:31:03.477367       1 store.go:1428] Monitoring endpoints count at <storage-prefix>//services/endpoints\nI0923 16:31:03.478073       1 client.go:360] parsed scheme: \"endpoint\"\nI0923 16:31:03.478392       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:4001  <nil> 0 <nil>}]\nI0923 16:31:03.478350       1 cacher.go:405] cacher (*core.Endpoints): initialized\nI0923 16:31:03.483998       1 store.go:1428] Monitoring nodes count at <storage-prefix>//minions\nI0923 16:31:03.484834       1 cacher.go:405] cacher (*core.Node): initialized\nI0923 16:31:03.485846       1 client.go:360] parsed scheme: \"endpoint\"\nI0923 16:31:03.485867       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:4001  <nil> 0 <nil>}]\nI0923 16:31:03.491142       1 store.go:1428] Monitoring pods count at <storage-prefix>//pods\nI0923 16:31:03.491689       1 client.go:360] parsed scheme: \"endpoint\"\nI0923 16:31:03.492405       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:4001  <nil> 0 <nil>}]\nI0923 16:31:03.492546       1 cacher.go:405] cacher (*cor