This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 0 failed / 0 succeeded
Started2021-10-13 00:44
Elapsed35m45s
Revisionmaster

No Test Failures!


Error lines from build-log.txt

... skipping 128 lines ...
I1013 00:45:10.392627    4716 http.go:37] curl https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt
I1013 00:45:10.394650    4716 http.go:37] curl https://storage.googleapis.com/kops-ci/bin/1.23.0-alpha.2+v1.23.0-alpha.1-424-ge8e9f04492/linux/amd64/kops
I1013 00:45:11.208046    4716 up.go:43] Cleaning up any leaked resources from previous cluster
I1013 00:45:11.208081    4716 dumplogs.go:40] /logs/artifacts/a23d1454-2bbe-11ec-824d-32dfe4bc407f/kops toolbox dump --name e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io --dir /logs/artifacts --private-key /etc/aws-ssh/aws-ssh-private --ssh-user ubuntu
I1013 00:45:11.225694    4737 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
I1013 00:45:11.225870    4737 featureflag.go:166] FeatureFlag "AlphaAllowGCE"=true
Error: Cluster.kops.k8s.io "e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io" not found
W1013 00:45:11.676760    4716 down.go:34] Dumping cluster logs at the start of Down() failed: exit status 1
I1013 00:45:11.676802    4716 down.go:48] /logs/artifacts/a23d1454-2bbe-11ec-824d-32dfe4bc407f/kops delete cluster --name e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io --yes
I1013 00:45:11.693940    4747 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
I1013 00:45:11.694027    4747 featureflag.go:166] FeatureFlag "AlphaAllowGCE"=true
Error: error reading cluster configuration: Cluster.kops.k8s.io "e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io" not found
I1013 00:45:12.157369    4716 http.go:37] curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip
2021/10/13 00:45:12 failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404
I1013 00:45:12.167969    4716 http.go:37] curl https://ip.jsb.workers.dev
I1013 00:45:12.274865    4716 up.go:144] /logs/artifacts/a23d1454-2bbe-11ec-824d-32dfe4bc407f/kops create cluster --name e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io --cloud aws --kubernetes-version https://storage.googleapis.com/kubernetes-release/release/v1.21.5 --ssh-public-key /etc/aws-ssh/aws-ssh-public --override cluster.spec.nodePortAccess=0.0.0.0/0 --yes --image=099720109477/ubuntu/images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20211001 --channel=alpha --networking=flannel --container-runtime=docker --admin-access 34.134.86.254/32 --master-count 1 --master-volume-size 48 --node-count 4 --node-volume-size 48 --zones ap-southeast-1a --master-size c5.large
I1013 00:45:12.292214    4758 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
I1013 00:45:12.292316    4758 featureflag.go:166] FeatureFlag "AlphaAllowGCE"=true
I1013 00:45:12.313572    4758 create_cluster.go:838] Using SSH public key: /etc/aws-ssh/aws-ssh-public
I1013 00:45:12.856598    4758 new_cluster.go:1077]  Cloud Provider ID = aws
... skipping 41 lines ...

I1013 00:45:42.067975    4716 up.go:181] /logs/artifacts/a23d1454-2bbe-11ec-824d-32dfe4bc407f/kops validate cluster --name e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io --count 10 --wait 15m0s
I1013 00:45:42.085555    4777 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
I1013 00:45:42.085650    4777 featureflag.go:166] FeatureFlag "AlphaAllowGCE"=true
Validating cluster e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io

W1013 00:45:43.782315    4777 validate_cluster.go:184] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
W1013 00:45:53.820717    4777 validate_cluster.go:184] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 00:46:03.855493    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 00:46:13.884477    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 00:46:23.917072    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 00:46:33.960164    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
W1013 00:46:43.991004    4777 validate_cluster.go:184] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 00:46:54.021024    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 00:47:04.054463    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 00:47:14.084058    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 00:47:24.128213    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 00:47:34.159267    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 00:47:44.225522    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 00:47:54.273051    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 00:48:04.325758    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 00:48:14.355766    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 00:48:24.385421    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 00:48:34.430255    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 00:48:44.513462    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
W1013 00:48:54.558113    4777 validate_cluster.go:184] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 00:49:04.586975    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1013 00:49:14.623316    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

... skipping 11 lines ...
Pod	kube-system/coredns-6c8944dbdc-ccddt			system-cluster-critical pod "coredns-6c8944dbdc-ccddt" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-dxjsp		system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-dxjsp" is pending
Pod	kube-system/kube-flannel-ds-dxnsw			system-node-critical pod "kube-flannel-ds-dxnsw" is pending
Pod	kube-system/kube-flannel-ds-qp2bm			system-node-critical pod "kube-flannel-ds-qp2bm" is pending
Pod	kube-system/kube-flannel-ds-wn9rb			system-node-critical pod "kube-flannel-ds-wn9rb" is pending

Validation Failed
W1013 00:49:29.898259    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

... skipping 13 lines ...
Node	ip-172-20-55-159.ap-southeast-1.compute.internal	node "ip-172-20-55-159.ap-southeast-1.compute.internal" of role "node" is not ready
Pod	kube-system/coredns-6c8944dbdc-ccddt			system-cluster-critical pod "coredns-6c8944dbdc-ccddt" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-dxjsp		system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-dxjsp" is pending
Pod	kube-system/kube-flannel-ds-78xlx			system-node-critical pod "kube-flannel-ds-78xlx" is pending
Pod	kube-system/kube-flannel-ds-dxnsw			system-node-critical pod "kube-flannel-ds-dxnsw" is pending

Validation Failed
W1013 00:49:43.471722    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

... skipping 6 lines ...
ip-172-20-60-219.ap-southeast-1.compute.internal	master	True

VALIDATION ERRORS
KIND	NAME						MESSAGE
Node	ip-172-20-43-74.ap-southeast-1.compute.internal	node "ip-172-20-43-74.ap-southeast-1.compute.internal" of role "node" is not ready

Validation Failed
W1013 00:49:56.945899    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

... skipping 6 lines ...
ip-172-20-60-219.ap-southeast-1.compute.internal	master	True

VALIDATION ERRORS
KIND	NAME									MESSAGE
Pod	kube-system/kube-proxy-ip-172-20-55-159.ap-southeast-1.compute.internal	system-node-critical pod "kube-proxy-ip-172-20-55-159.ap-southeast-1.compute.internal" is pending

Validation Failed
W1013 00:50:10.439050    4777 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-ap-southeast-1a	Master	c5.large	1	1	ap-southeast-1a
nodes-ap-southeast-1a	Node	t3.medium	4	4	ap-southeast-1a

... skipping 297 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: hostPath]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (immediate binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Driver hostPath doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
... skipping 584 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:52:54.831: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "request-timeout-4293" for this suite.

•
------------------------------
{"msg":"PASSED [sig-api-machinery] Server request timeout the request should be served with a default timeout if the specified timeout in the request URL exceeds maximum allowed","total":-1,"completed":1,"skipped":0,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
... skipping 302 lines ...
• [SLOW TEST:12.683 seconds]
[sig-storage] EmptyDir wrapper volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  should not conflict [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir wrapper volumes should not conflict [Conformance]","total":-1,"completed":1,"skipped":0,"failed":0}

SSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:05.580: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 116 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-storage] Downward API volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/downwardapi_volume.go:41
[It] should provide node allocatable (memory) as default memory limit if the limit is not set [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test downward API volume plugin
Oct 13 00:52:54.772: INFO: Waiting up to 5m0s for pod "downwardapi-volume-a85fe6f8-45c5-4059-81ac-42136a292959" in namespace "downward-api-4475" to be "Succeeded or Failed"
Oct 13 00:52:55.008: INFO: Pod "downwardapi-volume-a85fe6f8-45c5-4059-81ac-42136a292959": Phase="Pending", Reason="", readiness=false. Elapsed: 236.13995ms
Oct 13 00:52:57.248: INFO: Pod "downwardapi-volume-a85fe6f8-45c5-4059-81ac-42136a292959": Phase="Pending", Reason="", readiness=false. Elapsed: 2.476802168s
Oct 13 00:52:59.486: INFO: Pod "downwardapi-volume-a85fe6f8-45c5-4059-81ac-42136a292959": Phase="Pending", Reason="", readiness=false. Elapsed: 4.714777295s
Oct 13 00:53:01.723: INFO: Pod "downwardapi-volume-a85fe6f8-45c5-4059-81ac-42136a292959": Phase="Pending", Reason="", readiness=false. Elapsed: 6.951658959s
Oct 13 00:53:03.963: INFO: Pod "downwardapi-volume-a85fe6f8-45c5-4059-81ac-42136a292959": Phase="Succeeded", Reason="", readiness=false. Elapsed: 9.191713823s
STEP: Saw pod success
Oct 13 00:53:03.963: INFO: Pod "downwardapi-volume-a85fe6f8-45c5-4059-81ac-42136a292959" satisfied condition "Succeeded or Failed"
Oct 13 00:53:04.200: INFO: Trying to get logs from node ip-172-20-43-74.ap-southeast-1.compute.internal pod downwardapi-volume-a85fe6f8-45c5-4059-81ac-42136a292959 container client-container: <nil>
STEP: delete the pod
Oct 13 00:53:04.708: INFO: Waiting for pod downwardapi-volume-a85fe6f8-45c5-4059-81ac-42136a292959 to disappear
Oct 13 00:53:04.944: INFO: Pod downwardapi-volume-a85fe6f8-45c5-4059-81ac-42136a292959 no longer exists
[AfterEach] [sig-storage] Downward API volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:12.800 seconds]
[sig-storage] Downward API volume
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should provide node allocatable (memory) as default memory limit if the limit is not set [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Downward API volume should provide node allocatable (memory) as default memory limit if the limit is not set [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":4,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:05.687: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 59 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  Simple CustomResourceDefinition
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/custom_resource_definition.go:48
    listing custom resource definition objects works  [Conformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition listing custom resource definition objects works  [Conformance]","total":-1,"completed":1,"skipped":11,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:06.739: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 103 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/runtime.go:41
    on terminated container
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/runtime.go:134
      should report termination message [LinuxOnly] as empty when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Container Runtime blackbox test on terminated container should report termination message [LinuxOnly] as empty when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":4,"failed":0}

S
------------------------------
{"msg":"PASSED [sig-apps] DisruptionController should observe PodDisruptionBudget status updated [Conformance]","total":-1,"completed":1,"skipped":1,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:07.497: INFO: Driver local doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 137 lines ...
Oct 13 00:52:54.081: INFO: No PSP annotation exists on dry run pod; assuming PodSecurityPolicy is disabled
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable via the environment [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating configMap configmap-4860/configmap-test-01a3b338-c5df-4933-9ed5-5046a9834af5
STEP: Creating a pod to test consume configMaps
Oct 13 00:52:55.034: INFO: Waiting up to 5m0s for pod "pod-configmaps-fea6763b-5dcf-4b3a-b6e6-4df8e46b2b2a" in namespace "configmap-4860" to be "Succeeded or Failed"
Oct 13 00:52:55.268: INFO: Pod "pod-configmaps-fea6763b-5dcf-4b3a-b6e6-4df8e46b2b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 234.187581ms
Oct 13 00:52:57.503: INFO: Pod "pod-configmaps-fea6763b-5dcf-4b3a-b6e6-4df8e46b2b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2.469492294s
Oct 13 00:52:59.738: INFO: Pod "pod-configmaps-fea6763b-5dcf-4b3a-b6e6-4df8e46b2b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4.703997561s
Oct 13 00:53:01.973: INFO: Pod "pod-configmaps-fea6763b-5dcf-4b3a-b6e6-4df8e46b2b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 6.939078007s
Oct 13 00:53:04.208: INFO: Pod "pod-configmaps-fea6763b-5dcf-4b3a-b6e6-4df8e46b2b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 9.174401811s
Oct 13 00:53:06.491: INFO: Pod "pod-configmaps-fea6763b-5dcf-4b3a-b6e6-4df8e46b2b2a": Phase="Succeeded", Reason="", readiness=false. Elapsed: 11.457277825s
STEP: Saw pod success
Oct 13 00:53:06.491: INFO: Pod "pod-configmaps-fea6763b-5dcf-4b3a-b6e6-4df8e46b2b2a" satisfied condition "Succeeded or Failed"
Oct 13 00:53:06.725: INFO: Trying to get logs from node ip-172-20-37-188.ap-southeast-1.compute.internal pod pod-configmaps-fea6763b-5dcf-4b3a-b6e6-4df8e46b2b2a container env-test: <nil>
STEP: delete the pod
Oct 13 00:53:07.223: INFO: Waiting for pod pod-configmaps-fea6763b-5dcf-4b3a-b6e6-4df8e46b2b2a to disappear
Oct 13 00:53:07.457: INFO: Pod pod-configmaps-fea6763b-5dcf-4b3a-b6e6-4df8e46b2b2a no longer exists
[AfterEach] [sig-node] ConfigMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:15.277 seconds]
[sig-node] ConfigMap
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should be consumable via the environment [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] ConfigMap should be consumable via the environment [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":6,"failed":0}

SSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:08.210: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 30 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:53:08.613: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "custom-resource-definition-6617" for this suite.

•
------------------------------
{"msg":"PASSED [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition getting/updating/patching custom resource definition status sub-resource works  [Conformance]","total":-1,"completed":2,"skipped":25,"failed":0}

SS
------------------------------
[BeforeEach] [sig-node] AppArmor
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 87 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:53:09.227: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "replication-controller-156" for this suite.

•
------------------------------
{"msg":"PASSED [sig-apps] ReplicationController should release no longer matching pods [Conformance]","total":-1,"completed":2,"skipped":20,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:09.734: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 39 lines ...
• [SLOW TEST:14.603 seconds]
[sig-api-machinery] ResourceQuota
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should create a ResourceQuota and capture the life of a replica set. [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a replica set. [Conformance]","total":-1,"completed":1,"skipped":6,"failed":0}

SS
------------------------------
[BeforeEach] [sig-storage] Volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 29 lines ...
Oct 13 00:53:05.702: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename emptydir
STEP: Waiting for a default service account to be provisioned in namespace
[It] volume on tmpfs should have the correct mode [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test emptydir volume type on tmpfs
Oct 13 00:53:07.161: INFO: Waiting up to 5m0s for pod "pod-b2bd7749-a171-4760-b240-e26c9cc9b3f2" in namespace "emptydir-6551" to be "Succeeded or Failed"
Oct 13 00:53:07.398: INFO: Pod "pod-b2bd7749-a171-4760-b240-e26c9cc9b3f2": Phase="Pending", Reason="", readiness=false. Elapsed: 236.701164ms
Oct 13 00:53:09.635: INFO: Pod "pod-b2bd7749-a171-4760-b240-e26c9cc9b3f2": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.473560015s
STEP: Saw pod success
Oct 13 00:53:09.635: INFO: Pod "pod-b2bd7749-a171-4760-b240-e26c9cc9b3f2" satisfied condition "Succeeded or Failed"
Oct 13 00:53:09.871: INFO: Trying to get logs from node ip-172-20-55-159.ap-southeast-1.compute.internal pod pod-b2bd7749-a171-4760-b240-e26c9cc9b3f2 container test-container: <nil>
STEP: delete the pod
Oct 13 00:53:10.393: INFO: Waiting for pod pod-b2bd7749-a171-4760-b240-e26c9cc9b3f2 to disappear
Oct 13 00:53:10.630: INFO: Pod pod-b2bd7749-a171-4760-b240-e26c9cc9b3f2 no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:5.417 seconds]
[sig-storage] EmptyDir volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  volume on tmpfs should have the correct mode [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes volume on tmpfs should have the correct mode [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":10,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:11.129: INFO: Only supported for providers [gce gke] (not aws)
[AfterEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 90 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: local][LocalVolumeType: dir]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (delayed binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Driver local doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
... skipping 58 lines ...
• [SLOW TEST:16.349 seconds]
[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should not be able to mutate or prevent deletion of webhook configuration objects [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should not be able to mutate or prevent deletion of webhook configuration objects [Conformance]","total":-1,"completed":2,"skipped":2,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:11.944: INFO: Only supported for providers [openstack] (not aws)
[AfterEach] [Testpattern: Dynamic PV (default fs)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 52 lines ...
• [SLOW TEST:19.169 seconds]
[sig-network] Services
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/common/framework.go:23
  should release NodePorts on delete
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:1561
------------------------------
{"msg":"PASSED [sig-network] Services should release NodePorts on delete","total":-1,"completed":1,"skipped":5,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:12.089: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 57 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:53:12.343: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "kubectl-758" for this suite.

•
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Proxy server should support --unix-socket=/path  [Conformance]","total":-1,"completed":2,"skipped":28,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] capacity
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:12.848: INFO: Only supported for providers [gce gke] (not aws)
[AfterEach] [Testpattern: Dynamic PV (default fs)] capacity
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 28 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:53:12.660: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "discovery-3977" for this suite.

•
------------------------------
{"msg":"PASSED [sig-api-machinery] Discovery Custom resource should have storage version hash","total":-1,"completed":3,"skipped":24,"failed":0}

SSSSSSSSS
------------------------------
[BeforeEach] [sig-api-machinery] client-go should negotiate
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 43 lines ...
• [SLOW TEST:21.724 seconds]
[sig-node] PrivilegedPod [NodeConformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should enable privileged commands [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/privileged.go:49
------------------------------
{"msg":"PASSED [sig-api-machinery] client-go should negotiate watch and report errors with accept \"application/vnd.kubernetes.protobuf,application/json\"","total":-1,"completed":3,"skipped":29,"failed":0}
[BeforeEach] [sig-api-machinery] Server request timeout
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:53:13.877: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename request-timeout
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 3 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:53:15.398: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "request-timeout-8274" for this suite.

•
------------------------------
{"msg":"PASSED [sig-api-machinery] Server request timeout should return HTTP status code 400 if the user specifies an invalid timeout in the request URL","total":-1,"completed":4,"skipped":29,"failed":0}

SS
------------------------------
[BeforeEach] [sig-node] Pods
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 18 lines ...
STEP: getting the Pod and ensuring that it's patched
STEP: getting the PodStatus
STEP: replacing the Pod's status Ready condition to False
STEP: check the Pod again to ensure its Ready conditions are False
STEP: deleting the Pod via a Collection with a LabelSelector
STEP: watching for the Pod to be deleted
Oct 13 00:53:04.839: INFO: observed event type ERROR
Oct 13 00:53:04.839: FAIL: failed to see DELETED event
Unexpected error:
    <*errors.errorString | 0xc00051f480>: {
        s: "watch closed before UntilWithoutRetry timeout",
    }
    watch closed before UntilWithoutRetry timeout
occurred

... skipping 193 lines ...
• Failure [23.148 seconds]
[sig-node] Pods
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should run through the lifecycle of Pods and PodStatus [Conformance] [It]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630

  Oct 13 00:53:04.839: failed to see DELETED event
  Unexpected error:
      <*errors.errorString | 0xc00051f480>: {
          s: "watch closed before UntilWithoutRetry timeout",
      }
      watch closed before UntilWithoutRetry timeout
  occurred

  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/pods.go:1045
------------------------------
{"msg":"FAILED [sig-node] Pods should run through the lifecycle of Pods and PodStatus [Conformance]","total":-1,"completed":0,"skipped":4,"failed":1,"failures":["[sig-node] Pods should run through the lifecycle of Pods and PodStatus [Conformance]"]}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:16.011: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 93 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: vsphere]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (delayed binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Only supported for providers [vsphere] (not aws)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:1437
------------------------------
... skipping 148 lines ...
[AfterEach] [sig-api-machinery] client-go should negotiate
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:53:18.746: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready

•
------------------------------
{"msg":"PASSED [sig-api-machinery] client-go should negotiate watch and report errors with accept \"application/json,application/vnd.kubernetes.protobuf\"","total":-1,"completed":1,"skipped":4,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:18.995: INFO: Driver "local" does not provide raw block - skipping
[AfterEach] [Testpattern: Pre-provisioned PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 64 lines ...
Oct 13 00:53:15.904: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename emptydir
STEP: Waiting for a default service account to be provisioned in namespace
[It] should support (non-root,0666,default) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test emptydir 0666 on node default medium
Oct 13 00:53:17.377: INFO: Waiting up to 5m0s for pod "pod-acb7ecdd-00be-4b30-86ba-b1a28ac6549d" in namespace "emptydir-3699" to be "Succeeded or Failed"
Oct 13 00:53:17.620: INFO: Pod "pod-acb7ecdd-00be-4b30-86ba-b1a28ac6549d": Phase="Pending", Reason="", readiness=false. Elapsed: 243.61862ms
Oct 13 00:53:19.869: INFO: Pod "pod-acb7ecdd-00be-4b30-86ba-b1a28ac6549d": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.491963556s
STEP: Saw pod success
Oct 13 00:53:19.869: INFO: Pod "pod-acb7ecdd-00be-4b30-86ba-b1a28ac6549d" satisfied condition "Succeeded or Failed"
Oct 13 00:53:20.112: INFO: Trying to get logs from node ip-172-20-55-159.ap-southeast-1.compute.internal pod pod-acb7ecdd-00be-4b30-86ba-b1a28ac6549d container test-container: <nil>
STEP: delete the pod
Oct 13 00:53:20.611: INFO: Waiting for pod pod-acb7ecdd-00be-4b30-86ba-b1a28ac6549d to disappear
Oct 13 00:53:20.892: INFO: Pod pod-acb7ecdd-00be-4b30-86ba-b1a28ac6549d no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:5.481 seconds]
[sig-storage] EmptyDir volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should support (non-root,0666,default) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes should support (non-root,0666,default) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":31,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:21.395: INFO: Driver local doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 94 lines ...
• [SLOW TEST:13.993 seconds]
[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should mutate custom resource with pruning [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource with pruning [Conformance]","total":-1,"completed":2,"skipped":23,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:21.605: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 77 lines ...
Oct 13 00:53:16.133: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename emptydir
STEP: Waiting for a default service account to be provisioned in namespace
[It] should support (root,0777,default) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test emptydir 0777 on node default medium
Oct 13 00:53:17.568: INFO: Waiting up to 5m0s for pod "pod-c947a52e-c299-4681-be0d-509b5f121b36" in namespace "emptydir-1711" to be "Succeeded or Failed"
Oct 13 00:53:17.804: INFO: Pod "pod-c947a52e-c299-4681-be0d-509b5f121b36": Phase="Pending", Reason="", readiness=false. Elapsed: 235.754603ms
Oct 13 00:53:20.041: INFO: Pod "pod-c947a52e-c299-4681-be0d-509b5f121b36": Phase="Pending", Reason="", readiness=false. Elapsed: 2.473647036s
Oct 13 00:53:22.279: INFO: Pod "pod-c947a52e-c299-4681-be0d-509b5f121b36": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.711018351s
STEP: Saw pod success
Oct 13 00:53:22.279: INFO: Pod "pod-c947a52e-c299-4681-be0d-509b5f121b36" satisfied condition "Succeeded or Failed"
Oct 13 00:53:22.515: INFO: Trying to get logs from node ip-172-20-48-187.ap-southeast-1.compute.internal pod pod-c947a52e-c299-4681-be0d-509b5f121b36 container test-container: <nil>
STEP: delete the pod
Oct 13 00:53:22.995: INFO: Waiting for pod pod-c947a52e-c299-4681-be0d-509b5f121b36 to disappear
Oct 13 00:53:23.232: INFO: Pod pod-c947a52e-c299-4681-be0d-509b5f121b36 no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:7.572 seconds]
[sig-storage] EmptyDir volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should support (root,0777,default) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes should support (root,0777,default) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":1,"skipped":30,"failed":1,"failures":["[sig-node] Pods should run through the lifecycle of Pods and PodStatus [Conformance]"]}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
... skipping 55 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should not mount / map unused volumes in a pod [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:351
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":-1,"completed":1,"skipped":7,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:25.024: INFO: Driver hostPath doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 85 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:192
    Two pods mounting a local volume one after the other
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:254
      should be able to write from pod1 and read from pod2
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:255
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: tmpfs] Two pods mounting a local volume one after the other should be able to write from pod1 and read from pod2","total":-1,"completed":1,"skipped":1,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:25.308: INFO: Driver emptydir doesn't support DynamicPV -- skipping
... skipping 70 lines ...
[sig-storage] CSI Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: csi-hostpath]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_volumes.go:40
    [Testpattern: Dynamic PV (delayed binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Driver "csi-hostpath" does not support topology - skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:92
------------------------------
... skipping 136 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:192
    Two pods mounting a local volume one after the other
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:254
      should be able to write from pod1 and read from pod2
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:255
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: dir-bindmounted] Two pods mounting a local volume one after the other should be able to write from pod1 and read from pod2","total":-1,"completed":1,"skipped":28,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:31.244: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 14 lines ...
      Driver local doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
S
------------------------------
{"msg":"PASSED [sig-network] Services should create endpoints for unready pods","total":-1,"completed":1,"skipped":0,"failed":0}
[BeforeEach] [sig-storage] ConfigMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:53:21.922: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename configmap
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating configMap with name configmap-test-volume-0f3d63e7-4194-4ba9-9b54-fb96f1e16caf
STEP: Creating a pod to test consume configMaps
Oct 13 00:53:23.607: INFO: Waiting up to 5m0s for pod "pod-configmaps-d95f09f4-54ad-492b-a08e-2060839dad35" in namespace "configmap-5621" to be "Succeeded or Failed"
Oct 13 00:53:23.846: INFO: Pod "pod-configmaps-d95f09f4-54ad-492b-a08e-2060839dad35": Phase="Pending", Reason="", readiness=false. Elapsed: 239.198113ms
Oct 13 00:53:26.085: INFO: Pod "pod-configmaps-d95f09f4-54ad-492b-a08e-2060839dad35": Phase="Pending", Reason="", readiness=false. Elapsed: 2.478838453s
Oct 13 00:53:28.325: INFO: Pod "pod-configmaps-d95f09f4-54ad-492b-a08e-2060839dad35": Phase="Pending", Reason="", readiness=false. Elapsed: 4.718369511s
Oct 13 00:53:30.566: INFO: Pod "pod-configmaps-d95f09f4-54ad-492b-a08e-2060839dad35": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.959186625s
STEP: Saw pod success
Oct 13 00:53:30.566: INFO: Pod "pod-configmaps-d95f09f4-54ad-492b-a08e-2060839dad35" satisfied condition "Succeeded or Failed"
Oct 13 00:53:30.805: INFO: Trying to get logs from node ip-172-20-55-159.ap-southeast-1.compute.internal pod pod-configmaps-d95f09f4-54ad-492b-a08e-2060839dad35 container agnhost-container: <nil>
STEP: delete the pod
Oct 13 00:53:31.302: INFO: Waiting for pod pod-configmaps-d95f09f4-54ad-492b-a08e-2060839dad35 to disappear
Oct 13 00:53:31.541: INFO: Pod pod-configmaps-d95f09f4-54ad-492b-a08e-2060839dad35 no longer exists
[AfterEach] [sig-storage] ConfigMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:10.097 seconds]
[sig-storage] ConfigMap
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] ConfigMap should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":0,"failed":0}

SSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:32.054: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 30 lines ...
STEP: creating the pod
STEP: setting up selector
STEP: submitting the pod to kubernetes
STEP: verifying the pod is in kubernetes
STEP: deleting the pod gracefully
STEP: verifying the kubelet observed the termination notice
Oct 13 00:53:16.861: INFO: start=2021-10-13 00:53:11.362394587 +0000 UTC m=+31.226743184, now=2021-10-13 00:53:16.861941447 +0000 UTC m=+36.726290063, kubelet pod: {"metadata":{"name":"pod-submit-remove-f52c20ea-3515-4d1a-9162-17267cca7d31","namespace":"pods-2313","uid":"aaf0a20d-f43f-4c97-a390-da27fdd45ef9","resourceVersion":"1586","creationTimestamp":"2021-10-13T00:52:57Z","deletionTimestamp":"2021-10-13T00:53:41Z","deletionGracePeriodSeconds":30,"labels":{"name":"foo","time":"612019998"},"annotations":{"kubernetes.io/config.seen":"2021-10-13T00:52:58.000490762Z","kubernetes.io/config.source":"api"},"managedFields":[{"manager":"e2e.test","operation":"Update","apiVersion":"v1","time":"2021-10-13T00:52:57Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:labels":{".":{},"f:name":{},"f:time":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"agnhost-container\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}]},"spec":{"volumes":[{"name":"kube-api-access-zqfs5","projected":{"sources":[{"serviceAccountToken":{"expirationSeconds":3607,"path":"token"}},{"configMap":{"name":"kube-root-ca.crt","items":[{"key":"ca.crt","path":"ca.crt"}]}},{"downwardAPI":{"items":[{"path":"namespace","fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}]}}],"defaultMode":420}}],"containers":[{"name":"agnhost-container","image":"k8s.gcr.io/e2e-test-images/agnhost:2.32","args":["pause"],"resources":{},"volumeMounts":[{"name":"kube-api-access-zqfs5","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{}}],"restartPolicy":"Always","terminationGracePeriodSeconds":0,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-172-20-37-188.ap-southeast-1.compute.internal","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true,"preemptionPolicy":"PreemptLowerPriority"},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2021-10-13T00:52:58Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2021-10-13T00:53:13Z","reason":"ContainersNotReady","message":"containers with unready status: [agnhost-container]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2021-10-13T00:53:13Z","reason":"ContainersNotReady","message":"containers with unready status: [agnhost-container]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2021-10-13T00:52:57Z"}],"hostIP":"172.20.37.188","podIP":"100.96.3.7","podIPs":[{"ip":"100.96.3.7"}],"startTime":"2021-10-13T00:52:58Z","containerStatuses":[{"name":"agnhost-container","state":{"terminated":{"exitCode":2,"reason":"Error","startedAt":"2021-10-13T00:53:07Z","finishedAt":"2021-10-13T00:53:12Z","containerID":"docker://f144adcf2ab8b6301d5f89b6723c3d6c03ed883dcc44c47b9891b9cc38a2ee8e"}},"lastState":{},"ready":false,"restartCount":0,"image":"k8s.gcr.io/e2e-test-images/agnhost:2.32","imageID":"docker-pullable://k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1","containerID":"docker://f144adcf2ab8b6301d5f89b6723c3d6c03ed883dcc44c47b9891b9cc38a2ee8e","started":false}],"qosClass":"BestEffort"}}
Oct 13 00:53:21.616: INFO: start=2021-10-13 00:53:11.362394587 +0000 UTC m=+31.226743184, now=2021-10-13 00:53:21.616053556 +0000 UTC m=+41.480402162, kubelet pod: {"metadata":{"name":"pod-submit-remove-f52c20ea-3515-4d1a-9162-17267cca7d31","namespace":"pods-2313","uid":"aaf0a20d-f43f-4c97-a390-da27fdd45ef9","resourceVersion":"1586","creationTimestamp":"2021-10-13T00:52:57Z","deletionTimestamp":"2021-10-13T00:53:41Z","deletionGracePeriodSeconds":30,"labels":{"name":"foo","time":"612019998"},"annotations":{"kubernetes.io/config.seen":"2021-10-13T00:52:58.000490762Z","kubernetes.io/config.source":"api"},"managedFields":[{"manager":"e2e.test","operation":"Update","apiVersion":"v1","time":"2021-10-13T00:52:57Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:labels":{".":{},"f:name":{},"f:time":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"agnhost-container\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}]},"spec":{"volumes":[{"name":"kube-api-access-zqfs5","projected":{"sources":[{"serviceAccountToken":{"expirationSeconds":3607,"path":"token"}},{"configMap":{"name":"kube-root-ca.crt","items":[{"key":"ca.crt","path":"ca.crt"}]}},{"downwardAPI":{"items":[{"path":"namespace","fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}]}}],"defaultMode":420}}],"containers":[{"name":"agnhost-container","image":"k8s.gcr.io/e2e-test-images/agnhost:2.32","args":["pause"],"resources":{},"volumeMounts":[{"name":"kube-api-access-zqfs5","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{}}],"restartPolicy":"Always","terminationGracePeriodSeconds":0,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-172-20-37-188.ap-southeast-1.compute.internal","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true,"preemptionPolicy":"PreemptLowerPriority"},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2021-10-13T00:52:58Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2021-10-13T00:53:13Z","reason":"ContainersNotReady","message":"containers with unready status: [agnhost-container]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2021-10-13T00:53:13Z","reason":"ContainersNotReady","message":"containers with unready status: [agnhost-container]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2021-10-13T00:52:57Z"}],"hostIP":"172.20.37.188","podIP":"100.96.3.7","podIPs":[{"ip":"100.96.3.7"}],"startTime":"2021-10-13T00:52:58Z","containerStatuses":[{"name":"agnhost-container","state":{"terminated":{"exitCode":2,"reason":"Error","startedAt":"2021-10-13T00:53:07Z","finishedAt":"2021-10-13T00:53:12Z","containerID":"docker://f144adcf2ab8b6301d5f89b6723c3d6c03ed883dcc44c47b9891b9cc38a2ee8e"}},"lastState":{},"ready":false,"restartCount":0,"image":"k8s.gcr.io/e2e-test-images/agnhost:2.32","imageID":"docker-pullable://k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1","containerID":"docker://f144adcf2ab8b6301d5f89b6723c3d6c03ed883dcc44c47b9891b9cc38a2ee8e","started":false}],"qosClass":"BestEffort"}}
Oct 13 00:53:26.615: INFO: start=2021-10-13 00:53:11.362394587 +0000 UTC m=+31.226743184, now=2021-10-13 00:53:26.615552306 +0000 UTC m=+46.479900914, kubelet pod: {"metadata":{"name":"pod-submit-remove-f52c20ea-3515-4d1a-9162-17267cca7d31","namespace":"pods-2313","uid":"aaf0a20d-f43f-4c97-a390-da27fdd45ef9","resourceVersion":"1586","creationTimestamp":"2021-10-13T00:52:57Z","deletionTimestamp":"2021-10-13T00:53:41Z","deletionGracePeriodSeconds":30,"labels":{"name":"foo","time":"612019998"},"annotations":{"kubernetes.io/config.seen":"2021-10-13T00:52:58.000490762Z","kubernetes.io/config.source":"api"},"managedFields":[{"manager":"e2e.test","operation":"Update","apiVersion":"v1","time":"2021-10-13T00:52:57Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:labels":{".":{},"f:name":{},"f:time":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"agnhost-container\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}]},"spec":{"volumes":[{"name":"kube-api-access-zqfs5","projected":{"sources":[{"serviceAccountToken":{"expirationSeconds":3607,"path":"token"}},{"configMap":{"name":"kube-root-ca.crt","items":[{"key":"ca.crt","path":"ca.crt"}]}},{"downwardAPI":{"items":[{"path":"namespace","fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}]}}],"defaultMode":420}}],"containers":[{"name":"agnhost-container","image":"k8s.gcr.io/e2e-test-images/agnhost:2.32","args":["pause"],"resources":{},"volumeMounts":[{"name":"kube-api-access-zqfs5","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{}}],"restartPolicy":"Always","terminationGracePeriodSeconds":0,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-172-20-37-188.ap-southeast-1.compute.internal","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true,"preemptionPolicy":"PreemptLowerPriority"},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2021-10-13T00:52:58Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2021-10-13T00:53:13Z","reason":"ContainersNotReady","message":"containers with unready status: [agnhost-container]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2021-10-13T00:53:13Z","reason":"ContainersNotReady","message":"containers with unready status: [agnhost-container]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2021-10-13T00:52:57Z"}],"hostIP":"172.20.37.188","podIP":"100.96.3.7","podIPs":[{"ip":"100.96.3.7"}],"startTime":"2021-10-13T00:52:58Z","containerStatuses":[{"name":"agnhost-container","state":{"terminated":{"exitCode":2,"reason":"Error","startedAt":"2021-10-13T00:53:07Z","finishedAt":"2021-10-13T00:53:12Z","containerID":"docker://f144adcf2ab8b6301d5f89b6723c3d6c03ed883dcc44c47b9891b9cc38a2ee8e"}},"lastState":{},"ready":false,"restartCount":0,"image":"k8s.gcr.io/e2e-test-images/agnhost:2.32","imageID":"docker-pullable://k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1","containerID":"docker://f144adcf2ab8b6301d5f89b6723c3d6c03ed883dcc44c47b9891b9cc38a2ee8e","started":false}],"qosClass":"BestEffort"}}
Oct 13 00:53:31.629: INFO: no pod exists with the name we were looking for, assuming the termination request was observed and completed
[AfterEach] [sig-node] Pods Extended
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:53:31.872: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "pods-2313" for this suite.

... skipping 3 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/framework.go:23
  Delete Grace Period
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pods.go:51
    should be submitted and removed
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/pods.go:62
------------------------------
{"msg":"PASSED [sig-node] Pods Extended Delete Grace Period should be submitted and removed","total":-1,"completed":1,"skipped":14,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:32.385: INFO: Only supported for providers [gce gke] (not aws)
... skipping 67 lines ...
Oct 13 00:53:17.325: INFO: PersistentVolumeClaim pvc-9j7ws found but phase is Pending instead of Bound.
Oct 13 00:53:19.569: INFO: PersistentVolumeClaim pvc-9j7ws found and phase=Bound (13.697287426s)
Oct 13 00:53:19.569: INFO: Waiting up to 3m0s for PersistentVolume local-czkvj to have phase Bound
Oct 13 00:53:19.810: INFO: PersistentVolume local-czkvj found and phase=Bound (240.279847ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-7zxl
STEP: Creating a pod to test subpath
Oct 13 00:53:20.530: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-7zxl" in namespace "provisioning-9543" to be "Succeeded or Failed"
Oct 13 00:53:20.772: INFO: Pod "pod-subpath-test-preprovisionedpv-7zxl": Phase="Pending", Reason="", readiness=false. Elapsed: 241.423933ms
Oct 13 00:53:23.012: INFO: Pod "pod-subpath-test-preprovisionedpv-7zxl": Phase="Pending", Reason="", readiness=false. Elapsed: 2.481638826s
Oct 13 00:53:25.255: INFO: Pod "pod-subpath-test-preprovisionedpv-7zxl": Phase="Pending", Reason="", readiness=false. Elapsed: 4.724110505s
Oct 13 00:53:27.496: INFO: Pod "pod-subpath-test-preprovisionedpv-7zxl": Phase="Pending", Reason="", readiness=false. Elapsed: 6.965125173s
Oct 13 00:53:29.738: INFO: Pod "pod-subpath-test-preprovisionedpv-7zxl": Phase="Succeeded", Reason="", readiness=false. Elapsed: 9.207149728s
STEP: Saw pod success
Oct 13 00:53:29.738: INFO: Pod "pod-subpath-test-preprovisionedpv-7zxl" satisfied condition "Succeeded or Failed"
Oct 13 00:53:29.977: INFO: Trying to get logs from node ip-172-20-55-159.ap-southeast-1.compute.internal pod pod-subpath-test-preprovisionedpv-7zxl container test-container-subpath-preprovisionedpv-7zxl: <nil>
STEP: delete the pod
Oct 13 00:53:30.483: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-7zxl to disappear
Oct 13 00:53:30.722: INFO: Pod pod-subpath-test-preprovisionedpv-7zxl no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-7zxl
Oct 13 00:53:30.723: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-7zxl" in namespace "provisioning-9543"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support readOnly file specified in the volumeMount [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:384
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link-bindmounted] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]","total":-1,"completed":1,"skipped":1,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:34.021: INFO: Driver hostPathSymlink doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 106 lines ...
Oct 13 00:53:17.346: INFO: PersistentVolumeClaim pvc-zq722 found but phase is Pending instead of Bound.
Oct 13 00:53:19.614: INFO: PersistentVolumeClaim pvc-zq722 found and phase=Bound (13.747539199s)
Oct 13 00:53:19.615: INFO: Waiting up to 3m0s for PersistentVolume local-8zmz6 to have phase Bound
Oct 13 00:53:19.865: INFO: PersistentVolume local-8zmz6 found and phase=Bound (250.832089ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-cbsr
STEP: Creating a pod to test subpath
Oct 13 00:53:20.600: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-cbsr" in namespace "provisioning-8505" to be "Succeeded or Failed"
Oct 13 00:53:20.847: INFO: Pod "pod-subpath-test-preprovisionedpv-cbsr": Phase="Pending", Reason="", readiness=false. Elapsed: 247.164164ms
Oct 13 00:53:23.091: INFO: Pod "pod-subpath-test-preprovisionedpv-cbsr": Phase="Pending", Reason="", readiness=false. Elapsed: 2.491577686s
Oct 13 00:53:25.337: INFO: Pod "pod-subpath-test-preprovisionedpv-cbsr": Phase="Pending", Reason="", readiness=false. Elapsed: 4.737036035s
Oct 13 00:53:27.583: INFO: Pod "pod-subpath-test-preprovisionedpv-cbsr": Phase="Pending", Reason="", readiness=false. Elapsed: 6.983180555s
Oct 13 00:53:29.846: INFO: Pod "pod-subpath-test-preprovisionedpv-cbsr": Phase="Succeeded", Reason="", readiness=false. Elapsed: 9.246595497s
STEP: Saw pod success
Oct 13 00:53:29.846: INFO: Pod "pod-subpath-test-preprovisionedpv-cbsr" satisfied condition "Succeeded or Failed"
Oct 13 00:53:30.091: INFO: Trying to get logs from node ip-172-20-48-187.ap-southeast-1.compute.internal pod pod-subpath-test-preprovisionedpv-cbsr container test-container-volume-preprovisionedpv-cbsr: <nil>
STEP: delete the pod
Oct 13 00:53:30.615: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-cbsr to disappear
Oct 13 00:53:30.860: INFO: Pod pod-subpath-test-preprovisionedpv-cbsr no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-cbsr
Oct 13 00:53:30.860: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-cbsr" in namespace "provisioning-8505"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support non-existent path
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:194
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link-bindmounted] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path","total":-1,"completed":1,"skipped":2,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:34.462: INFO: Only supported for providers [vsphere] (not aws)
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 87 lines ...
Oct 13 00:53:25.350: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename emptydir
STEP: Waiting for a default service account to be provisioned in namespace
[It] should support (non-root,0666,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test emptydir 0666 on tmpfs
Oct 13 00:53:26.795: INFO: Waiting up to 5m0s for pod "pod-8c93db1b-57e0-4f68-bf6f-d83d323558e5" in namespace "emptydir-1800" to be "Succeeded or Failed"
Oct 13 00:53:27.036: INFO: Pod "pod-8c93db1b-57e0-4f68-bf6f-d83d323558e5": Phase="Pending", Reason="", readiness=false. Elapsed: 240.340103ms
Oct 13 00:53:29.276: INFO: Pod "pod-8c93db1b-57e0-4f68-bf6f-d83d323558e5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.481044344s
Oct 13 00:53:31.516: INFO: Pod "pod-8c93db1b-57e0-4f68-bf6f-d83d323558e5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.720975395s
Oct 13 00:53:33.757: INFO: Pod "pod-8c93db1b-57e0-4f68-bf6f-d83d323558e5": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.961601198s
STEP: Saw pod success
Oct 13 00:53:33.757: INFO: Pod "pod-8c93db1b-57e0-4f68-bf6f-d83d323558e5" satisfied condition "Succeeded or Failed"
Oct 13 00:53:33.997: INFO: Trying to get logs from node ip-172-20-55-159.ap-southeast-1.compute.internal pod pod-8c93db1b-57e0-4f68-bf6f-d83d323558e5 container test-container: <nil>
STEP: delete the pod
Oct 13 00:53:34.484: INFO: Waiting for pod pod-8c93db1b-57e0-4f68-bf6f-d83d323558e5 to disappear
Oct 13 00:53:34.726: INFO: Pod pod-8c93db1b-57e0-4f68-bf6f-d83d323558e5 no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 33 lines ...
Oct 13 00:53:16.643: INFO: PersistentVolumeClaim pvc-5kfk2 found but phase is Pending instead of Bound.
Oct 13 00:53:18.886: INFO: PersistentVolumeClaim pvc-5kfk2 found and phase=Bound (6.985592703s)
Oct 13 00:53:18.886: INFO: Waiting up to 3m0s for PersistentVolume local-x68mg to have phase Bound
Oct 13 00:53:19.127: INFO: PersistentVolume local-x68mg found and phase=Bound (241.080964ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-t5h8
STEP: Creating a pod to test subpath
Oct 13 00:53:19.875: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-t5h8" in namespace "provisioning-3135" to be "Succeeded or Failed"
Oct 13 00:53:20.116: INFO: Pod "pod-subpath-test-preprovisionedpv-t5h8": Phase="Pending", Reason="", readiness=false. Elapsed: 241.267274ms
Oct 13 00:53:22.357: INFO: Pod "pod-subpath-test-preprovisionedpv-t5h8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.482700467s
Oct 13 00:53:24.599: INFO: Pod "pod-subpath-test-preprovisionedpv-t5h8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.724408264s
Oct 13 00:53:26.842: INFO: Pod "pod-subpath-test-preprovisionedpv-t5h8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.966969889s
Oct 13 00:53:29.083: INFO: Pod "pod-subpath-test-preprovisionedpv-t5h8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 9.208735868s
STEP: Saw pod success
Oct 13 00:53:29.083: INFO: Pod "pod-subpath-test-preprovisionedpv-t5h8" satisfied condition "Succeeded or Failed"
Oct 13 00:53:29.325: INFO: Trying to get logs from node ip-172-20-48-187.ap-southeast-1.compute.internal pod pod-subpath-test-preprovisionedpv-t5h8 container test-container-volume-preprovisionedpv-t5h8: <nil>
STEP: delete the pod
Oct 13 00:53:29.847: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-t5h8 to disappear
Oct 13 00:53:30.089: INFO: Pod pod-subpath-test-preprovisionedpv-t5h8 no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-t5h8
Oct 13 00:53:30.089: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-t5h8" in namespace "provisioning-3135"
... skipping 24 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support non-existent path
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:194
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: block] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path","total":-1,"completed":1,"skipped":20,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:36.596: INFO: Driver hostPath doesn't support DynamicPV -- skipping
... skipping 150 lines ...
• [SLOW TEST:44.670 seconds]
[sig-network] Services
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/common/framework.go:23
  should have session affinity work for NodePort service [LinuxOnly] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-network] Services should have session affinity work for NodePort service [LinuxOnly] [Conformance]","total":-1,"completed":1,"skipped":0,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
... skipping 26 lines ...
Oct 13 00:53:16.180: INFO: PersistentVolumeClaim pvc-r7jw8 found but phase is Pending instead of Bound.
Oct 13 00:53:18.416: INFO: PersistentVolumeClaim pvc-r7jw8 found and phase=Bound (9.182168983s)
Oct 13 00:53:18.416: INFO: Waiting up to 3m0s for PersistentVolume local-mbn5g to have phase Bound
Oct 13 00:53:18.651: INFO: PersistentVolume local-mbn5g found and phase=Bound (235.081487ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-km7z
STEP: Creating a pod to test subpath
Oct 13 00:53:19.363: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-km7z" in namespace "provisioning-4137" to be "Succeeded or Failed"
Oct 13 00:53:19.619: INFO: Pod "pod-subpath-test-preprovisionedpv-km7z": Phase="Pending", Reason="", readiness=false. Elapsed: 256.190969ms
Oct 13 00:53:21.858: INFO: Pod "pod-subpath-test-preprovisionedpv-km7z": Phase="Pending", Reason="", readiness=false. Elapsed: 2.495155504s
Oct 13 00:53:24.095: INFO: Pod "pod-subpath-test-preprovisionedpv-km7z": Phase="Pending", Reason="", readiness=false. Elapsed: 4.731665292s
Oct 13 00:53:26.330: INFO: Pod "pod-subpath-test-preprovisionedpv-km7z": Phase="Pending", Reason="", readiness=false. Elapsed: 6.967024111s
Oct 13 00:53:28.567: INFO: Pod "pod-subpath-test-preprovisionedpv-km7z": Phase="Pending", Reason="", readiness=false. Elapsed: 9.203706973s
Oct 13 00:53:30.802: INFO: Pod "pod-subpath-test-preprovisionedpv-km7z": Phase="Succeeded", Reason="", readiness=false. Elapsed: 11.439113603s
STEP: Saw pod success
Oct 13 00:53:30.802: INFO: Pod "pod-subpath-test-preprovisionedpv-km7z" satisfied condition "Succeeded or Failed"
Oct 13 00:53:31.039: INFO: Trying to get logs from node ip-172-20-48-187.ap-southeast-1.compute.internal pod pod-subpath-test-preprovisionedpv-km7z container test-container-volume-preprovisionedpv-km7z: <nil>
STEP: delete the pod
Oct 13 00:53:31.540: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-km7z to disappear
Oct 13 00:53:31.775: INFO: Pod pod-subpath-test-preprovisionedpv-km7z no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-km7z
Oct 13 00:53:31.775: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-km7z" in namespace "provisioning-4137"
... skipping 26 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support non-existent path
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:194
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: blockfs] [Testpattern: Pre-provisioned PV (default fs)] subPath should support non-existent path","total":-1,"completed":1,"skipped":7,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:39.988: INFO: Driver hostPathSymlink doesn't support PreprovisionedPV -- skipping
... skipping 115 lines ...
• [SLOW TEST:21.098 seconds]
[sig-api-machinery] ResourceQuota
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should verify ResourceQuota with terminating scopes. [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] ResourceQuota should verify ResourceQuota with terminating scopes. [Conformance]","total":-1,"completed":2,"skipped":11,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:40.137: INFO: Driver local doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (block volmode)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 63 lines ...
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196

      Driver "hostPath" does not support exec - skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:106
------------------------------
{"msg":"PASSED [sig-node] PrivilegedPod [NodeConformance] should enable privileged commands [LinuxOnly]","total":-1,"completed":1,"skipped":12,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:53:14.699: INFO: >>> kubeConfig: /root/.kube/config
... skipping 17 lines ...
Oct 13 00:53:32.501: INFO: PersistentVolumeClaim pvc-vtm45 found but phase is Pending instead of Bound.
Oct 13 00:53:34.745: INFO: PersistentVolumeClaim pvc-vtm45 found and phase=Bound (13.727913872s)
Oct 13 00:53:34.745: INFO: Waiting up to 3m0s for PersistentVolume local-c6qrf to have phase Bound
Oct 13 00:53:34.987: INFO: PersistentVolume local-c6qrf found and phase=Bound (242.682032ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-z9th
STEP: Creating a pod to test subpath
Oct 13 00:53:35.718: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-z9th" in namespace "provisioning-2897" to be "Succeeded or Failed"
Oct 13 00:53:35.962: INFO: Pod "pod-subpath-test-preprovisionedpv-z9th": Phase="Pending", Reason="", readiness=false. Elapsed: 242.966709ms
Oct 13 00:53:38.206: INFO: Pod "pod-subpath-test-preprovisionedpv-z9th": Phase="Pending", Reason="", readiness=false. Elapsed: 2.487411054s
Oct 13 00:53:40.451: INFO: Pod "pod-subpath-test-preprovisionedpv-z9th": Phase="Pending", Reason="", readiness=false. Elapsed: 4.732786528s
Oct 13 00:53:42.696: INFO: Pod "pod-subpath-test-preprovisionedpv-z9th": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.977556884s
STEP: Saw pod success
Oct 13 00:53:42.696: INFO: Pod "pod-subpath-test-preprovisionedpv-z9th" satisfied condition "Succeeded or Failed"
Oct 13 00:53:42.941: INFO: Trying to get logs from node ip-172-20-37-188.ap-southeast-1.compute.internal pod pod-subpath-test-preprovisionedpv-z9th container test-container-subpath-preprovisionedpv-z9th: <nil>
STEP: delete the pod
Oct 13 00:53:43.442: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-z9th to disappear
Oct 13 00:53:43.686: INFO: Pod pod-subpath-test-preprovisionedpv-z9th no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-z9th
Oct 13 00:53:43.686: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-z9th" in namespace "provisioning-2897"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support readOnly directory specified in the volumeMount
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:369
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link-bindmounted] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly directory specified in the volumeMount","total":-1,"completed":2,"skipped":12,"failed":0}

SSSSSSSSSSSS
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes should support (non-root,0666,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":10,"failed":0}
[BeforeEach] [sig-apps] DisruptionController
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:53:35.216: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename disruption
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 16 lines ...
• [SLOW TEST:12.123 seconds]
[sig-apps] DisruptionController
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  evictions: enough pods, absolute => should allow an eviction
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/disruption.go:267
------------------------------
{"msg":"PASSED [sig-apps] DisruptionController evictions: enough pods, absolute =\u003e should allow an eviction","total":-1,"completed":3,"skipped":10,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:47.361: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 119 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:192
    Two pods mounting a local volume at the same time
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:248
      should be able to write from pod1 and read from pod2
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:249
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: block] Two pods mounting a local volume at the same time should be able to write from pod1 and read from pod2","total":-1,"completed":4,"skipped":33,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:47.411: INFO: Driver local doesn't support ext3 -- skipping
... skipping 39 lines ...
Oct 13 00:53:31.514: INFO: PersistentVolumeClaim pvc-29xfj found but phase is Pending instead of Bound.
Oct 13 00:53:33.754: INFO: PersistentVolumeClaim pvc-29xfj found and phase=Bound (2.479530389s)
Oct 13 00:53:33.754: INFO: Waiting up to 3m0s for PersistentVolume local-b9x5s to have phase Bound
Oct 13 00:53:33.993: INFO: PersistentVolume local-b9x5s found and phase=Bound (239.557651ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-sr5x
STEP: Creating a pod to test subpath
Oct 13 00:53:34.716: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-sr5x" in namespace "provisioning-8892" to be "Succeeded or Failed"
Oct 13 00:53:34.956: INFO: Pod "pod-subpath-test-preprovisionedpv-sr5x": Phase="Pending", Reason="", readiness=false. Elapsed: 240.09585ms
Oct 13 00:53:37.200: INFO: Pod "pod-subpath-test-preprovisionedpv-sr5x": Phase="Pending", Reason="", readiness=false. Elapsed: 2.484429682s
Oct 13 00:53:39.440: INFO: Pod "pod-subpath-test-preprovisionedpv-sr5x": Phase="Pending", Reason="", readiness=false. Elapsed: 4.724635753s
Oct 13 00:53:41.684: INFO: Pod "pod-subpath-test-preprovisionedpv-sr5x": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.968424378s
STEP: Saw pod success
Oct 13 00:53:41.684: INFO: Pod "pod-subpath-test-preprovisionedpv-sr5x" satisfied condition "Succeeded or Failed"
Oct 13 00:53:41.924: INFO: Trying to get logs from node ip-172-20-43-74.ap-southeast-1.compute.internal pod pod-subpath-test-preprovisionedpv-sr5x container test-container-subpath-preprovisionedpv-sr5x: <nil>
STEP: delete the pod
Oct 13 00:53:42.413: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-sr5x to disappear
Oct 13 00:53:42.653: INFO: Pod pod-subpath-test-preprovisionedpv-sr5x no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-sr5x
Oct 13 00:53:42.653: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-sr5x" in namespace "provisioning-8892"
... skipping 22 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support readOnly directory specified in the volumeMount
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:369
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: tmpfs] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly directory specified in the volumeMount","total":-1,"completed":2,"skipped":10,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:47.632: INFO: Driver hostPath doesn't support DynamicPV -- skipping
... skipping 28 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: hostPath]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (delayed binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Driver hostPath doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
... skipping 78 lines ...
Oct 13 00:53:22.465: INFO: Unable to read jessie_udp@dns-test-service.dns-2225 from pod dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662: the server could not find the requested resource (get pods dns-test-963b9a8a-5b67-496b-b51e-702136bfa662)
Oct 13 00:53:22.705: INFO: Unable to read jessie_tcp@dns-test-service.dns-2225 from pod dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662: the server could not find the requested resource (get pods dns-test-963b9a8a-5b67-496b-b51e-702136bfa662)
Oct 13 00:53:22.947: INFO: Unable to read jessie_udp@dns-test-service.dns-2225.svc from pod dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662: the server could not find the requested resource (get pods dns-test-963b9a8a-5b67-496b-b51e-702136bfa662)
Oct 13 00:53:23.193: INFO: Unable to read jessie_tcp@dns-test-service.dns-2225.svc from pod dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662: the server could not find the requested resource (get pods dns-test-963b9a8a-5b67-496b-b51e-702136bfa662)
Oct 13 00:53:23.443: INFO: Unable to read jessie_udp@_http._tcp.dns-test-service.dns-2225.svc from pod dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662: the server could not find the requested resource (get pods dns-test-963b9a8a-5b67-496b-b51e-702136bfa662)
Oct 13 00:53:23.683: INFO: Unable to read jessie_tcp@_http._tcp.dns-test-service.dns-2225.svc from pod dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662: the server could not find the requested resource (get pods dns-test-963b9a8a-5b67-496b-b51e-702136bfa662)
Oct 13 00:53:25.146: INFO: Lookups using dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662 failed for: [wheezy_udp@dns-test-service wheezy_tcp@dns-test-service wheezy_udp@dns-test-service.dns-2225 wheezy_tcp@dns-test-service.dns-2225 wheezy_udp@dns-test-service.dns-2225.svc wheezy_tcp@dns-test-service.dns-2225.svc wheezy_udp@_http._tcp.dns-test-service.dns-2225.svc wheezy_tcp@_http._tcp.dns-test-service.dns-2225.svc jessie_udp@dns-test-service jessie_tcp@dns-test-service jessie_udp@dns-test-service.dns-2225 jessie_tcp@dns-test-service.dns-2225 jessie_udp@dns-test-service.dns-2225.svc jessie_tcp@dns-test-service.dns-2225.svc jessie_udp@_http._tcp.dns-test-service.dns-2225.svc jessie_tcp@_http._tcp.dns-test-service.dns-2225.svc]

Oct 13 00:53:30.394: INFO: Unable to read wheezy_udp@dns-test-service from pod dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662: the server could not find the requested resource (get pods dns-test-963b9a8a-5b67-496b-b51e-702136bfa662)
Oct 13 00:53:30.634: INFO: Unable to read wheezy_tcp@dns-test-service from pod dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662: the server could not find the requested resource (get pods dns-test-963b9a8a-5b67-496b-b51e-702136bfa662)
Oct 13 00:53:30.873: INFO: Unable to read wheezy_udp@dns-test-service.dns-2225 from pod dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662: the server could not find the requested resource (get pods dns-test-963b9a8a-5b67-496b-b51e-702136bfa662)
Oct 13 00:53:31.120: INFO: Unable to read wheezy_tcp@dns-test-service.dns-2225 from pod dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662: the server could not find the requested resource (get pods dns-test-963b9a8a-5b67-496b-b51e-702136bfa662)
Oct 13 00:53:31.365: INFO: Unable to read wheezy_udp@dns-test-service.dns-2225.svc from pod dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662: the server could not find the requested resource (get pods dns-test-963b9a8a-5b67-496b-b51e-702136bfa662)
... skipping 3 lines ...
Oct 13 00:53:33.782: INFO: Unable to read jessie_udp@dns-test-service from pod dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662: the server could not find the requested resource (get pods dns-test-963b9a8a-5b67-496b-b51e-702136bfa662)
Oct 13 00:53:34.022: INFO: Unable to read jessie_tcp@dns-test-service from pod dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662: the server could not find the requested resource (get pods dns-test-963b9a8a-5b67-496b-b51e-702136bfa662)
Oct 13 00:53:34.261: INFO: Unable to read jessie_udp@dns-test-service.dns-2225 from pod dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662: the server could not find the requested resource (get pods dns-test-963b9a8a-5b67-496b-b51e-702136bfa662)
Oct 13 00:53:34.982: INFO: Unable to read jessie_tcp@dns-test-service.dns-2225.svc from pod dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662: the server could not find the requested resource (get pods dns-test-963b9a8a-5b67-496b-b51e-702136bfa662)
Oct 13 00:53:35.222: INFO: Unable to read jessie_udp@_http._tcp.dns-test-service.dns-2225.svc from pod dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662: the server could not find the requested resource (get pods dns-test-963b9a8a-5b67-496b-b51e-702136bfa662)
Oct 13 00:53:35.462: INFO: Unable to read jessie_tcp@_http._tcp.dns-test-service.dns-2225.svc from pod dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662: the server could not find the requested resource (get pods dns-test-963b9a8a-5b67-496b-b51e-702136bfa662)
Oct 13 00:53:36.912: INFO: Lookups using dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662 failed for: [wheezy_udp@dns-test-service wheezy_tcp@dns-test-service wheezy_udp@dns-test-service.dns-2225 wheezy_tcp@dns-test-service.dns-2225 wheezy_udp@dns-test-service.dns-2225.svc wheezy_tcp@dns-test-service.dns-2225.svc wheezy_udp@_http._tcp.dns-test-service.dns-2225.svc wheezy_tcp@_http._tcp.dns-test-service.dns-2225.svc jessie_udp@dns-test-service jessie_tcp@dns-test-service jessie_udp@dns-test-service.dns-2225 jessie_tcp@dns-test-service.dns-2225.svc jessie_udp@_http._tcp.dns-test-service.dns-2225.svc jessie_tcp@_http._tcp.dns-test-service.dns-2225.svc]

Oct 13 00:53:46.884: INFO: DNS probes using dns-2225/dns-test-963b9a8a-5b67-496b-b51e-702136bfa662 succeeded

STEP: deleting the pod
STEP: deleting the test service
STEP: deleting the test headless service
... skipping 80 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:192
    Two pods mounting a local volume at the same time
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:248
      should be able to write from pod1 and read from pod2
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:249
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: dir-link] Two pods mounting a local volume at the same time should be able to write from pod1 and read from pod2","total":-1,"completed":3,"skipped":27,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
... skipping 33 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (delayed binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should provision a volume and schedule a pod with AllowedTopologies
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:164
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (delayed binding)] topology should provision a volume and schedule a pod with AllowedTopologies","total":-1,"completed":2,"skipped":13,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:49.061: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 91 lines ...
Oct 13 00:53:31.681: INFO: PersistentVolumeClaim pvc-wwwbn found but phase is Pending instead of Bound.
Oct 13 00:53:33.916: INFO: PersistentVolumeClaim pvc-wwwbn found and phase=Bound (15.895483293s)
Oct 13 00:53:33.916: INFO: Waiting up to 3m0s for PersistentVolume local-9hwld to have phase Bound
Oct 13 00:53:34.150: INFO: PersistentVolume local-9hwld found and phase=Bound (233.759259ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-h9jr
STEP: Creating a pod to test subpath
Oct 13 00:53:34.852: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-h9jr" in namespace "provisioning-9483" to be "Succeeded or Failed"
Oct 13 00:53:35.086: INFO: Pod "pod-subpath-test-preprovisionedpv-h9jr": Phase="Pending", Reason="", readiness=false. Elapsed: 233.995666ms
Oct 13 00:53:37.321: INFO: Pod "pod-subpath-test-preprovisionedpv-h9jr": Phase="Pending", Reason="", readiness=false. Elapsed: 2.468378783s
Oct 13 00:53:39.556: INFO: Pod "pod-subpath-test-preprovisionedpv-h9jr": Phase="Pending", Reason="", readiness=false. Elapsed: 4.703622369s
Oct 13 00:53:41.790: INFO: Pod "pod-subpath-test-preprovisionedpv-h9jr": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.937932747s
STEP: Saw pod success
Oct 13 00:53:41.790: INFO: Pod "pod-subpath-test-preprovisionedpv-h9jr" satisfied condition "Succeeded or Failed"
Oct 13 00:53:42.024: INFO: Trying to get logs from node ip-172-20-43-74.ap-southeast-1.compute.internal pod pod-subpath-test-preprovisionedpv-h9jr container test-container-subpath-preprovisionedpv-h9jr: <nil>
STEP: delete the pod
Oct 13 00:53:42.523: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-h9jr to disappear
Oct 13 00:53:42.761: INFO: Pod pod-subpath-test-preprovisionedpv-h9jr no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-h9jr
Oct 13 00:53:42.761: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-h9jr" in namespace "provisioning-9483"
... skipping 24 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support readOnly file specified in the volumeMount [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:384
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: block] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]","total":-1,"completed":2,"skipped":21,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:49.311: INFO: Driver csi-hostpath doesn't support PreprovisionedPV -- skipping
... skipping 89 lines ...
STEP: Building a namespace api object, basename secrets
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable via the environment [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: creating secret secrets-9004/secret-test-78d0cc48-85f6-4b0e-9a82-e488ecd172ff
STEP: Creating a pod to test consume secrets
Oct 13 00:53:35.741: INFO: Waiting up to 5m0s for pod "pod-configmaps-dac00cf0-0e14-4af8-a5fb-558c91aae9bd" in namespace "secrets-9004" to be "Succeeded or Failed"
Oct 13 00:53:35.981: INFO: Pod "pod-configmaps-dac00cf0-0e14-4af8-a5fb-558c91aae9bd": Phase="Pending", Reason="", readiness=false. Elapsed: 239.496063ms
Oct 13 00:53:38.221: INFO: Pod "pod-configmaps-dac00cf0-0e14-4af8-a5fb-558c91aae9bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.479496173s
Oct 13 00:53:40.461: INFO: Pod "pod-configmaps-dac00cf0-0e14-4af8-a5fb-558c91aae9bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.720055558s
Oct 13 00:53:42.701: INFO: Pod "pod-configmaps-dac00cf0-0e14-4af8-a5fb-558c91aae9bd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.960428783s
Oct 13 00:53:44.942: INFO: Pod "pod-configmaps-dac00cf0-0e14-4af8-a5fb-558c91aae9bd": Phase="Pending", Reason="", readiness=false. Elapsed: 9.200516073s
Oct 13 00:53:47.182: INFO: Pod "pod-configmaps-dac00cf0-0e14-4af8-a5fb-558c91aae9bd": Phase="Pending", Reason="", readiness=false. Elapsed: 11.440567809s
Oct 13 00:53:49.423: INFO: Pod "pod-configmaps-dac00cf0-0e14-4af8-a5fb-558c91aae9bd": Phase="Succeeded", Reason="", readiness=false. Elapsed: 13.681472583s
STEP: Saw pod success
Oct 13 00:53:49.423: INFO: Pod "pod-configmaps-dac00cf0-0e14-4af8-a5fb-558c91aae9bd" satisfied condition "Succeeded or Failed"
Oct 13 00:53:49.677: INFO: Trying to get logs from node ip-172-20-55-159.ap-southeast-1.compute.internal pod pod-configmaps-dac00cf0-0e14-4af8-a5fb-558c91aae9bd container env-test: <nil>
STEP: delete the pod
Oct 13 00:53:50.178: INFO: Waiting for pod pod-configmaps-dac00cf0-0e14-4af8-a5fb-558c91aae9bd to disappear
Oct 13 00:53:50.417: INFO: Pod pod-configmaps-dac00cf0-0e14-4af8-a5fb-558c91aae9bd no longer exists
[AfterEach] [sig-node] Secrets
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 17 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:38
STEP: Setting up data
[It] should support subpaths with projected pod [LinuxOnly] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating pod pod-subpath-test-projected-6rrv
STEP: Creating a pod to test atomic-volume-subpath
Oct 13 00:53:27.308: INFO: Waiting up to 5m0s for pod "pod-subpath-test-projected-6rrv" in namespace "subpath-1701" to be "Succeeded or Failed"
Oct 13 00:53:27.544: INFO: Pod "pod-subpath-test-projected-6rrv": Phase="Pending", Reason="", readiness=false. Elapsed: 235.938713ms
Oct 13 00:53:29.781: INFO: Pod "pod-subpath-test-projected-6rrv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.472231072s
Oct 13 00:53:32.017: INFO: Pod "pod-subpath-test-projected-6rrv": Phase="Pending", Reason="", readiness=false. Elapsed: 4.708927071s
Oct 13 00:53:34.254: INFO: Pod "pod-subpath-test-projected-6rrv": Phase="Running", Reason="", readiness=true. Elapsed: 6.945454528s
Oct 13 00:53:36.490: INFO: Pod "pod-subpath-test-projected-6rrv": Phase="Running", Reason="", readiness=true. Elapsed: 9.181607012s
Oct 13 00:53:38.726: INFO: Pod "pod-subpath-test-projected-6rrv": Phase="Running", Reason="", readiness=true. Elapsed: 11.41767332s
... skipping 2 lines ...
Oct 13 00:53:45.435: INFO: Pod "pod-subpath-test-projected-6rrv": Phase="Running", Reason="", readiness=true. Elapsed: 18.126730822s
Oct 13 00:53:47.671: INFO: Pod "pod-subpath-test-projected-6rrv": Phase="Running", Reason="", readiness=true. Elapsed: 20.362721846s
Oct 13 00:53:49.918: INFO: Pod "pod-subpath-test-projected-6rrv": Phase="Running", Reason="", readiness=true. Elapsed: 22.609830611s
Oct 13 00:53:52.155: INFO: Pod "pod-subpath-test-projected-6rrv": Phase="Running", Reason="", readiness=true. Elapsed: 24.846931601s
Oct 13 00:53:54.401: INFO: Pod "pod-subpath-test-projected-6rrv": Phase="Succeeded", Reason="", readiness=false. Elapsed: 27.092441849s
STEP: Saw pod success
Oct 13 00:53:54.401: INFO: Pod "pod-subpath-test-projected-6rrv" satisfied condition "Succeeded or Failed"
Oct 13 00:53:54.637: INFO: Trying to get logs from node ip-172-20-55-159.ap-southeast-1.compute.internal pod pod-subpath-test-projected-6rrv container test-container-subpath-projected-6rrv: <nil>
STEP: delete the pod
Oct 13 00:53:55.118: INFO: Waiting for pod pod-subpath-test-projected-6rrv to disappear
Oct 13 00:53:55.361: INFO: Pod pod-subpath-test-projected-6rrv no longer exists
STEP: Deleting pod pod-subpath-test-projected-6rrv
Oct 13 00:53:55.361: INFO: Deleting pod "pod-subpath-test-projected-6rrv" in namespace "subpath-1701"
... skipping 8 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  Atomic writer volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:34
    should support subpaths with projected pod [LinuxOnly] [Conformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Subpath Atomic writer volumes should support subpaths with projected pod [LinuxOnly] [Conformance]","total":-1,"completed":2,"skipped":40,"failed":1,"failures":["[sig-node] Pods should run through the lifecycle of Pods and PodStatus [Conformance]"]}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:56.091: INFO: Only supported for providers [gce gke] (not aws)
[AfterEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 114 lines ...
• [SLOW TEST:7.578 seconds]
[sig-apps] Deployment
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  deployment reaping should cascade to its replica sets and pods
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/deployment.go:92
------------------------------
{"msg":"PASSED [sig-apps] Deployment deployment reaping should cascade to its replica sets and pods","total":-1,"completed":3,"skipped":32,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:53:56.944: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 81 lines ...
• [SLOW TEST:14.126 seconds]
[sig-api-machinery] ServerSideApply
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should work for CRDs
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/apply.go:569
------------------------------
{"msg":"PASSED [sig-api-machinery] ServerSideApply should work for CRDs","total":-1,"completed":4,"skipped":18,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:54:01.537: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian)
... skipping 158 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/runtime.go:41
    when starting a container that exits
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/runtime.go:42
      should run with the expected status [NodeConformance] [Conformance]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Container Runtime blackbox test when starting a container that exits should run with the expected status [NodeConformance] [Conformance]","total":-1,"completed":6,"skipped":40,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:54:03.934: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 45 lines ...
Oct 13 00:53:33.309: INFO: PersistentVolume nfs-hz4z8 found and phase=Bound (242.854317ms)
Oct 13 00:53:33.552: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-tbwz7] to have phase Bound
Oct 13 00:53:33.795: INFO: PersistentVolumeClaim pvc-tbwz7 found and phase=Bound (242.922669ms)
STEP: Checking pod has write access to PersistentVolumes
Oct 13 00:53:34.037: INFO: Creating nfs test pod
Oct 13 00:53:34.282: INFO: Pod should terminate with exitcode 0 (success)
Oct 13 00:53:34.282: INFO: Waiting up to 5m0s for pod "pvc-tester-2tsnc" in namespace "pv-8789" to be "Succeeded or Failed"
Oct 13 00:53:34.524: INFO: Pod "pvc-tester-2tsnc": Phase="Pending", Reason="", readiness=false. Elapsed: 242.723279ms
Oct 13 00:53:36.769: INFO: Pod "pvc-tester-2tsnc": Phase="Pending", Reason="", readiness=false. Elapsed: 2.487434893s
Oct 13 00:53:39.019: INFO: Pod "pvc-tester-2tsnc": Phase="Pending", Reason="", readiness=false. Elapsed: 4.73737409s
Oct 13 00:53:41.264: INFO: Pod "pvc-tester-2tsnc": Phase="Pending", Reason="", readiness=false. Elapsed: 6.982214389s
Oct 13 00:53:43.508: INFO: Pod "pvc-tester-2tsnc": Phase="Pending", Reason="", readiness=false. Elapsed: 9.226165823s
Oct 13 00:53:45.754: INFO: Pod "pvc-tester-2tsnc": Phase="Succeeded", Reason="", readiness=false. Elapsed: 11.47200416s
STEP: Saw pod success
Oct 13 00:53:45.754: INFO: Pod "pvc-tester-2tsnc" satisfied condition "Succeeded or Failed"
Oct 13 00:53:45.754: INFO: Pod pvc-tester-2tsnc succeeded 
Oct 13 00:53:45.754: INFO: Deleting pod "pvc-tester-2tsnc" in namespace "pv-8789"
Oct 13 00:53:46.001: INFO: Wait up to 5m0s for pod "pvc-tester-2tsnc" to be fully deleted
Oct 13 00:53:46.486: INFO: Creating nfs test pod
Oct 13 00:53:46.738: INFO: Pod should terminate with exitcode 0 (success)
Oct 13 00:53:46.738: INFO: Waiting up to 5m0s for pod "pvc-tester-2clzn" in namespace "pv-8789" to be "Succeeded or Failed"
Oct 13 00:53:46.982: INFO: Pod "pvc-tester-2clzn": Phase="Pending", Reason="", readiness=false. Elapsed: 243.542219ms
Oct 13 00:53:49.225: INFO: Pod "pvc-tester-2clzn": Phase="Pending", Reason="", readiness=false. Elapsed: 2.487018271s
Oct 13 00:53:51.469: INFO: Pod "pvc-tester-2clzn": Phase="Pending", Reason="", readiness=false. Elapsed: 4.730929328s
Oct 13 00:53:53.715: INFO: Pod "pvc-tester-2clzn": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.97693408s
STEP: Saw pod success
Oct 13 00:53:53.715: INFO: Pod "pvc-tester-2clzn" satisfied condition "Succeeded or Failed"
Oct 13 00:53:53.715: INFO: Pod pvc-tester-2clzn succeeded 
Oct 13 00:53:53.715: INFO: Deleting pod "pvc-tester-2clzn" in namespace "pv-8789"
Oct 13 00:53:53.964: INFO: Wait up to 5m0s for pod "pvc-tester-2clzn" to be fully deleted
STEP: Deleting PVCs to invoke reclaim policy
Oct 13 00:53:55.199: INFO: Deleting PVC pvc-tbwz7 to trigger reclamation of PV nfs-hz4z8
Oct 13 00:53:55.199: INFO: Deleting PersistentVolumeClaim "pvc-tbwz7"
... skipping 31 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes.go:122
    with multiple PVs and PVCs all in same ns
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes.go:212
      should create 2 PVs and 4 PVCs: test write access
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes.go:233
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes NFS with multiple PVs and PVCs all in same ns should create 2 PVs and 4 PVCs: test write access","total":-1,"completed":3,"skipped":27,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] capacity
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:54:05.409: INFO: Only supported for providers [azure] (not aws)
[AfterEach] [Testpattern: Dynamic PV (default fs)] capacity
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 96 lines ...
STEP: Building a namespace api object, basename security-context-test
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:46
[It] should allow privilege escalation when true [LinuxOnly] [NodeConformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:367
Oct 13 00:53:58.376: INFO: Waiting up to 5m0s for pod "alpine-nnp-true-f445773c-b50b-47e3-8d40-f6f21ebf7ce3" in namespace "security-context-test-1435" to be "Succeeded or Failed"
Oct 13 00:53:58.610: INFO: Pod "alpine-nnp-true-f445773c-b50b-47e3-8d40-f6f21ebf7ce3": Phase="Pending", Reason="", readiness=false. Elapsed: 234.587738ms
Oct 13 00:54:00.846: INFO: Pod "alpine-nnp-true-f445773c-b50b-47e3-8d40-f6f21ebf7ce3": Phase="Pending", Reason="", readiness=false. Elapsed: 2.469964513s
Oct 13 00:54:03.080: INFO: Pod "alpine-nnp-true-f445773c-b50b-47e3-8d40-f6f21ebf7ce3": Phase="Pending", Reason="", readiness=false. Elapsed: 4.704322219s
Oct 13 00:54:05.315: INFO: Pod "alpine-nnp-true-f445773c-b50b-47e3-8d40-f6f21ebf7ce3": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.938741778s
Oct 13 00:54:05.315: INFO: Pod "alpine-nnp-true-f445773c-b50b-47e3-8d40-f6f21ebf7ce3" satisfied condition "Succeeded or Failed"
[AfterEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:54:05.558: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "security-context-test-1435" for this suite.


... skipping 2 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  when creating containers with AllowPrivilegeEscalation
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:296
    should allow privilege escalation when true [LinuxOnly] [NodeConformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:367
------------------------------
{"msg":"PASSED [sig-node] Security Context when creating containers with AllowPrivilegeEscalation should allow privilege escalation when true [LinuxOnly] [NodeConformance]","total":-1,"completed":4,"skipped":37,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:54:06.037: INFO: Driver local doesn't support InlineVolume -- skipping
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 104 lines ...
• [SLOW TEST:5.992 seconds]
[sig-storage] ConfigMap
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  updates should be reflected in volume [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] ConfigMap updates should be reflected in volume [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":22,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:54:07.551: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 70 lines ...
STEP: Building a namespace api object, basename security-context-test
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:46
[It] should run the container with readonly rootfs when readOnlyRootFilesystem=true [LinuxOnly] [NodeConformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:217
Oct 13 00:54:04.315: INFO: Waiting up to 5m0s for pod "busybox-readonly-true-ed4f9f38-604b-4900-9a45-fae775000d5f" in namespace "security-context-test-5802" to be "Succeeded or Failed"
Oct 13 00:54:04.557: INFO: Pod "busybox-readonly-true-ed4f9f38-604b-4900-9a45-fae775000d5f": Phase="Pending", Reason="", readiness=false. Elapsed: 241.730809ms
Oct 13 00:54:06.800: INFO: Pod "busybox-readonly-true-ed4f9f38-604b-4900-9a45-fae775000d5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2.484358279s
Oct 13 00:54:09.042: INFO: Pod "busybox-readonly-true-ed4f9f38-604b-4900-9a45-fae775000d5f": Phase="Failed", Reason="", readiness=false. Elapsed: 4.727221548s
Oct 13 00:54:09.042: INFO: Pod "busybox-readonly-true-ed4f9f38-604b-4900-9a45-fae775000d5f" satisfied condition "Succeeded or Failed"
[AfterEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:54:09.043: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "security-context-test-5802" for this suite.


... skipping 2 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  When creating a pod with readOnlyRootFilesystem
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:171
    should run the container with readonly rootfs when readOnlyRootFilesystem=true [LinuxOnly] [NodeConformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:217
------------------------------
{"msg":"PASSED [sig-node] Security Context When creating a pod with readOnlyRootFilesystem should run the container with readonly rootfs when readOnlyRootFilesystem=true [LinuxOnly] [NodeConformance]","total":-1,"completed":5,"skipped":52,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
... skipping 7 lines ...
Oct 13 00:53:37.876: INFO: In-tree plugin kubernetes.io/aws-ebs is not migrated, not validating any metrics
STEP: creating a test aws volume
Oct 13 00:53:39.136: INFO: Successfully created a new PD: "aws://ap-southeast-1a/vol-0935d3ebec645cccf".
Oct 13 00:53:39.136: INFO: Creating resource for inline volume
STEP: Creating pod exec-volume-test-inlinevolume-tmdf
STEP: Creating a pod to test exec-volume-test
Oct 13 00:53:39.380: INFO: Waiting up to 5m0s for pod "exec-volume-test-inlinevolume-tmdf" in namespace "volume-8484" to be "Succeeded or Failed"
Oct 13 00:53:39.622: INFO: Pod "exec-volume-test-inlinevolume-tmdf": Phase="Pending", Reason="", readiness=false. Elapsed: 242.191984ms
Oct 13 00:53:41.865: INFO: Pod "exec-volume-test-inlinevolume-tmdf": Phase="Pending", Reason="", readiness=false. Elapsed: 2.484323541s
Oct 13 00:53:44.107: INFO: Pod "exec-volume-test-inlinevolume-tmdf": Phase="Pending", Reason="", readiness=false. Elapsed: 4.727136519s
Oct 13 00:53:46.350: INFO: Pod "exec-volume-test-inlinevolume-tmdf": Phase="Pending", Reason="", readiness=false. Elapsed: 6.969882976s
Oct 13 00:53:48.592: INFO: Pod "exec-volume-test-inlinevolume-tmdf": Phase="Pending", Reason="", readiness=false. Elapsed: 9.212101302s
Oct 13 00:53:50.835: INFO: Pod "exec-volume-test-inlinevolume-tmdf": Phase="Pending", Reason="", readiness=false. Elapsed: 11.455107744s
Oct 13 00:53:53.078: INFO: Pod "exec-volume-test-inlinevolume-tmdf": Phase="Pending", Reason="", readiness=false. Elapsed: 13.697411311s
Oct 13 00:53:55.330: INFO: Pod "exec-volume-test-inlinevolume-tmdf": Phase="Succeeded", Reason="", readiness=false. Elapsed: 15.949566993s
STEP: Saw pod success
Oct 13 00:53:55.330: INFO: Pod "exec-volume-test-inlinevolume-tmdf" satisfied condition "Succeeded or Failed"
Oct 13 00:53:55.605: INFO: Trying to get logs from node ip-172-20-48-187.ap-southeast-1.compute.internal pod exec-volume-test-inlinevolume-tmdf container exec-container-inlinevolume-tmdf: <nil>
STEP: delete the pod
Oct 13 00:53:56.110: INFO: Waiting for pod exec-volume-test-inlinevolume-tmdf to disappear
Oct 13 00:53:56.351: INFO: Pod exec-volume-test-inlinevolume-tmdf no longer exists
STEP: Deleting pod exec-volume-test-inlinevolume-tmdf
Oct 13 00:53:56.351: INFO: Deleting pod "exec-volume-test-inlinevolume-tmdf" in namespace "volume-8484"
Oct 13 00:53:56.906: INFO: Couldn't delete PD "aws://ap-southeast-1a/vol-0935d3ebec645cccf", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0935d3ebec645cccf is currently attached to i-0856c3c3c0ee2f508
	status code: 400, request id: 69ed7ac1-d04a-4eb5-8180-450535caa7f3
Oct 13 00:54:03.025: INFO: Couldn't delete PD "aws://ap-southeast-1a/vol-0935d3ebec645cccf", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0935d3ebec645cccf is currently attached to i-0856c3c3c0ee2f508
	status code: 400, request id: c064af50-6b64-458b-8d8f-7d5c32e2e152
Oct 13 00:54:09.101: INFO: Successfully deleted PD "aws://ap-southeast-1a/vol-0935d3ebec645cccf".
[AfterEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:54:09.101: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-8484" for this suite.
... skipping 6 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (ext4)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should allow exec of files on the volume
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Inline-volume (ext4)] volumes should allow exec of files on the volume","total":-1,"completed":2,"skipped":40,"failed":0}

SS
------------------------------
[BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeFeature:Sysctls]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/sysctl.go:35
[BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeFeature:Sysctls]
... skipping 4 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeFeature:Sysctls]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/sysctl.go:64
[It] should support unsafe sysctls which are actually allowed [MinimumKubeletVersion:1.21] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod with the kernel.shm_rmid_forced sysctl
STEP: Watching for error events or started pod
STEP: Waiting for pod completion
STEP: Checking that the pod succeeded
STEP: Getting logs from the pod
STEP: Checking that the sysctl is actually updated
[AfterEach] [sig-node] Sysctls [LinuxOnly] [NodeFeature:Sysctls]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:7.177 seconds]
[sig-node] Sysctls [LinuxOnly] [NodeFeature:Sysctls]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should support unsafe sysctls which are actually allowed [MinimumKubeletVersion:1.21] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Sysctls [LinuxOnly] [NodeFeature:Sysctls] should support unsafe sysctls which are actually allowed [MinimumKubeletVersion:1.21] [Conformance]","total":-1,"completed":7,"skipped":45,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:54:12.854: INFO: Driver local doesn't support InlineVolume -- skipping
[AfterEach] [Testpattern: Inline-volume (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 22 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-storage] Projected downwardAPI
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/projected_downwardapi.go:41
[It] should provide podname only [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test downward API volume plugin
Oct 13 00:54:06.924: INFO: Waiting up to 5m0s for pod "downwardapi-volume-181b6696-e2a7-4445-986a-43b95469c27d" in namespace "projected-2200" to be "Succeeded or Failed"
Oct 13 00:54:07.167: INFO: Pod "downwardapi-volume-181b6696-e2a7-4445-986a-43b95469c27d": Phase="Pending", Reason="", readiness=false. Elapsed: 243.023503ms
Oct 13 00:54:09.411: INFO: Pod "downwardapi-volume-181b6696-e2a7-4445-986a-43b95469c27d": Phase="Pending", Reason="", readiness=false. Elapsed: 2.486799833s
Oct 13 00:54:11.655: INFO: Pod "downwardapi-volume-181b6696-e2a7-4445-986a-43b95469c27d": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.730577201s
STEP: Saw pod success
Oct 13 00:54:11.655: INFO: Pod "downwardapi-volume-181b6696-e2a7-4445-986a-43b95469c27d" satisfied condition "Succeeded or Failed"
Oct 13 00:54:11.898: INFO: Trying to get logs from node ip-172-20-37-188.ap-southeast-1.compute.internal pod downwardapi-volume-181b6696-e2a7-4445-986a-43b95469c27d container client-container: <nil>
STEP: delete the pod
Oct 13 00:54:12.431: INFO: Waiting for pod downwardapi-volume-181b6696-e2a7-4445-986a-43b95469c27d to disappear
Oct 13 00:54:12.678: INFO: Pod downwardapi-volume-181b6696-e2a7-4445-986a-43b95469c27d no longer exists
[AfterEach] [sig-storage] Projected downwardAPI
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:7.708 seconds]
[sig-storage] Projected downwardAPI
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should provide podname only [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Projected downwardAPI should provide podname only [NodeConformance] [Conformance]","total":-1,"completed":4,"skipped":38,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:54:13.174: INFO: Only supported for providers [gce gke] (not aws)
[AfterEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 133 lines ...
Oct 13 00:53:46.049: INFO: PersistentVolume nfs-cd7jz found and phase=Bound (243.676978ms)
Oct 13 00:53:46.293: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-k54q4] to have phase Bound
Oct 13 00:53:46.537: INFO: PersistentVolumeClaim pvc-k54q4 found and phase=Bound (243.965599ms)
STEP: Checking pod has write access to PersistentVolumes
Oct 13 00:53:46.781: INFO: Creating nfs test pod
Oct 13 00:53:47.026: INFO: Pod should terminate with exitcode 0 (success)
Oct 13 00:53:47.026: INFO: Waiting up to 5m0s for pod "pvc-tester-7kmq5" in namespace "pv-9733" to be "Succeeded or Failed"
Oct 13 00:53:47.270: INFO: Pod "pvc-tester-7kmq5": Phase="Pending", Reason="", readiness=false. Elapsed: 244.132091ms
Oct 13 00:53:49.533: INFO: Pod "pvc-tester-7kmq5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.506649998s
Oct 13 00:53:51.777: INFO: Pod "pvc-tester-7kmq5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.751144879s
Oct 13 00:53:54.023: INFO: Pod "pvc-tester-7kmq5": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.996582562s
STEP: Saw pod success
Oct 13 00:53:54.023: INFO: Pod "pvc-tester-7kmq5" satisfied condition "Succeeded or Failed"
Oct 13 00:53:54.023: INFO: Pod pvc-tester-7kmq5 succeeded 
Oct 13 00:53:54.023: INFO: Deleting pod "pvc-tester-7kmq5" in namespace "pv-9733"
Oct 13 00:53:54.272: INFO: Wait up to 5m0s for pod "pvc-tester-7kmq5" to be fully deleted
Oct 13 00:53:54.760: INFO: Creating nfs test pod
Oct 13 00:53:55.004: INFO: Pod should terminate with exitcode 0 (success)
Oct 13 00:53:55.004: INFO: Waiting up to 5m0s for pod "pvc-tester-fgb7k" in namespace "pv-9733" to be "Succeeded or Failed"
Oct 13 00:53:55.250: INFO: Pod "pvc-tester-fgb7k": Phase="Pending", Reason="", readiness=false. Elapsed: 246.083731ms
Oct 13 00:53:57.495: INFO: Pod "pvc-tester-fgb7k": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.490512001s
STEP: Saw pod success
Oct 13 00:53:57.495: INFO: Pod "pvc-tester-fgb7k" satisfied condition "Succeeded or Failed"
Oct 13 00:53:57.495: INFO: Pod pvc-tester-fgb7k succeeded 
Oct 13 00:53:57.495: INFO: Deleting pod "pvc-tester-fgb7k" in namespace "pv-9733"
Oct 13 00:53:57.745: INFO: Wait up to 5m0s for pod "pvc-tester-fgb7k" to be fully deleted
Oct 13 00:53:58.245: INFO: Creating nfs test pod
Oct 13 00:53:58.491: INFO: Pod should terminate with exitcode 0 (success)
Oct 13 00:53:58.491: INFO: Waiting up to 5m0s for pod "pvc-tester-cjjlp" in namespace "pv-9733" to be "Succeeded or Failed"
Oct 13 00:53:58.736: INFO: Pod "pvc-tester-cjjlp": Phase="Pending", Reason="", readiness=false. Elapsed: 244.868749ms
Oct 13 00:54:01.021: INFO: Pod "pvc-tester-cjjlp": Phase="Pending", Reason="", readiness=false. Elapsed: 2.530178206s
Oct 13 00:54:03.265: INFO: Pod "pvc-tester-cjjlp": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.774581547s
STEP: Saw pod success
Oct 13 00:54:03.265: INFO: Pod "pvc-tester-cjjlp" satisfied condition "Succeeded or Failed"
Oct 13 00:54:03.265: INFO: Pod pvc-tester-cjjlp succeeded 
Oct 13 00:54:03.265: INFO: Deleting pod "pvc-tester-cjjlp" in namespace "pv-9733"
Oct 13 00:54:03.513: INFO: Wait up to 5m0s for pod "pvc-tester-cjjlp" to be fully deleted
STEP: Deleting PVCs to invoke reclaim policy
Oct 13 00:54:04.245: INFO: Deleting PVC pvc-796bb to trigger reclamation of PV nfs-tggdp
Oct 13 00:54:04.245: INFO: Deleting PersistentVolumeClaim "pvc-796bb"
... skipping 36 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes.go:122
    with multiple PVs and PVCs all in same ns
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes.go:212
      should create 3 PVs and 3 PVCs: test write access
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes.go:243
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes NFS with multiple PVs and PVCs all in same ns should create 3 PVs and 3 PVCs: test write access","total":-1,"completed":2,"skipped":11,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:54:17.423: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 83 lines ...
Oct 13 00:54:01.198: INFO: PersistentVolumeClaim pvc-5w4rg found but phase is Pending instead of Bound.
Oct 13 00:54:03.434: INFO: PersistentVolumeClaim pvc-5w4rg found and phase=Bound (9.179644676s)
Oct 13 00:54:03.434: INFO: Waiting up to 3m0s for PersistentVolume local-8jtd8 to have phase Bound
Oct 13 00:54:03.671: INFO: PersistentVolume local-8jtd8 found and phase=Bound (236.985667ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-lftc
STEP: Creating a pod to test subpath
Oct 13 00:54:04.380: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-lftc" in namespace "provisioning-8054" to be "Succeeded or Failed"
Oct 13 00:54:04.615: INFO: Pod "pod-subpath-test-preprovisionedpv-lftc": Phase="Pending", Reason="", readiness=false. Elapsed: 235.229415ms
Oct 13 00:54:06.850: INFO: Pod "pod-subpath-test-preprovisionedpv-lftc": Phase="Pending", Reason="", readiness=false. Elapsed: 2.470909072s
Oct 13 00:54:09.087: INFO: Pod "pod-subpath-test-preprovisionedpv-lftc": Phase="Pending", Reason="", readiness=false. Elapsed: 4.707078165s
Oct 13 00:54:11.322: INFO: Pod "pod-subpath-test-preprovisionedpv-lftc": Phase="Pending", Reason="", readiness=false. Elapsed: 6.942641189s
Oct 13 00:54:13.559: INFO: Pod "pod-subpath-test-preprovisionedpv-lftc": Phase="Succeeded", Reason="", readiness=false. Elapsed: 9.179389587s
STEP: Saw pod success
Oct 13 00:54:13.559: INFO: Pod "pod-subpath-test-preprovisionedpv-lftc" satisfied condition "Succeeded or Failed"
Oct 13 00:54:13.794: INFO: Trying to get logs from node ip-172-20-55-159.ap-southeast-1.compute.internal pod pod-subpath-test-preprovisionedpv-lftc container test-container-subpath-preprovisionedpv-lftc: <nil>
STEP: delete the pod
Oct 13 00:54:14.276: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-lftc to disappear
Oct 13 00:54:14.511: INFO: Pod pod-subpath-test-preprovisionedpv-lftc no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-lftc
Oct 13 00:54:14.511: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-lftc" in namespace "provisioning-8054"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support readOnly directory specified in the volumeMount
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:369
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link] [Testpattern: Pre-provisioned PV (default fs)] subPath should support readOnly directory specified in the volumeMount","total":-1,"completed":2,"skipped":20,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:54:17.796: INFO: Driver local doesn't support InlineVolume -- skipping
[AfterEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 120 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should store data
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: tmpfs] [Testpattern: Pre-provisioned PV (default fs)] volumes should store data","total":-1,"completed":1,"skipped":3,"failed":0}

S
------------------------------
{"msg":"PASSED [sig-network] DNS should resolve DNS of partial qualified names for services [LinuxOnly] [Conformance]","total":-1,"completed":1,"skipped":2,"failed":0}
[BeforeEach] [sig-api-machinery] ResourceQuota
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:53:48.360: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename resourcequota
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 15 lines ...
• [SLOW TEST:31.658 seconds]
[sig-api-machinery] ResourceQuota
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should create a ResourceQuota and capture the life of a configMap. [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a configMap. [Conformance]","total":-1,"completed":2,"skipped":2,"failed":0}

SSS
------------------------------
{"msg":"PASSED [sig-api-machinery] ServerSideApply should remove a field if it is owned but removed in the apply request","total":-1,"completed":5,"skipped":53,"failed":0}
[BeforeEach] [sig-node] Pods
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:54:16.683: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename pods
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 16 lines ...
• [SLOW TEST:7.485 seconds]
[sig-node] Pods
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should support remote command execution over websockets [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Pods should support remote command execution over websockets [NodeConformance] [Conformance]","total":-1,"completed":6,"skipped":53,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-auth] ServiceAccounts
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 57 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/runtime.go:41
    when running a container with a new image
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/runtime.go:266
      should be able to pull image [NodeConformance]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/runtime.go:382
------------------------------
{"msg":"PASSED [sig-node] Container Runtime blackbox test when running a container with a new image should be able to pull image [NodeConformance]","total":-1,"completed":8,"skipped":47,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:54:25.558: INFO: Only supported for providers [vsphere] (not aws)
... skipping 29 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:54:27.602: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "secrets-9014" for this suite.

•
------------------------------
{"msg":"PASSED [sig-storage] Secrets should be immutable if `immutable` field is set [Conformance]","total":-1,"completed":7,"skipped":56,"failed":0}

SSSSSSSSSSS
------------------------------
[BeforeEach] [sig-node] InitContainer [NodeConformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 15 lines ...
• [SLOW TEST:11.518 seconds]
[sig-node] InitContainer [NodeConformance]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should invoke init containers on a RestartNever pod [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] InitContainer [NodeConformance] should invoke init containers on a RestartNever pod [Conformance]","total":-1,"completed":3,"skipped":27,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:54:29.012: INFO: Driver emptydir doesn't support PreprovisionedPV -- skipping
[AfterEach] [Testpattern: Pre-provisioned PV (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 77 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:192
    One pod requesting one prebound PVC
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:209
      should be able to mount volume and write from pod1
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:238
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: dir-link] One pod requesting one prebound PVC should be able to mount volume and write from pod1","total":-1,"completed":6,"skipped":31,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:54:29.974: INFO: Driver local doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 33 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:54:30.413: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "kubectl-3043" for this suite.

•
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Kubectl create quota should create a quota with scopes","total":-1,"completed":8,"skipped":67,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:54:30.920: INFO: Only supported for providers [openstack] (not aws)
... skipping 5 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: cinder]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (immediate binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Only supported for providers [openstack] (not aws)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:1092
------------------------------
... skipping 71 lines ...
Oct 13 00:54:15.765: INFO: PersistentVolumeClaim pvc-jtv6v found but phase is Pending instead of Bound.
Oct 13 00:54:18.001: INFO: PersistentVolumeClaim pvc-jtv6v found and phase=Bound (13.661008545s)
Oct 13 00:54:18.001: INFO: Waiting up to 3m0s for PersistentVolume local-htt49 to have phase Bound
Oct 13 00:54:18.238: INFO: PersistentVolume local-htt49 found and phase=Bound (237.216821ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-9pzd
STEP: Creating a pod to test subpath
Oct 13 00:54:18.947: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-9pzd" in namespace "provisioning-2537" to be "Succeeded or Failed"
Oct 13 00:54:19.183: INFO: Pod "pod-subpath-test-preprovisionedpv-9pzd": Phase="Pending", Reason="", readiness=false. Elapsed: 235.744508ms
Oct 13 00:54:21.420: INFO: Pod "pod-subpath-test-preprovisionedpv-9pzd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.472783536s
Oct 13 00:54:23.656: INFO: Pod "pod-subpath-test-preprovisionedpv-9pzd": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.708898851s
STEP: Saw pod success
Oct 13 00:54:23.656: INFO: Pod "pod-subpath-test-preprovisionedpv-9pzd" satisfied condition "Succeeded or Failed"
Oct 13 00:54:23.894: INFO: Trying to get logs from node ip-172-20-37-188.ap-southeast-1.compute.internal pod pod-subpath-test-preprovisionedpv-9pzd container test-container-subpath-preprovisionedpv-9pzd: <nil>
STEP: delete the pod
Oct 13 00:54:24.383: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-9pzd to disappear
Oct 13 00:54:24.619: INFO: Pod pod-subpath-test-preprovisionedpv-9pzd no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-9pzd
Oct 13 00:54:24.619: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-9pzd" in namespace "provisioning-2537"
STEP: Creating pod pod-subpath-test-preprovisionedpv-9pzd
STEP: Creating a pod to test subpath
Oct 13 00:54:25.093: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-9pzd" in namespace "provisioning-2537" to be "Succeeded or Failed"
Oct 13 00:54:25.329: INFO: Pod "pod-subpath-test-preprovisionedpv-9pzd": Phase="Pending", Reason="", readiness=false. Elapsed: 235.527334ms
Oct 13 00:54:27.566: INFO: Pod "pod-subpath-test-preprovisionedpv-9pzd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.472601952s
Oct 13 00:54:29.806: INFO: Pod "pod-subpath-test-preprovisionedpv-9pzd": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.712924337s
STEP: Saw pod success
Oct 13 00:54:29.807: INFO: Pod "pod-subpath-test-preprovisionedpv-9pzd" satisfied condition "Succeeded or Failed"
Oct 13 00:54:30.043: INFO: Trying to get logs from node ip-172-20-37-188.ap-southeast-1.compute.internal pod pod-subpath-test-preprovisionedpv-9pzd container test-container-subpath-preprovisionedpv-9pzd: <nil>
STEP: delete the pod
Oct 13 00:54:30.532: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-9pzd to disappear
Oct 13 00:54:30.767: INFO: Pod pod-subpath-test-preprovisionedpv-9pzd no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-9pzd
Oct 13 00:54:30.767: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-9pzd" in namespace "provisioning-2537"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support existing directories when readOnly specified in the volumeSource
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:399
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link-bindmounted] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource","total":-1,"completed":3,"skipped":48,"failed":1,"failures":["[sig-node] Pods should run through the lifecycle of Pods and PodStatus [Conformance]"]}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:54:34.059: INFO: Only supported for providers [gce gke] (not aws)
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 132 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (default fs)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should store data
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Inline-volume (default fs)] volumes should store data","total":-1,"completed":3,"skipped":21,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:54:38.766: INFO: Driver hostPathSymlink doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 2 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: hostPathSymlink]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (delayed binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Driver hostPathSymlink doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
... skipping 87 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  When creating a container with runAsNonRoot
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:104
    should not run with an explicit root user ID [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:139
------------------------------
{"msg":"PASSED [sig-node] Security Context When creating a container with runAsNonRoot should not run with an explicit root user ID [LinuxOnly]","total":-1,"completed":3,"skipped":24,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:54:41.963: INFO: Only supported for providers [vsphere] (not aws)
... skipping 112 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:192
    One pod requesting one prebound PVC
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:209
      should be able to mount volume and read from pod1
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:232
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: blockfswithformat] One pod requesting one prebound PVC should be able to mount volume and read from pod1","total":-1,"completed":6,"skipped":53,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-api-machinery] Watchers
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 14 lines ...
• [SLOW TEST:37.951 seconds]
[sig-api-machinery] Watchers
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should receive events on concurrent watches in same order [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] Watchers should receive events on concurrent watches in same order [Conformance]","total":-1,"completed":3,"skipped":42,"failed":0}

SSSSS
------------------------------
[BeforeEach] [sig-auth] Metadata Concealment
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 82 lines ...
Oct 13 00:54:40.964: INFO: Creating a PV followed by a PVC
Oct 13 00:54:41.456: INFO: Waiting for PV local-pvldflw to bind to PVC pvc-xhwkq
Oct 13 00:54:41.456: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-xhwkq] to have phase Bound
Oct 13 00:54:41.699: INFO: PersistentVolumeClaim pvc-xhwkq found and phase=Bound (243.029787ms)
Oct 13 00:54:41.699: INFO: Waiting up to 3m0s for PersistentVolume local-pvldflw to have phase Bound
Oct 13 00:54:41.946: INFO: PersistentVolume local-pvldflw found and phase=Bound (246.595521ms)
[It] should fail scheduling due to different NodeSelector
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:379
STEP: local-volume-type: dir
STEP: Initializing test volumes
Oct 13 00:54:42.433: INFO: ExecWithOptions {Command:[nsenter --mount=/rootfs/proc/1/ns/mnt -- sh -c mkdir -p /tmp/local-volume-test-b8643a84-6047-4d00-a41b-e30dfe72b488] Namespace:persistent-local-volumes-test-2358 PodName:hostexec-ip-172-20-55-159.ap-southeast-1.compute.internal-dvt2m ContainerName:agnhost-container Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false}
Oct 13 00:54:42.433: INFO: >>> kubeConfig: /root/.kube/config
STEP: Creating local PVCs and PVs
... skipping 22 lines ...

• [SLOW TEST:17.767 seconds]
[sig-storage] PersistentVolumes-local 
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  Pod with node different from PV's NodeAffinity
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:347
    should fail scheduling due to different NodeSelector
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:379
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  Pod with node different from PV's NodeAffinity should fail scheduling due to different NodeSelector","total":-1,"completed":9,"skipped":75,"failed":0}

SS
------------------------------
[BeforeEach] [sig-network] Firewall rule
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 193 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents","total":-1,"completed":3,"skipped":10,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:54:54.257: INFO: Only supported for providers [vsphere] (not aws)
[AfterEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 134 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/common/framework.go:23
  version v1
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/proxy.go:74
    should proxy logs on node using proxy subresource 
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/proxy.go:91
------------------------------
{"msg":"PASSED [sig-network] Proxy version v1 should proxy logs on node using proxy subresource ","total":-1,"completed":10,"skipped":77,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
... skipping 115 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_volumes.go:40
    [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should create read-only inline ephemeral volume
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:149
------------------------------
{"msg":"PASSED [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read-only inline ephemeral volume","total":-1,"completed":1,"skipped":10,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:54:56.183: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 76 lines ...
• [SLOW TEST:34.607 seconds]
[sig-network] Services
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/common/framework.go:23
  should preserve source pod IP for traffic thru service cluster IP [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/service.go:903
------------------------------
{"msg":"PASSED [sig-network] Services should preserve source pod IP for traffic thru service cluster IP [LinuxOnly]","total":-1,"completed":9,"skipped":52,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:00.187: INFO: Only supported for providers [azure] (not aws)
[AfterEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 19 lines ...
STEP: Building a namespace api object, basename security-context-test
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:46
[It] should run with an explicit non-root user ID [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:129
Oct 13 00:54:50.783: INFO: Waiting up to 5m0s for pod "explicit-nonroot-uid" in namespace "security-context-test-1862" to be "Succeeded or Failed"
Oct 13 00:54:51.025: INFO: Pod "explicit-nonroot-uid": Phase="Pending", Reason="", readiness=false. Elapsed: 241.782491ms
Oct 13 00:54:53.267: INFO: Pod "explicit-nonroot-uid": Phase="Pending", Reason="", readiness=false. Elapsed: 2.48341942s
Oct 13 00:54:55.509: INFO: Pod "explicit-nonroot-uid": Phase="Pending", Reason="", readiness=false. Elapsed: 4.725125302s
Oct 13 00:54:57.751: INFO: Pod "explicit-nonroot-uid": Phase="Pending", Reason="", readiness=false. Elapsed: 6.967041092s
Oct 13 00:54:59.993: INFO: Pod "explicit-nonroot-uid": Phase="Succeeded", Reason="", readiness=false. Elapsed: 9.209650748s
Oct 13 00:54:59.993: INFO: Pod "explicit-nonroot-uid" satisfied condition "Succeeded or Failed"
[AfterEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:55:00.244: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "security-context-test-1862" for this suite.


... skipping 2 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  When creating a container with runAsNonRoot
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:104
    should run with an explicit non-root user ID [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:129
------------------------------
{"msg":"PASSED [sig-node] Security Context When creating a container with runAsNonRoot should run with an explicit non-root user ID [LinuxOnly]","total":-1,"completed":4,"skipped":59,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
... skipping 16 lines ...
Oct 13 00:54:32.256: INFO: PersistentVolumeClaim pvc-sdp7q found but phase is Pending instead of Bound.
Oct 13 00:54:34.501: INFO: PersistentVolumeClaim pvc-sdp7q found and phase=Bound (4.731674947s)
Oct 13 00:54:34.501: INFO: Waiting up to 3m0s for PersistentVolume local-wxhbm to have phase Bound
Oct 13 00:54:34.744: INFO: PersistentVolume local-wxhbm found and phase=Bound (243.351192ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-nncv
STEP: Creating a pod to test subpath
Oct 13 00:54:35.476: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-nncv" in namespace "provisioning-8223" to be "Succeeded or Failed"
Oct 13 00:54:35.720: INFO: Pod "pod-subpath-test-preprovisionedpv-nncv": Phase="Pending", Reason="", readiness=false. Elapsed: 244.008394ms
Oct 13 00:54:37.964: INFO: Pod "pod-subpath-test-preprovisionedpv-nncv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.487934719s
Oct 13 00:54:40.209: INFO: Pod "pod-subpath-test-preprovisionedpv-nncv": Phase="Pending", Reason="", readiness=false. Elapsed: 4.7335422s
Oct 13 00:54:42.454: INFO: Pod "pod-subpath-test-preprovisionedpv-nncv": Phase="Pending", Reason="", readiness=false. Elapsed: 6.978366407s
Oct 13 00:54:44.699: INFO: Pod "pod-subpath-test-preprovisionedpv-nncv": Phase="Pending", Reason="", readiness=false. Elapsed: 9.223189721s
Oct 13 00:54:46.943: INFO: Pod "pod-subpath-test-preprovisionedpv-nncv": Phase="Pending", Reason="", readiness=false. Elapsed: 11.467633138s
Oct 13 00:54:49.187: INFO: Pod "pod-subpath-test-preprovisionedpv-nncv": Phase="Pending", Reason="", readiness=false. Elapsed: 13.711240716s
Oct 13 00:54:51.431: INFO: Pod "pod-subpath-test-preprovisionedpv-nncv": Phase="Succeeded", Reason="", readiness=false. Elapsed: 15.955082952s
STEP: Saw pod success
Oct 13 00:54:51.431: INFO: Pod "pod-subpath-test-preprovisionedpv-nncv" satisfied condition "Succeeded or Failed"
Oct 13 00:54:51.677: INFO: Trying to get logs from node ip-172-20-43-74.ap-southeast-1.compute.internal pod pod-subpath-test-preprovisionedpv-nncv container test-container-subpath-preprovisionedpv-nncv: <nil>
STEP: delete the pod
Oct 13 00:54:52.177: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-nncv to disappear
Oct 13 00:54:52.420: INFO: Pod pod-subpath-test-preprovisionedpv-nncv no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-nncv
Oct 13 00:54:52.420: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-nncv" in namespace "provisioning-8223"
STEP: Creating pod pod-subpath-test-preprovisionedpv-nncv
STEP: Creating a pod to test subpath
Oct 13 00:54:52.916: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-nncv" in namespace "provisioning-8223" to be "Succeeded or Failed"
Oct 13 00:54:53.159: INFO: Pod "pod-subpath-test-preprovisionedpv-nncv": Phase="Pending", Reason="", readiness=false. Elapsed: 243.508703ms
Oct 13 00:54:55.405: INFO: Pod "pod-subpath-test-preprovisionedpv-nncv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.489533776s
Oct 13 00:54:57.650: INFO: Pod "pod-subpath-test-preprovisionedpv-nncv": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.734255322s
STEP: Saw pod success
Oct 13 00:54:57.650: INFO: Pod "pod-subpath-test-preprovisionedpv-nncv" satisfied condition "Succeeded or Failed"
Oct 13 00:54:57.893: INFO: Trying to get logs from node ip-172-20-43-74.ap-southeast-1.compute.internal pod pod-subpath-test-preprovisionedpv-nncv container test-container-subpath-preprovisionedpv-nncv: <nil>
STEP: delete the pod
Oct 13 00:54:58.411: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-nncv to disappear
Oct 13 00:54:58.655: INFO: Pod pod-subpath-test-preprovisionedpv-nncv no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-nncv
Oct 13 00:54:58.656: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-nncv" in namespace "provisioning-8223"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support existing directories when readOnly specified in the volumeSource
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:399
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource","total":-1,"completed":2,"skipped":4,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:01.972: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 24 lines ...
STEP: Building a namespace api object, basename projected
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable from pods in volume as non-root with FSGroup [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/projected_configmap.go:75
STEP: Creating configMap with name projected-configmap-test-volume-c64e7b60-3911-45ec-aa4d-8f1459f70d6f
STEP: Creating a pod to test consume configMaps
Oct 13 00:54:55.953: INFO: Waiting up to 5m0s for pod "pod-projected-configmaps-77d7c253-93a7-4a4b-8837-294ead9c8165" in namespace "projected-8213" to be "Succeeded or Failed"
Oct 13 00:54:56.192: INFO: Pod "pod-projected-configmaps-77d7c253-93a7-4a4b-8837-294ead9c8165": Phase="Pending", Reason="", readiness=false. Elapsed: 238.979217ms
Oct 13 00:54:58.432: INFO: Pod "pod-projected-configmaps-77d7c253-93a7-4a4b-8837-294ead9c8165": Phase="Pending", Reason="", readiness=false. Elapsed: 2.479269371s
Oct 13 00:55:00.671: INFO: Pod "pod-projected-configmaps-77d7c253-93a7-4a4b-8837-294ead9c8165": Phase="Pending", Reason="", readiness=false. Elapsed: 4.718343573s
Oct 13 00:55:02.911: INFO: Pod "pod-projected-configmaps-77d7c253-93a7-4a4b-8837-294ead9c8165": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.957831557s
STEP: Saw pod success
Oct 13 00:55:02.911: INFO: Pod "pod-projected-configmaps-77d7c253-93a7-4a4b-8837-294ead9c8165" satisfied condition "Succeeded or Failed"
Oct 13 00:55:03.150: INFO: Trying to get logs from node ip-172-20-37-188.ap-southeast-1.compute.internal pod pod-projected-configmaps-77d7c253-93a7-4a4b-8837-294ead9c8165 container agnhost-container: <nil>
STEP: delete the pod
Oct 13 00:55:03.637: INFO: Waiting for pod pod-projected-configmaps-77d7c253-93a7-4a4b-8837-294ead9c8165 to disappear
Oct 13 00:55:03.876: INFO: Pod pod-projected-configmaps-77d7c253-93a7-4a4b-8837-294ead9c8165 no longer exists
[AfterEach] [sig-storage] Projected configMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:10.077 seconds]
[sig-storage] Projected configMap
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should be consumable from pods in volume as non-root with FSGroup [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/projected_configmap.go:75
------------------------------
{"msg":"PASSED [sig-storage] Projected configMap should be consumable from pods in volume as non-root with FSGroup [LinuxOnly] [NodeFeature:FSGroup]","total":-1,"completed":4,"skipped":14,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:04.370: INFO: Only supported for providers [gce gke] (not aws)
... skipping 23 lines ...
Oct 13 00:54:56.208: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename downward-api
STEP: Waiting for a default service account to be provisioned in namespace
[It] should provide host IP as an env var [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test downward api env vars
Oct 13 00:54:57.674: INFO: Waiting up to 5m0s for pod "downward-api-114895a9-0047-45fd-88d6-bcda452c3d1d" in namespace "downward-api-9974" to be "Succeeded or Failed"
Oct 13 00:54:57.917: INFO: Pod "downward-api-114895a9-0047-45fd-88d6-bcda452c3d1d": Phase="Pending", Reason="", readiness=false. Elapsed: 243.402713ms
Oct 13 00:55:00.161: INFO: Pod "downward-api-114895a9-0047-45fd-88d6-bcda452c3d1d": Phase="Pending", Reason="", readiness=false. Elapsed: 2.487626764s
Oct 13 00:55:02.409: INFO: Pod "downward-api-114895a9-0047-45fd-88d6-bcda452c3d1d": Phase="Pending", Reason="", readiness=false. Elapsed: 4.735358563s
Oct 13 00:55:04.655: INFO: Pod "downward-api-114895a9-0047-45fd-88d6-bcda452c3d1d": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.98082537s
STEP: Saw pod success
Oct 13 00:55:04.655: INFO: Pod "downward-api-114895a9-0047-45fd-88d6-bcda452c3d1d" satisfied condition "Succeeded or Failed"
Oct 13 00:55:04.898: INFO: Trying to get logs from node ip-172-20-37-188.ap-southeast-1.compute.internal pod downward-api-114895a9-0047-45fd-88d6-bcda452c3d1d container dapi-container: <nil>
STEP: delete the pod
Oct 13 00:55:05.395: INFO: Waiting for pod downward-api-114895a9-0047-45fd-88d6-bcda452c3d1d to disappear
Oct 13 00:55:05.638: INFO: Pod downward-api-114895a9-0047-45fd-88d6-bcda452c3d1d no longer exists
[AfterEach] [sig-node] Downward API
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:9.921 seconds]
[sig-node] Downward API
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should provide host IP as an env var [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Downward API should provide host IP as an env var [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":20,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:06.143: INFO: Only supported for providers [gce gke] (not aws)
... skipping 178 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_volumes.go:40
    [Testpattern: Dynamic PV (default fs)] provisioning
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should provision storage with pvc data source
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:238
------------------------------
{"msg":"PASSED [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with pvc data source","total":-1,"completed":3,"skipped":7,"failed":0}

SSSS
------------------------------
[BeforeEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:55:00.749: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename emptydir
STEP: Waiting for a default service account to be provisioned in namespace
[It] should support (non-root,0644,default) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test emptydir 0644 on node default medium
Oct 13 00:55:02.203: INFO: Waiting up to 5m0s for pod "pod-2b0e9281-3535-4a3c-a615-816adc4538fb" in namespace "emptydir-7570" to be "Succeeded or Failed"
Oct 13 00:55:02.444: INFO: Pod "pod-2b0e9281-3535-4a3c-a615-816adc4538fb": Phase="Pending", Reason="", readiness=false. Elapsed: 241.064676ms
Oct 13 00:55:04.686: INFO: Pod "pod-2b0e9281-3535-4a3c-a615-816adc4538fb": Phase="Pending", Reason="", readiness=false. Elapsed: 2.482711169s
Oct 13 00:55:06.928: INFO: Pod "pod-2b0e9281-3535-4a3c-a615-816adc4538fb": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.724479914s
STEP: Saw pod success
Oct 13 00:55:06.928: INFO: Pod "pod-2b0e9281-3535-4a3c-a615-816adc4538fb" satisfied condition "Succeeded or Failed"
Oct 13 00:55:07.169: INFO: Trying to get logs from node ip-172-20-37-188.ap-southeast-1.compute.internal pod pod-2b0e9281-3535-4a3c-a615-816adc4538fb container test-container: <nil>
STEP: delete the pod
Oct 13 00:55:07.661: INFO: Waiting for pod pod-2b0e9281-3535-4a3c-a615-816adc4538fb to disappear
Oct 13 00:55:07.902: INFO: Pod pod-2b0e9281-3535-4a3c-a615-816adc4538fb no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:7.639 seconds]
[sig-storage] EmptyDir volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should support (non-root,0644,default) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes should support (non-root,0644,default) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":62,"failed":0}

SS
------------------------------
[BeforeEach] [sig-storage] HostPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 2 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-storage] HostPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/host_path.go:37
[It] should support subPath [NodeConformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/host_path.go:93
STEP: Creating a pod to test hostPath subPath
Oct 13 00:55:05.831: INFO: Waiting up to 5m0s for pod "pod-host-path-test" in namespace "hostpath-5671" to be "Succeeded or Failed"
Oct 13 00:55:06.070: INFO: Pod "pod-host-path-test": Phase="Pending", Reason="", readiness=false. Elapsed: 238.802127ms
Oct 13 00:55:08.311: INFO: Pod "pod-host-path-test": Phase="Pending", Reason="", readiness=false. Elapsed: 2.479560248s
Oct 13 00:55:10.550: INFO: Pod "pod-host-path-test": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.718993195s
STEP: Saw pod success
Oct 13 00:55:10.550: INFO: Pod "pod-host-path-test" satisfied condition "Succeeded or Failed"
Oct 13 00:55:10.790: INFO: Trying to get logs from node ip-172-20-37-188.ap-southeast-1.compute.internal pod pod-host-path-test container test-container-2: <nil>
STEP: delete the pod
Oct 13 00:55:11.281: INFO: Waiting for pod pod-host-path-test to disappear
Oct 13 00:55:11.520: INFO: Pod pod-host-path-test no longer exists
[AfterEach] [sig-storage] HostPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:7.605 seconds]
[sig-storage] HostPath
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should support subPath [NodeConformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/host_path.go:93
------------------------------
{"msg":"PASSED [sig-storage] HostPath should support subPath [NodeConformance]","total":-1,"completed":5,"skipped":21,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:12.008: INFO: Driver local doesn't support InlineVolume -- skipping
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 71 lines ...
[It] should support existing single file [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219
Oct 13 00:55:09.624: INFO: In-tree plugin kubernetes.io/empty-dir is not migrated, not validating any metrics
Oct 13 00:55:09.624: INFO: Creating resource for inline volume
STEP: Creating pod pod-subpath-test-inlinevolume-kwb4
STEP: Creating a pod to test subpath
Oct 13 00:55:09.867: INFO: Waiting up to 5m0s for pod "pod-subpath-test-inlinevolume-kwb4" in namespace "provisioning-4408" to be "Succeeded or Failed"
Oct 13 00:55:10.108: INFO: Pod "pod-subpath-test-inlinevolume-kwb4": Phase="Pending", Reason="", readiness=false. Elapsed: 240.919309ms
Oct 13 00:55:12.349: INFO: Pod "pod-subpath-test-inlinevolume-kwb4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.482292391s
Oct 13 00:55:14.592: INFO: Pod "pod-subpath-test-inlinevolume-kwb4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.72443995s
STEP: Saw pod success
Oct 13 00:55:14.592: INFO: Pod "pod-subpath-test-inlinevolume-kwb4" satisfied condition "Succeeded or Failed"
Oct 13 00:55:14.833: INFO: Trying to get logs from node ip-172-20-37-188.ap-southeast-1.compute.internal pod pod-subpath-test-inlinevolume-kwb4 container test-container-subpath-inlinevolume-kwb4: <nil>
STEP: delete the pod
Oct 13 00:55:15.367: INFO: Waiting for pod pod-subpath-test-inlinevolume-kwb4 to disappear
Oct 13 00:55:15.608: INFO: Pod pod-subpath-test-inlinevolume-kwb4 no longer exists
STEP: Deleting pod pod-subpath-test-inlinevolume-kwb4
Oct 13 00:55:15.608: INFO: Deleting pod "pod-subpath-test-inlinevolume-kwb4" in namespace "provisioning-4408"
... skipping 12 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support existing single file [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should support existing single file [LinuxOnly]","total":-1,"completed":6,"skipped":64,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
... skipping 133 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_volumes.go:40
    [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should not mount / map unused volumes in a pod [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:351
------------------------------
{"msg":"PASSED [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":-1,"completed":3,"skipped":24,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:17.973: INFO: Only supported for providers [vsphere] (not aws)
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 27 lines ...
Oct 13 00:53:48.921: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-9235llhpd
STEP: creating a claim
Oct 13 00:53:49.161: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-vmpb
STEP: Creating a pod to test subpath
Oct 13 00:53:49.904: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-vmpb" in namespace "provisioning-9235" to be "Succeeded or Failed"
Oct 13 00:53:50.144: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 239.603694ms
Oct 13 00:53:52.403: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 2.498326554s
Oct 13 00:53:54.645: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 4.741003189s
Oct 13 00:53:56.888: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 6.983482652s
Oct 13 00:53:59.136: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 9.231287172s
Oct 13 00:54:01.376: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 11.471574522s
Oct 13 00:54:03.618: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 13.713103285s
Oct 13 00:54:05.859: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 15.954196481s
Oct 13 00:54:08.099: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 18.194993057s
Oct 13 00:54:10.339: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 20.434936151s
Oct 13 00:54:12.580: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Succeeded", Reason="", readiness=false. Elapsed: 22.675970534s
STEP: Saw pod success
Oct 13 00:54:12.580: INFO: Pod "pod-subpath-test-dynamicpv-vmpb" satisfied condition "Succeeded or Failed"
Oct 13 00:54:12.820: INFO: Trying to get logs from node ip-172-20-55-159.ap-southeast-1.compute.internal pod pod-subpath-test-dynamicpv-vmpb container test-container-subpath-dynamicpv-vmpb: <nil>
STEP: delete the pod
Oct 13 00:54:13.339: INFO: Waiting for pod pod-subpath-test-dynamicpv-vmpb to disappear
Oct 13 00:54:13.585: INFO: Pod pod-subpath-test-dynamicpv-vmpb no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-vmpb
Oct 13 00:54:13.585: INFO: Deleting pod "pod-subpath-test-dynamicpv-vmpb" in namespace "provisioning-9235"
STEP: Creating pod pod-subpath-test-dynamicpv-vmpb
STEP: Creating a pod to test subpath
Oct 13 00:54:14.065: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-vmpb" in namespace "provisioning-9235" to be "Succeeded or Failed"
Oct 13 00:54:14.304: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 239.529831ms
Oct 13 00:54:16.545: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 2.479975795s
Oct 13 00:54:18.786: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 4.721030654s
Oct 13 00:54:21.050: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 6.985539603s
Oct 13 00:54:23.290: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 9.225684226s
Oct 13 00:54:25.531: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 11.465854154s
... skipping 8 lines ...
Oct 13 00:54:45.700: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 31.635288006s
Oct 13 00:54:47.947: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 33.882161443s
Oct 13 00:54:50.190: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 36.125706734s
Oct 13 00:54:52.431: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Pending", Reason="", readiness=false. Elapsed: 38.366580573s
Oct 13 00:54:54.673: INFO: Pod "pod-subpath-test-dynamicpv-vmpb": Phase="Succeeded", Reason="", readiness=false. Elapsed: 40.607777815s
STEP: Saw pod success
Oct 13 00:54:54.673: INFO: Pod "pod-subpath-test-dynamicpv-vmpb" satisfied condition "Succeeded or Failed"
Oct 13 00:54:54.912: INFO: Trying to get logs from node ip-172-20-37-188.ap-southeast-1.compute.internal pod pod-subpath-test-dynamicpv-vmpb container test-container-subpath-dynamicpv-vmpb: <nil>
STEP: delete the pod
Oct 13 00:54:55.400: INFO: Waiting for pod pod-subpath-test-dynamicpv-vmpb to disappear
Oct 13 00:54:55.640: INFO: Pod pod-subpath-test-dynamicpv-vmpb no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-vmpb
Oct 13 00:54:55.640: INFO: Deleting pod "pod-subpath-test-dynamicpv-vmpb" in namespace "provisioning-9235"
... skipping 21 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support existing directories when readOnly specified in the volumeSource
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:399
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource","total":-1,"completed":3,"skipped":31,"failed":0}

SSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:18.802: INFO: Driver emptydir doesn't support DynamicPV -- skipping
... skipping 25 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:50
[It] files with FSGroup ownership should support (root,0644,tmpfs)
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:67
STEP: Creating a pod to test emptydir 0644 on tmpfs
Oct 13 00:55:13.546: INFO: Waiting up to 5m0s for pod "pod-7e365b75-a56e-41e3-9051-ce9bddd69004" in namespace "emptydir-7734" to be "Succeeded or Failed"
Oct 13 00:55:13.784: INFO: Pod "pod-7e365b75-a56e-41e3-9051-ce9bddd69004": Phase="Pending", Reason="", readiness=false. Elapsed: 238.811249ms
Oct 13 00:55:16.028: INFO: Pod "pod-7e365b75-a56e-41e3-9051-ce9bddd69004": Phase="Pending", Reason="", readiness=false. Elapsed: 2.481935536s
Oct 13 00:55:18.267: INFO: Pod "pod-7e365b75-a56e-41e3-9051-ce9bddd69004": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.72179148s
STEP: Saw pod success
Oct 13 00:55:18.267: INFO: Pod "pod-7e365b75-a56e-41e3-9051-ce9bddd69004" satisfied condition "Succeeded or Failed"
Oct 13 00:55:18.506: INFO: Trying to get logs from node ip-172-20-55-159.ap-southeast-1.compute.internal pod pod-7e365b75-a56e-41e3-9051-ce9bddd69004 container test-container: <nil>
STEP: delete the pod
Oct 13 00:55:19.001: INFO: Waiting for pod pod-7e365b75-a56e-41e3-9051-ce9bddd69004 to disappear
Oct 13 00:55:19.240: INFO: Pod pod-7e365b75-a56e-41e3-9051-ce9bddd69004 no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 6 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:48
    files with FSGroup ownership should support (root,0644,tmpfs)
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:67
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup] files with FSGroup ownership should support (root,0644,tmpfs)","total":-1,"completed":6,"skipped":46,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:19.733: INFO: Driver hostPath doesn't support ext4 -- skipping
... skipping 126 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents","total":-1,"completed":3,"skipped":30,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:23.266: INFO: Only supported for providers [vsphere] (not aws)
... skipping 12 lines ...
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/provisioning.go:179

      Only supported for providers [vsphere] (not aws)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:1437
------------------------------
{"msg":"PASSED [sig-auth] ServiceAccounts should allow opting out of API token automount  [Conformance]","total":-1,"completed":3,"skipped":5,"failed":0}
[BeforeEach] [sig-network] DNS
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:54:25.369: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename dns
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 21 lines ...
STEP: retrieving the pod
STEP: looking for the results for each expected name from probers
Oct 13 00:54:50.172: INFO: File wheezy_udp@dns-test-service-3.dns-6203.svc.cluster.local from pod  dns-6203/dns-test-64471105-9f6a-4848-a040-627830962d77 contains 'foo.example.com.
' instead of 'bar.example.com.'
Oct 13 00:54:50.412: INFO: File jessie_udp@dns-test-service-3.dns-6203.svc.cluster.local from pod  dns-6203/dns-test-64471105-9f6a-4848-a040-627830962d77 contains 'foo.example.com.
' instead of 'bar.example.com.'
Oct 13 00:54:50.412: INFO: Lookups using dns-6203/dns-test-64471105-9f6a-4848-a040-627830962d77 failed for: [wheezy_udp@dns-test-service-3.dns-6203.svc.cluster.local jessie_udp@dns-test-service-3.dns-6203.svc.cluster.local]

Oct 13 00:54:55.652: INFO: File wheezy_udp@dns-test-service-3.dns-6203.svc.cluster.local from pod  dns-6203/dns-test-64471105-9f6a-4848-a040-627830962d77 contains 'foo.example.com.
' instead of 'bar.example.com.'
Oct 13 00:54:55.892: INFO: File jessie_udp@dns-test-service-3.dns-6203.svc.cluster.local from pod  dns-6203/dns-test-64471105-9f6a-4848-a040-627830962d77 contains 'foo.example.com.
' instead of 'bar.example.com.'
Oct 13 00:54:55.892: INFO: Lookups using dns-6203/dns-test-64471105-9f6a-4848-a040-627830962d77 failed for: [wheezy_udp@dns-test-service-3.dns-6203.svc.cluster.local jessie_udp@dns-test-service-3.dns-6203.svc.cluster.local]

Oct 13 00:55:00.653: INFO: File wheezy_udp@dns-test-service-3.dns-6203.svc.cluster.local from pod  dns-6203/dns-test-64471105-9f6a-4848-a040-627830962d77 contains 'foo.example.com.
' instead of 'bar.example.com.'
Oct 13 00:55:00.893: INFO: File jessie_udp@dns-test-service-3.dns-6203.svc.cluster.local from pod  dns-6203/dns-test-64471105-9f6a-4848-a040-627830962d77 contains 'foo.example.com.
' instead of 'bar.example.com.'
Oct 13 00:55:00.893: INFO: Lookups using dns-6203/dns-test-64471105-9f6a-4848-a040-627830962d77 failed for: [wheezy_udp@dns-test-service-3.dns-6203.svc.cluster.local jessie_udp@dns-test-service-3.dns-6203.svc.cluster.local]

Oct 13 00:55:05.894: INFO: DNS probes using dns-test-64471105-9f6a-4848-a040-627830962d77 succeeded

STEP: deleting the pod
STEP: changing the service to type=ClusterIP
STEP: Running these commands on wheezy: for i in `seq 1 30`; do dig +short dns-test-service-3.dns-6203.svc.cluster.local A > /results/wheezy_udp@dns-test-service-3.dns-6203.svc.cluster.local; sleep 1; done
... skipping 17 lines ...
• [SLOW TEST:57.930 seconds]
[sig-network] DNS
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/common/framework.go:23
  should provide DNS for ExternalName services [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-network] DNS should provide DNS for ExternalName services [Conformance]","total":-1,"completed":4,"skipped":5,"failed":0}

SSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:23.330: INFO: Only supported for providers [azure] (not aws)
... skipping 25 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-storage] Projected downwardAPI
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/projected_downwardapi.go:41
[It] should provide podname as non-root with fsgroup and defaultMode [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/projected_downwardapi.go:106
STEP: Creating a pod to test downward API volume plugin
Oct 13 00:55:19.441: INFO: Waiting up to 5m0s for pod "metadata-volume-9f15363b-d8da-457e-83fa-4d5cf500d65e" in namespace "projected-6700" to be "Succeeded or Failed"
Oct 13 00:55:19.684: INFO: Pod "metadata-volume-9f15363b-d8da-457e-83fa-4d5cf500d65e": Phase="Pending", Reason="", readiness=false. Elapsed: 242.873842ms
Oct 13 00:55:21.928: INFO: Pod "metadata-volume-9f15363b-d8da-457e-83fa-4d5cf500d65e": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.486184081s
STEP: Saw pod success
Oct 13 00:55:21.928: INFO: Pod "metadata-volume-9f15363b-d8da-457e-83fa-4d5cf500d65e" satisfied condition "Succeeded or Failed"
Oct 13 00:55:22.171: INFO: Trying to get logs from node ip-172-20-55-159.ap-southeast-1.compute.internal pod metadata-volume-9f15363b-d8da-457e-83fa-4d5cf500d65e container client-container: <nil>
STEP: delete the pod
Oct 13 00:55:22.703: INFO: Waiting for pod metadata-volume-9f15363b-d8da-457e-83fa-4d5cf500d65e to disappear
Oct 13 00:55:22.945: INFO: Pod metadata-volume-9f15363b-d8da-457e-83fa-4d5cf500d65e no longer exists
[AfterEach] [sig-storage] Projected downwardAPI
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:5.453 seconds]
[sig-storage] Projected downwardAPI
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should provide podname as non-root with fsgroup and defaultMode [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/projected_downwardapi.go:106
------------------------------
{"msg":"PASSED [sig-storage] Projected downwardAPI should provide podname as non-root with fsgroup and defaultMode [LinuxOnly] [NodeFeature:FSGroup]","total":-1,"completed":4,"skipped":25,"failed":0}

SSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] capacity
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:23.464: INFO: Driver aws doesn't publish storage capacity -- skipping
... skipping 67 lines ...
Oct 13 00:55:19.790: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename svcaccounts
STEP: Waiting for a default service account to be provisioned in namespace
[It] should mount projected service account token [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test service account token: 
Oct 13 00:55:21.227: INFO: Waiting up to 5m0s for pod "test-pod-559f056b-5926-4c90-9aab-3f5e09b2cf14" in namespace "svcaccounts-9357" to be "Succeeded or Failed"
Oct 13 00:55:21.466: INFO: Pod "test-pod-559f056b-5926-4c90-9aab-3f5e09b2cf14": Phase="Pending", Reason="", readiness=false. Elapsed: 239.028764ms
Oct 13 00:55:23.705: INFO: Pod "test-pod-559f056b-5926-4c90-9aab-3f5e09b2cf14": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.478212019s
STEP: Saw pod success
Oct 13 00:55:23.705: INFO: Pod "test-pod-559f056b-5926-4c90-9aab-3f5e09b2cf14" satisfied condition "Succeeded or Failed"
Oct 13 00:55:23.947: INFO: Trying to get logs from node ip-172-20-37-188.ap-southeast-1.compute.internal pod test-pod-559f056b-5926-4c90-9aab-3f5e09b2cf14 container agnhost-container: <nil>
STEP: delete the pod
Oct 13 00:55:24.434: INFO: Waiting for pod test-pod-559f056b-5926-4c90-9aab-3f5e09b2cf14 to disappear
Oct 13 00:55:24.673: INFO: Pod test-pod-559f056b-5926-4c90-9aab-3f5e09b2cf14 no longer exists
[AfterEach] [sig-auth] ServiceAccounts
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:5.363 seconds]
[sig-auth] ServiceAccounts
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/auth/framework.go:23
  should mount projected service account token [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-auth] ServiceAccounts should mount projected service account token [Conformance]","total":-1,"completed":7,"skipped":61,"failed":0}

SSSS
------------------------------
[BeforeEach] [sig-node] Pods Extended
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 11 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:55:25.209: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "pods-540" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Pods Extended Pods Set QOS Class should be set on Pods with matching resource requests and limits for memory and cpu [Conformance]","total":-1,"completed":5,"skipped":40,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:25.721: INFO: Driver hostPathSymlink doesn't support DynamicPV -- skipping
... skipping 142 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should not mount / map unused volumes in a pod [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:351
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-bindmounted] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":-1,"completed":7,"skipped":63,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:28.132: INFO: Only supported for providers [vsphere] (not aws)
... skipping 113 lines ...
Oct 13 00:53:43.160: INFO: waiting for CSIDriver csi-mock-csi-mock-volumes-7716 to register on node ip-172-20-43-74.ap-southeast-1.compute.internal
STEP: Creating pod
Oct 13 00:54:11.284: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Oct 13 00:54:11.531: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-8bdsb] to have phase Bound
Oct 13 00:54:11.774: INFO: PersistentVolumeClaim pvc-8bdsb found and phase=Bound (242.752696ms)
STEP: checking for CSIInlineVolumes feature
Oct 13 00:54:29.493: INFO: Error getting logs for pod inline-volume-zdwj6: the server rejected our request for an unknown reason (get pods inline-volume-zdwj6)
Oct 13 00:54:29.979: INFO: Deleting pod "inline-volume-zdwj6" in namespace "csi-mock-volumes-7716"
Oct 13 00:54:30.224: INFO: Wait up to 5m0s for pod "inline-volume-zdwj6" to be fully deleted
STEP: Deleting the previously created pod
Oct 13 00:54:38.712: INFO: Deleting pod "pvc-volume-tester-bc665" in namespace "csi-mock-volumes-7716"
Oct 13 00:54:38.962: INFO: Wait up to 5m0s for pod "pvc-volume-tester-bc665" to be fully deleted
STEP: Checking CSI driver logs
Oct 13 00:54:47.714: INFO: Found volume attribute csi.storage.k8s.io/serviceAccount.name: default
Oct 13 00:54:47.714: INFO: Found volume attribute csi.storage.k8s.io/ephemeral: false
Oct 13 00:54:47.714: INFO: Found volume attribute csi.storage.k8s.io/pod.name: pvc-volume-tester-bc665
Oct 13 00:54:47.714: INFO: Found volume attribute csi.storage.k8s.io/pod.namespace: csi-mock-volumes-7716
Oct 13 00:54:47.714: INFO: Found volume attribute csi.storage.k8s.io/pod.uid: 2076379d-f66e-43d9-ac43-f786819eff3a
Oct 13 00:54:47.714: INFO: Found NodeUnpublishVolume: {json: {"Method":"/csi.v1.Node/NodeUnpublishVolume","Request":{"volume_id":"4","target_path":"/var/lib/kubelet/pods/2076379d-f66e-43d9-ac43-f786819eff3a/volumes/kubernetes.io~csi/pvc-b92cc688-489a-4932-81b4-e1fba1dd2aff/mount"},"Response":{},"Error":"","FullError":null} Method:NodeUnpublishVolume Request:{VolumeContext:map[]} FullError:{Code:OK Message:} Error:}
STEP: Deleting pod pvc-volume-tester-bc665
Oct 13 00:54:47.714: INFO: Deleting pod "pvc-volume-tester-bc665" in namespace "csi-mock-volumes-7716"
STEP: Deleting claim pvc-8bdsb
Oct 13 00:54:48.449: INFO: Waiting up to 2m0s for PersistentVolume pvc-b92cc688-489a-4932-81b4-e1fba1dd2aff to get deleted
Oct 13 00:54:48.694: INFO: PersistentVolume pvc-b92cc688-489a-4932-81b4-e1fba1dd2aff was removed
STEP: Deleting storageclass csi-mock-volumes-7716-sczs6b8
... skipping 44 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  CSI workload information using mock driver
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:443
    should be passed when podInfoOnMount=true
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:493
------------------------------
{"msg":"PASSED [sig-storage] CSI mock volume CSI workload information using mock driver should be passed when podInfoOnMount=true","total":-1,"completed":2,"skipped":25,"failed":0}

SSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:32.039: INFO: Driver csi-hostpath doesn't support InlineVolume -- skipping
... skipping 126 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: azure-disk]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (immediate binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Only supported for providers [azure] (not aws)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:1566
------------------------------
... skipping 110 lines ...
• [SLOW TEST:10.193 seconds]
[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should mutate pod and apply defaults after mutation [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate pod and apply defaults after mutation [Conformance]","total":-1,"completed":8,"skipped":65,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-storage] ConfigMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:55:28.184: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename configmap
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable from pods in volume with mappings and Item mode set [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating configMap with name configmap-test-volume-map-c50f2b1c-194e-4cec-92c6-105da2513055
STEP: Creating a pod to test consume configMaps
Oct 13 00:55:29.898: INFO: Waiting up to 5m0s for pod "pod-configmaps-397b637d-c27b-4b0b-9980-f281112bff83" in namespace "configmap-6072" to be "Succeeded or Failed"
Oct 13 00:55:30.140: INFO: Pod "pod-configmaps-397b637d-c27b-4b0b-9980-f281112bff83": Phase="Pending", Reason="", readiness=false. Elapsed: 241.613145ms
Oct 13 00:55:32.382: INFO: Pod "pod-configmaps-397b637d-c27b-4b0b-9980-f281112bff83": Phase="Pending", Reason="", readiness=false. Elapsed: 2.483880428s
Oct 13 00:55:34.678: INFO: Pod "pod-configmaps-397b637d-c27b-4b0b-9980-f281112bff83": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.77984869s
STEP: Saw pod success
Oct 13 00:55:34.678: INFO: Pod "pod-configmaps-397b637d-c27b-4b0b-9980-f281112bff83" satisfied condition "Succeeded or Failed"
Oct 13 00:55:34.924: INFO: Trying to get logs from node ip-172-20-37-188.ap-southeast-1.compute.internal pod pod-configmaps-397b637d-c27b-4b0b-9980-f281112bff83 container agnhost-container: <nil>
STEP: delete the pod
Oct 13 00:55:35.497: INFO: Waiting for pod pod-configmaps-397b637d-c27b-4b0b-9980-f281112bff83 to disappear
Oct 13 00:55:35.744: INFO: Pod pod-configmaps-397b637d-c27b-4b0b-9980-f281112bff83 no longer exists
[AfterEach] [sig-storage] ConfigMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:8.046 seconds]
[sig-storage] ConfigMap
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should be consumable from pods in volume with mappings and Item mode set [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] ConfigMap should be consumable from pods in volume with mappings and Item mode set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":8,"skipped":76,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:36.239: INFO: Driver local doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (block volmode)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 11 lines ...
      Driver local doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
SSSSSS
------------------------------
{"msg":"PASSED [sig-node] Pods should be updated [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":15,"failed":0}
[BeforeEach] [sig-auth] ServiceAccounts
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:55:33.700: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename svcaccounts
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 10 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:55:37.109: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "svcaccounts-4481" for this suite.

•
------------------------------
{"msg":"PASSED [sig-auth] ServiceAccounts should guarantee kube-root-ca.crt exist in any namespace [Conformance]","total":-1,"completed":6,"skipped":15,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:37.605: INFO: Only supported for providers [openstack] (not aws)
... skipping 59 lines ...
Oct 13 00:53:40.520: INFO: creating *v1.ClusterRoleBinding: csi-controller-snapshotter-role-csi-mock-volumes-1592
Oct 13 00:53:40.763: INFO: creating *v1.StorageClass: csi-mock-sc-csi-mock-volumes-1592
Oct 13 00:53:41.006: INFO: creating *v1.StatefulSet: csi-mock-volumes-1592-268/csi-mockplugin
Oct 13 00:53:41.252: INFO: creating *v1.CSIDriver: csi-mock-csi-mock-volumes-1592
Oct 13 00:53:41.496: INFO: waiting up to 4m0s for CSIDriver "csi-mock-csi-mock-volumes-1592"
Oct 13 00:53:41.738: INFO: waiting for CSIDriver csi-mock-csi-mock-volumes-1592 to register on node ip-172-20-48-187.ap-southeast-1.compute.internal
I1013 00:53:57.133353    5353 csi.go:431] gRPCCall: {"Method":"/csi.v1.Identity/GetPluginInfo","Request":{},"Response":{"name":"csi-mock-csi-mock-volumes-1592","vendor_version":"0.3.0","manifest":{"url":"https://k8s.io/kubernetes/test/e2e/storage/drivers/csi-test/mock"}},"Error":"","FullError":null}
I1013 00:53:58.409255    5353 csi.go:431] gRPCCall: {"Method":"/csi.v1.Identity/Probe","Request":{},"Response":{"ready":{"value":true}},"Error":"","FullError":null}
I1013 00:53:58.654847    5353 csi.go:431] gRPCCall: {"Method":"/csi.v1.Identity/GetPluginInfo","Request":{},"Response":{"name":"csi-mock-csi-mock-volumes-1592","vendor_version":"0.3.0","manifest":{"url":"https://k8s.io/kubernetes/test/e2e/storage/drivers/csi-test/mock"}},"Error":"","FullError":null}
I1013 00:53:58.900273    5353 csi.go:431] gRPCCall: {"Method":"/csi.v1.Identity/GetPluginCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}}]},"Error":"","FullError":null}
I1013 00:53:59.199605    5353 csi.go:431] gRPCCall: {"Method":"/csi.v1.Controller/ControllerGetCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":8}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":12}}},{"Type":{"Rpc":{"type":11}}},{"Type":{"Rpc":{"type":9}}}]},"Error":"","FullError":null}
I1013 00:53:59.672317    5353 csi.go:431] gRPCCall: {"Method":"/csi.v1.Node/NodeGetInfo","Request":{},"Response":{"node_id":"csi-mock-csi-mock-volumes-1592"},"Error":"","FullError":null}
STEP: Creating pod
Oct 13 00:54:10.064: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
I1013 00:54:10.588560    5353 csi.go:431] gRPCCall: {"Method":"/csi.v1.Controller/CreateVolume","Request":{"name":"pvc-f8288704-99b2-44c7-8db8-24a10c050cd7","capacity_range":{"required_bytes":1073741824},"volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}}]},"Response":null,"Error":"rpc error: code = ResourceExhausted desc = fake error","FullError":{"code":8,"message":"fake error"}}
I1013 00:54:10.845458    5353 csi.go:431] gRPCCall: {"Method":"/csi.v1.Controller/CreateVolume","Request":{"name":"pvc-f8288704-99b2-44c7-8db8-24a10c050cd7","capacity_range":{"required_bytes":1073741824},"volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}}]},"Response":{"volume":{"capacity_bytes":1073741824,"volume_id":"4","volume_context":{"name":"pvc-f8288704-99b2-44c7-8db8-24a10c050cd7"}}},"Error":"","FullError":null}
I1013 00:54:12.198147    5353 csi.go:431] gRPCCall: {"Method":"/csi.v1.Node/NodeGetCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Rpc":{}}},{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":4}}}]},"Error":"","FullError":null}
Oct 13 00:54:12.449: INFO: >>> kubeConfig: /root/.kube/config
I1013 00:54:14.027787    5353 csi.go:431] gRPCCall: {"Method":"/csi.v1.Node/NodeStageVolume","Request":{"volume_id":"4","staging_target_path":"/var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-f8288704-99b2-44c7-8db8-24a10c050cd7/globalmount","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-f8288704-99b2-44c7-8db8-24a10c050cd7","storage.kubernetes.io/csiProvisionerIdentity":"1634086439334-8081-csi-mock-csi-mock-volumes-1592"}},"Response":{},"Error":"","FullError":null}
I1013 00:54:14.473002    5353 csi.go:431] gRPCCall: {"Method":"/csi.v1.Node/NodeGetCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Rpc":{}}},{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":4}}}]},"Error":"","FullError":null}
Oct 13 00:54:14.714: INFO: >>> kubeConfig: /root/.kube/config
Oct 13 00:54:16.335: INFO: >>> kubeConfig: /root/.kube/config
Oct 13 00:54:17.863: INFO: >>> kubeConfig: /root/.kube/config
I1013 00:54:19.573917    5353 csi.go:431] gRPCCall: {"Method":"/csi.v1.Node/NodePublishVolume","Request":{"volume_id":"4","staging_target_path":"/var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-f8288704-99b2-44c7-8db8-24a10c050cd7/globalmount","target_path":"/var/lib/kubelet/pods/70bcfdb9-d169-4a2f-ad9a-2bc1eaf6bd92/volumes/kubernetes.io~csi/pvc-f8288704-99b2-44c7-8db8-24a10c050cd7/mount","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-f8288704-99b2-44c7-8db8-24a10c050cd7","storage.kubernetes.io/csiProvisionerIdentity":"1634086439334-8081-csi-mock-csi-mock-volumes-1592"}},"Response":{},"Error":"","FullError":null}
Oct 13 00:54:23.041: INFO: Deleting pod "pvc-volume-tester-tldc5" in namespace "csi-mock-volumes-1592"
Oct 13 00:54:23.286: INFO: Wait up to 5m0s for pod "pvc-volume-tester-tldc5" to be fully deleted
Oct 13 00:54:25.960: INFO: >>> kubeConfig: /root/.kube/config
I1013 00:54:27.468384    5353 csi.go:431] gRPCCall: {"Method":"/csi.v1.Node/NodeUnpublishVolume","Request":{"volume_id":"4","target_path":"/var/lib/kubelet/pods/70bcfdb9-d169-4a2f-ad9a-2bc1eaf6bd92/volumes/kubernetes.io~csi/pvc-f8288704-99b2-44c7-8db8-24a10c050cd7/mount"},"Response":{},"Error":"","FullError":null}
I1013 00:54:27.793653    5353 csi.go:431] gRPCCall: {"Method":"/csi.v1.Node/NodeGetCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Rpc":{}}},{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":4}}}]},"Error":"","FullError":null}
I1013 00:54:28.030423    5353 csi.go:431] gRPCCall: {"Method":"/csi.v1.Node/NodeUnstageVolume","Request":{"volume_id":"4","staging_target_path":"/var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-f8288704-99b2-44c7-8db8-24a10c050cd7/globalmount"},"Response":{},"Error":"","FullError":null}
I1013 00:54:36.036932    5353 csi.go:431] gRPCCall: {"Method":"/csi.v1.Controller/DeleteVolume","Request":{"volume_id":"4"},"Response":{},"Error":"","FullError":null}
STEP: Checking PVC events
Oct 13 00:54:37.019: INFO: PVC event ADDED: &v1.PersistentVolumeClaim{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-5lg2l", GenerateName:"pvc-", Namespace:"csi-mock-volumes-1592", SelfLink:"", UID:"f8288704-99b2-44c7-8db8-24a10c050cd7", ResourceVersion:"4299", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63769683250, loc:(*time.Location)(0x9e12f00)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string{"kubernetes.io/pvc-protection"}, ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"e2e.test", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc002af4318), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc002af4330)}}}, Spec:v1.PersistentVolumeClaimSpec{AccessModes:[]v1.PersistentVolumeAccessMode{"ReadWriteOnce"}, Selector:(*v1.LabelSelector)(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList{"storage":resource.Quantity{i:resource.int64Amount{value:1073741824, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"1Gi", Format:"BinarySI"}}}, VolumeName:"", StorageClassName:(*string)(0xc00323e380), VolumeMode:(*v1.PersistentVolumeMode)(0xc00323e390), DataSource:(*v1.TypedLocalObjectReference)(nil)}, Status:v1.PersistentVolumeClaimStatus{Phase:"Pending", AccessModes:[]v1.PersistentVolumeAccessMode(nil), Capacity:v1.ResourceList(nil), Conditions:[]v1.PersistentVolumeClaimCondition(nil)}}
Oct 13 00:54:37.019: INFO: PVC event MODIFIED: &v1.PersistentVolumeClaim{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-5lg2l", GenerateName:"pvc-", Namespace:"csi-mock-volumes-1592", SelfLink:"", UID:"f8288704-99b2-44c7-8db8-24a10c050cd7", ResourceVersion:"4307", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63769683250, loc:(*time.Location)(0x9e12f00)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string{"volume.kubernetes.io/selected-node":"ip-172-20-48-187.ap-southeast-1.compute.internal"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string{"kubernetes.io/pvc-protection"}, ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"e2e.test", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc002af4600), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc002af4618)}, v1.ManagedFieldsEntry{Manager:"kube-scheduler", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc002af4630), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc002af4648)}}}, Spec:v1.PersistentVolumeClaimSpec{AccessModes:[]v1.PersistentVolumeAccessMode{"ReadWriteOnce"}, Selector:(*v1.LabelSelector)(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList{"storage":resource.Quantity{i:resource.int64Amount{value:1073741824, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"1Gi", Format:"BinarySI"}}}, VolumeName:"", StorageClassName:(*string)(0xc00323e550), VolumeMode:(*v1.PersistentVolumeMode)(0xc00323e570), DataSource:(*v1.TypedLocalObjectReference)(nil)}, Status:v1.PersistentVolumeClaimStatus{Phase:"Pending", AccessModes:[]v1.PersistentVolumeAccessMode(nil), Capacity:v1.ResourceList(nil), Conditions:[]v1.PersistentVolumeClaimCondition(nil)}}
Oct 13 00:54:37.020: INFO: PVC event MODIFIED: &v1.PersistentVolumeClaim{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-5lg2l", GenerateName:"pvc-", Namespace:"csi-mock-volumes-1592", SelfLink:"", UID:"f8288704-99b2-44c7-8db8-24a10c050cd7", ResourceVersion:"4308", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63769683250, loc:(*time.Location)(0x9e12f00)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string{"volume.beta.kubernetes.io/storage-provisioner":"csi-mock-csi-mock-volumes-1592", "volume.kubernetes.io/selected-node":"ip-172-20-48-187.ap-southeast-1.compute.internal"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string{"kubernetes.io/pvc-protection"}, ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"e2e.test", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc003f55d28), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc003f55d40)}, v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc003f55d58), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc003f55d70)}, v1.ManagedFieldsEntry{Manager:"kube-scheduler", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc003f55d88), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc003f55da0)}}}, Spec:v1.PersistentVolumeClaimSpec{AccessModes:[]v1.PersistentVolumeAccessMode{"ReadWriteOnce"}, Selector:(*v1.LabelSelector)(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList{"storage":resource.Quantity{i:resource.int64Amount{value:1073741824, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"1Gi", Format:"BinarySI"}}}, VolumeName:"", StorageClassName:(*string)(0xc0025f6ac0), VolumeMode:(*v1.PersistentVolumeMode)(0xc0025f6ad0), DataSource:(*v1.TypedLocalObjectReference)(nil)}, Status:v1.PersistentVolumeClaimStatus{Phase:"Pending", AccessModes:[]v1.PersistentVolumeAccessMode(nil), Capacity:v1.ResourceList(nil), Conditions:[]v1.PersistentVolumeClaimCondition(nil)}}
Oct 13 00:54:37.020: INFO: PVC event MODIFIED: &v1.PersistentVolumeClaim{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-5lg2l", GenerateName:"pvc-", Namespace:"csi-mock-volumes-1592", SelfLink:"", UID:"f8288704-99b2-44c7-8db8-24a10c050cd7", ResourceVersion:"4325", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63769683250, loc:(*time.Location)(0x9e12f00)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string{"pv.kubernetes.io/bind-completed":"yes", "pv.kubernetes.io/bound-by-controller":"yes", "volume.beta.kubernetes.io/storage-provisioner":"csi-mock-csi-mock-volumes-1592", "volume.kubernetes.io/selected-node":"ip-172-20-48-187.ap-southeast-1.compute.internal"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string{"kubernetes.io/pvc-protection"}, ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"e2e.test", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc0039a2078), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0039a20a8)}, v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc0039a20c0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0039a20d8)}, v1.ManagedFieldsEntry{Manager:"kube-scheduler", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc0039a20f0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0039a2108)}}}, Spec:v1.PersistentVolumeClaimSpec{AccessModes:[]v1.PersistentVolumeAccessMode{"ReadWriteOnce"}, Selector:(*v1.LabelSelector)(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList{"storage":resource.Quantity{i:resource.int64Amount{value:1073741824, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"1Gi", Format:"BinarySI"}}}, VolumeName:"pvc-f8288704-99b2-44c7-8db8-24a10c050cd7", StorageClassName:(*string)(0xc002976210), VolumeMode:(*v1.PersistentVolumeMode)(0xc002976230), DataSource:(*v1.TypedLocalObjectReference)(nil)}, Status:v1.PersistentVolumeClaimStatus{Phase:"Pending", AccessModes:[]v1.PersistentVolumeAccessMode(nil), Capacity:v1.ResourceList(nil), Conditions:[]v1.PersistentVolumeClaimCondition(nil)}}
Oct 13 00:54:37.020: INFO: PVC event MODIFIED: &v1.PersistentVolumeClaim{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-5lg2l", GenerateName:"pvc-", Namespace:"csi-mock-volumes-1592", SelfLink:"", UID:"f8288704-99b2-44c7-8db8-24a10c050cd7", ResourceVersion:"4326", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63769683250, loc:(*time.Location)(0x9e12f00)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string{"pv.kubernetes.io/bind-completed":"yes", "pv.kubernetes.io/bound-by-controller":"yes", "volume.beta.kubernetes.io/storage-provisioner":"csi-mock-csi-mock-volumes-1592", "volume.kubernetes.io/selected-node":"ip-172-20-48-187.ap-southeast-1.compute.internal"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string{"kubernetes.io/pvc-protection"}, ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"e2e.test", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc0039a2138), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0039a2150)}, v1.ManagedFieldsEntry{Manager:"kube-scheduler", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc0039a2168), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0039a2180)}, v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc0039a2198), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0039a21b0)}}}, Spec:v1.PersistentVolumeClaimSpec{AccessModes:[]v1.PersistentVolumeAccessMode{"ReadWriteOnce"}, Selector:(*v1.LabelSelector)(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList{"storage":resource.Quantity{i:resource.int64Amount{value:1073741824, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"1Gi", Format:"BinarySI"}}}, VolumeName:"pvc-f8288704-99b2-44c7-8db8-24a10c050cd7", StorageClassName:(*string)(0xc002976280), VolumeMode:(*v1.PersistentVolumeMode)(0xc002976290), DataSource:(*v1.TypedLocalObjectReference)(nil)}, Status:v1.PersistentVolumeClaimStatus{Phase:"Bound", AccessModes:[]v1.PersistentVolumeAccessMode{"ReadWriteOnce"}, Capacity:v1.ResourceList{"storage":resource.Quantity{i:resource.int64Amount{value:1073741824, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"1Gi", Format:"BinarySI"}}, Conditions:[]v1.PersistentVolumeClaimCondition(nil)}}
... skipping 49 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  storage capacity
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:900
    exhausted, late binding, no topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:958
------------------------------
{"msg":"PASSED [sig-storage] CSI mock volume storage capacity exhausted, late binding, no topology","total":-1,"completed":2,"skipped":33,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:38.274: INFO: Driver local doesn't support InlineVolume -- skipping
[AfterEach] [Testpattern: Inline-volume (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 39 lines ...
• [SLOW TEST:22.859 seconds]
[sig-node] Probing container
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should be restarted with a /healthz http liveness probe [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Probing container should be restarted with a /healthz http liveness probe [NodeConformance] [Conformance]","total":-1,"completed":7,"skipped":66,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:39.472: INFO: Only supported for providers [gce gke] (not aws)
... skipping 37 lines ...
• [SLOW TEST:32.940 seconds]
[sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  works for multiple CRDs of different groups [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of different groups [Conformance]","total":-1,"completed":4,"skipped":11,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:39.922: INFO: Only supported for providers [gce gke] (not aws)
[AfterEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 2 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: gcepd]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (delayed binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Only supported for providers [gce gke] (not aws)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:1301
------------------------------
... skipping 203 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_volumes.go:40
    [Testpattern: Dynamic PV (block volmode)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should store data
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (block volmode)] volumes should store data","total":-1,"completed":2,"skipped":3,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-storage] Downward API volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 2 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-storage] Downward API volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/downwardapi_volume.go:41
[It] should set mode on item file [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test downward API volume plugin
Oct 13 00:55:39.761: INFO: Waiting up to 5m0s for pod "downwardapi-volume-c90996f0-1cf6-45e9-8b48-f6c2d829663a" in namespace "downward-api-2111" to be "Succeeded or Failed"
Oct 13 00:55:40.003: INFO: Pod "downwardapi-volume-c90996f0-1cf6-45e9-8b48-f6c2d829663a": Phase="Pending", Reason="", readiness=false. Elapsed: 242.515771ms
Oct 13 00:55:42.247: INFO: Pod "downwardapi-volume-c90996f0-1cf6-45e9-8b48-f6c2d829663a": Phase="Pending", Reason="", readiness=false. Elapsed: 2.486383454s
Oct 13 00:55:44.490: INFO: Pod "downwardapi-volume-c90996f0-1cf6-45e9-8b48-f6c2d829663a": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.729695587s
STEP: Saw pod success
Oct 13 00:55:44.491: INFO: Pod "downwardapi-volume-c90996f0-1cf6-45e9-8b48-f6c2d829663a" satisfied condition "Succeeded or Failed"
Oct 13 00:55:44.733: INFO: Trying to get logs from node ip-172-20-43-74.ap-southeast-1.compute.internal pod downwardapi-volume-c90996f0-1cf6-45e9-8b48-f6c2d829663a container client-container: <nil>
STEP: delete the pod
Oct 13 00:55:45.227: INFO: Waiting for pod downwardapi-volume-c90996f0-1cf6-45e9-8b48-f6c2d829663a to disappear
Oct 13 00:55:45.470: INFO: Pod downwardapi-volume-c90996f0-1cf6-45e9-8b48-f6c2d829663a no longer exists
[AfterEach] [sig-storage] Downward API volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:7.680 seconds]
[sig-storage] Downward API volume
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should set mode on item file [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Downward API volume should set mode on item file [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":3,"skipped":36,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:45.979: INFO: Driver csi-hostpath doesn't support InlineVolume -- skipping
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 65 lines ...
• [SLOW TEST:11.342 seconds]
[sig-auth] ServiceAccounts
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/auth/framework.go:23
  should ensure a single API token exists
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/auth/service_accounts.go:52
------------------------------
{"msg":"PASSED [sig-auth] ServiceAccounts should ensure a single API token exists","total":-1,"completed":9,"skipped":68,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:46.759: INFO: Only supported for providers [gce gke] (not aws)
... skipping 81 lines ...
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:449

      Only supported for providers [gce gke] (not aws)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:1301
------------------------------
{"msg":"PASSED [sig-network] DNS should provide /etc/hosts entries for the cluster [LinuxOnly] [Conformance]","total":-1,"completed":3,"skipped":31,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:55:40.950: INFO: >>> kubeConfig: /root/.kube/config
... skipping 2 lines ...
[It] should support existing single file [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219
Oct 13 00:55:42.228: INFO: In-tree plugin kubernetes.io/host-path is not migrated, not validating any metrics
Oct 13 00:55:42.472: INFO: Creating resource for inline volume
STEP: Creating pod pod-subpath-test-inlinevolume-zgsv
STEP: Creating a pod to test subpath
Oct 13 00:55:42.720: INFO: Waiting up to 5m0s for pod "pod-subpath-test-inlinevolume-zgsv" in namespace "provisioning-539" to be "Succeeded or Failed"
Oct 13 00:55:42.963: INFO: Pod "pod-subpath-test-inlinevolume-zgsv": Phase="Pending", Reason="", readiness=false. Elapsed: 242.795551ms
Oct 13 00:55:45.207: INFO: Pod "pod-subpath-test-inlinevolume-zgsv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.486720272s
Oct 13 00:55:47.450: INFO: Pod "pod-subpath-test-inlinevolume-zgsv": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.730262589s
STEP: Saw pod success
Oct 13 00:55:47.451: INFO: Pod "pod-subpath-test-inlinevolume-zgsv" satisfied condition "Succeeded or Failed"
Oct 13 00:55:47.694: INFO: Trying to get logs from node ip-172-20-43-74.ap-southeast-1.compute.internal pod pod-subpath-test-inlinevolume-zgsv container test-container-subpath-inlinevolume-zgsv: <nil>
STEP: delete the pod
Oct 13 00:55:48.198: INFO: Waiting for pod pod-subpath-test-inlinevolume-zgsv to disappear
Oct 13 00:55:48.440: INFO: Pod pod-subpath-test-inlinevolume-zgsv no longer exists
STEP: Deleting pod pod-subpath-test-inlinevolume-zgsv
Oct 13 00:55:48.440: INFO: Deleting pod "pod-subpath-test-inlinevolume-zgsv" in namespace "provisioning-539"
... skipping 12 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support existing single file [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: hostPath] [Testpattern: Inline-volume (default fs)] subPath should support existing single file [LinuxOnly]","total":-1,"completed":4,"skipped":31,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:49.425: INFO: Driver local doesn't support InlineVolume -- skipping
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 72 lines ...
[BeforeEach] [sig-apps] Job
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:55:46.839: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename job
STEP: Waiting for a default service account to be provisioned in namespace
[It] should fail when exceeds active deadline
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/job.go:253
STEP: Creating a job
STEP: Ensuring job past active deadline
[AfterEach] [sig-apps] Job
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:55:50.515: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "job-3099" for this suite.

•
------------------------------
{"msg":"PASSED [sig-apps] Job should fail when exceeds active deadline","total":-1,"completed":10,"skipped":89,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:51.016: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 66 lines ...
Oct 13 00:55:33.518: INFO: PersistentVolumeClaim pvc-r6v72 found and phase=Bound (6.962038517s)
Oct 13 00:55:33.519: INFO: Waiting up to 3m0s for PersistentVolume nfs-2sfzm to have phase Bound
Oct 13 00:55:33.758: INFO: PersistentVolume nfs-2sfzm found and phase=Bound (239.420984ms)
STEP: Checking pod has write access to PersistentVolume
Oct 13 00:55:34.238: INFO: Creating nfs test pod
Oct 13 00:55:34.488: INFO: Pod should terminate with exitcode 0 (success)
Oct 13 00:55:34.489: INFO: Waiting up to 5m0s for pod "pvc-tester-lqtl8" in namespace "pv-6728" to be "Succeeded or Failed"
Oct 13 00:55:34.731: INFO: Pod "pvc-tester-lqtl8": Phase="Pending", Reason="", readiness=false. Elapsed: 242.317392ms
Oct 13 00:55:36.971: INFO: Pod "pvc-tester-lqtl8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.482467783s
Oct 13 00:55:39.212: INFO: Pod "pvc-tester-lqtl8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.723740482s
Oct 13 00:55:41.499: INFO: Pod "pvc-tester-lqtl8": Phase="Succeeded", Reason="", readiness=false. Elapsed: 7.010502791s
STEP: Saw pod success
Oct 13 00:55:41.499: INFO: Pod "pvc-tester-lqtl8" satisfied condition "Succeeded or Failed"
Oct 13 00:55:41.499: INFO: Pod pvc-tester-lqtl8 succeeded 
Oct 13 00:55:41.499: INFO: Deleting pod "pvc-tester-lqtl8" in namespace "pv-6728"
Oct 13 00:55:41.747: INFO: Wait up to 5m0s for pod "pvc-tester-lqtl8" to be fully deleted
STEP: Deleting the PVC to invoke the reclaim policy.
Oct 13 00:55:41.987: INFO: Deleting PVC pvc-r6v72 to trigger reclamation of PV 
Oct 13 00:55:41.987: INFO: Deleting PersistentVolumeClaim "pvc-r6v72"
... skipping 23 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes.go:122
    with Single PV - PVC pairs
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes.go:155
      create a PVC and non-pre-bound PV: test write access
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes.go:178
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes NFS with Single PV - PVC pairs create a PVC and non-pre-bound PV: test write access","total":-1,"completed":4,"skipped":46,"failed":0}

SSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:58.433: INFO: Only supported for providers [vsphere] (not aws)
... skipping 169 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  CSI online volume expansion
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:672
    should expand volume without restarting pod if attach=on, nodeExpansion=on
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:687
------------------------------
{"msg":"PASSED [sig-storage] CSI mock volume CSI online volume expansion should expand volume without restarting pod if attach=on, nodeExpansion=on","total":-1,"completed":4,"skipped":36,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 28 lines ...
• [SLOW TEST:14.224 seconds]
[sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should be able to convert a non homogeneous list of CRs [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] should be able to convert a non homogeneous list of CRs [Conformance]","total":-1,"completed":3,"skipped":6,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:55:59.180: INFO: Driver local doesn't support InlineVolume -- skipping
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 96 lines ...
Oct 13 00:55:26.982: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(aws) supported size:{ 1Gi} 
STEP: creating a StorageClass volume-expand-2684vbd86
STEP: creating a claim
Oct 13 00:55:27.227: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Expanding non-expandable pvc
Oct 13 00:55:27.723: INFO: currentPvcSize {{1073741824 0} {<nil>} 1Gi BinarySI}, newSize {{2147483648 0} {<nil>}  BinarySI}
Oct 13 00:55:28.216: INFO: Error updating pvc awsbmkr8: PersistentVolumeClaim "awsbmkr8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-2684vbd86",
  	... // 2 identical fields
  }

Oct 13 00:55:30.706: INFO: Error updating pvc awsbmkr8: PersistentVolumeClaim "awsbmkr8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-2684vbd86",
  	... // 2 identical fields
  }

Oct 13 00:55:32.704: INFO: Error updating pvc awsbmkr8: PersistentVolumeClaim "awsbmkr8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-2684vbd86",
  	... // 2 identical fields
  }

Oct 13 00:55:34.722: INFO: Error updating pvc awsbmkr8: PersistentVolumeClaim "awsbmkr8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-2684vbd86",
  	... // 2 identical fields
  }

Oct 13 00:55:36.703: INFO: Error updating pvc awsbmkr8: PersistentVolumeClaim "awsbmkr8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-2684vbd86",
  	... // 2 identical fields
  }

Oct 13 00:55:38.717: INFO: Error updating pvc awsbmkr8: PersistentVolumeClaim "awsbmkr8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-2684vbd86",
  	... // 2 identical fields
  }

Oct 13 00:55:40.705: INFO: Error updating pvc awsbmkr8: PersistentVolumeClaim "awsbmkr8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-2684vbd86",
  	... // 2 identical fields
  }

Oct 13 00:55:42.705: INFO: Error updating pvc awsbmkr8: PersistentVolumeClaim "awsbmkr8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-2684vbd86",
  	... // 2 identical fields
  }

Oct 13 00:55:44.712: INFO: Error updating pvc awsbmkr8: PersistentVolumeClaim "awsbmkr8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-2684vbd86",
  	... // 2 identical fields
  }

Oct 13 00:55:46.703: INFO: Error updating pvc awsbmkr8: PersistentVolumeClaim "awsbmkr8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-2684vbd86",
  	... // 2 identical fields
  }

Oct 13 00:55:48.703: INFO: Error updating pvc awsbmkr8: PersistentVolumeClaim "awsbmkr8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-2684vbd86",
  	... // 2 identical fields
  }

Oct 13 00:55:50.704: INFO: Error updating pvc awsbmkr8: PersistentVolumeClaim "awsbmkr8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-2684vbd86",
  	... // 2 identical fields
  }

Oct 13 00:55:52.704: INFO: Error updating pvc awsbmkr8: PersistentVolumeClaim "awsbmkr8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-2684vbd86",
  	... // 2 identical fields
  }

Oct 13 00:55:54.703: INFO: Error updating pvc awsbmkr8: PersistentVolumeClaim "awsbmkr8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-2684vbd86",
  	... // 2 identical fields
  }

Oct 13 00:55:56.706: INFO: Error updating pvc awsbmkr8: PersistentVolumeClaim "awsbmkr8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-2684vbd86",
  	... // 2 identical fields
  }

Oct 13 00:55:58.715: INFO: Error updating pvc awsbmkr8: PersistentVolumeClaim "awsbmkr8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-2684vbd86",
  	... // 2 identical fields
  }

Oct 13 00:55:59.207: INFO: Error updating pvc awsbmkr8: PersistentVolumeClaim "awsbmkr8" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 24 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (default fs)] volume-expand
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should not allow expansion of pvcs without AllowVolumeExpansion property
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:157
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property","total":-1,"completed":6,"skipped":53,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:00.449: INFO: Only supported for providers [gce gke] (not aws)
... skipping 14 lines ...
      Only supported for providers [gce gke] (not aws)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:1301
------------------------------
SSSSSSSS
------------------------------
{"msg":"PASSED [sig-node] Secrets should be consumable via the environment [NodeConformance] [Conformance]","total":-1,"completed":2,"skipped":8,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:53:50.908: INFO: >>> kubeConfig: /root/.kube/config
... skipping 123 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_volumes.go:40
    [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      Verify if offline PVC expansion works
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:174
------------------------------
{"msg":"PASSED [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand Verify if offline PVC expansion works","total":-1,"completed":3,"skipped":8,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:01.248: INFO: Driver local doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 108 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:192
    Two pods mounting a local volume at the same time
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:248
      should be able to write from pod1 and read from pod2
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:249
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: dir-bindmounted] Two pods mounting a local volume at the same time should be able to write from pod1 and read from pod2","total":-1,"completed":9,"skipped":83,"failed":0}

SSSS
------------------------------
[BeforeEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:55:58.441: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename emptydir
STEP: Waiting for a default service account to be provisioned in namespace
[It] should support (non-root,0777,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test emptydir 0777 on tmpfs
Oct 13 00:55:59.892: INFO: Waiting up to 5m0s for pod "pod-2710dd59-801b-4bdb-bbbf-2226cf9c45ef" in namespace "emptydir-6377" to be "Succeeded or Failed"
Oct 13 00:56:00.133: INFO: Pod "pod-2710dd59-801b-4bdb-bbbf-2226cf9c45ef": Phase="Pending", Reason="", readiness=false. Elapsed: 240.915552ms
Oct 13 00:56:02.374: INFO: Pod "pod-2710dd59-801b-4bdb-bbbf-2226cf9c45ef": Phase="Pending", Reason="", readiness=false. Elapsed: 2.482477823s
Oct 13 00:56:04.615: INFO: Pod "pod-2710dd59-801b-4bdb-bbbf-2226cf9c45ef": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.723831397s
STEP: Saw pod success
Oct 13 00:56:04.616: INFO: Pod "pod-2710dd59-801b-4bdb-bbbf-2226cf9c45ef" satisfied condition "Succeeded or Failed"
Oct 13 00:56:04.855: INFO: Trying to get logs from node ip-172-20-48-187.ap-southeast-1.compute.internal pod pod-2710dd59-801b-4bdb-bbbf-2226cf9c45ef container test-container: <nil>
STEP: delete the pod
Oct 13 00:56:05.344: INFO: Waiting for pod pod-2710dd59-801b-4bdb-bbbf-2226cf9c45ef to disappear
Oct 13 00:56:05.584: INFO: Pod pod-2710dd59-801b-4bdb-bbbf-2226cf9c45ef no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:7.624 seconds]
[sig-storage] EmptyDir volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should support (non-root,0777,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes should support (non-root,0777,tmpfs) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":52,"failed":0}

SS
------------------------------
[BeforeEach] [sig-api-machinery] Garbage collector
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 14 lines ...
• [SLOW TEST:8.549 seconds]
[sig-api-machinery] Garbage collector
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should not be blocked by dependency circle [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] Garbage collector should not be blocked by dependency circle [Conformance]","total":-1,"completed":5,"skipped":39,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:07.627: INFO: Only supported for providers [gce gke] (not aws)
[AfterEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 139 lines ...
• [SLOW TEST:28.145 seconds]
[sig-network] Services
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/common/framework.go:23
  should be able to change the type from NodePort to ExternalName [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-network] Services should be able to change the type from NodePort to ExternalName [Conformance]","total":-1,"completed":5,"skipped":12,"failed":0}

SS
------------------------------
[BeforeEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 2 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:50
[It] nonexistent volume subPath should have the correct mode and owner using FSGroup
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:63
STEP: Creating a pod to test emptydir subpath on tmpfs
Oct 13 00:56:02.734: INFO: Waiting up to 5m0s for pod "pod-bad0023b-65dc-46a5-881e-bcd624b3f8e1" in namespace "emptydir-8654" to be "Succeeded or Failed"
Oct 13 00:56:02.974: INFO: Pod "pod-bad0023b-65dc-46a5-881e-bcd624b3f8e1": Phase="Pending", Reason="", readiness=false. Elapsed: 239.57388ms
Oct 13 00:56:05.214: INFO: Pod "pod-bad0023b-65dc-46a5-881e-bcd624b3f8e1": Phase="Pending", Reason="", readiness=false. Elapsed: 2.479558662s
Oct 13 00:56:07.455: INFO: Pod "pod-bad0023b-65dc-46a5-881e-bcd624b3f8e1": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.720531771s
STEP: Saw pod success
Oct 13 00:56:07.455: INFO: Pod "pod-bad0023b-65dc-46a5-881e-bcd624b3f8e1" satisfied condition "Succeeded or Failed"
Oct 13 00:56:07.695: INFO: Trying to get logs from node ip-172-20-48-187.ap-southeast-1.compute.internal pod pod-bad0023b-65dc-46a5-881e-bcd624b3f8e1 container test-container: <nil>
STEP: delete the pod
Oct 13 00:56:08.184: INFO: Waiting for pod pod-bad0023b-65dc-46a5-881e-bcd624b3f8e1 to disappear
Oct 13 00:56:08.424: INFO: Pod pod-bad0023b-65dc-46a5-881e-bcd624b3f8e1 no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 6 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:48
    nonexistent volume subPath should have the correct mode and owner using FSGroup
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/empty_dir.go:63
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes when FSGroup is specified [LinuxOnly] [NodeFeature:FSGroup] nonexistent volume subPath should have the correct mode and owner using FSGroup","total":-1,"completed":4,"skipped":18,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:08.929: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 132 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  CSI Volume expansion
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:561
    should expand volume by restarting pod if attach=on, nodeExpansion=on
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:590
------------------------------
{"msg":"PASSED [sig-storage] CSI mock volume CSI Volume expansion should expand volume by restarting pod if attach=on, nodeExpansion=on","total":-1,"completed":4,"skipped":30,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:11.412: INFO: Only supported for providers [gce gke] (not aws)
[AfterEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 160 lines ...
• [SLOW TEST:7.158 seconds]
[sig-api-machinery] Discovery
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should validate PreferredVersion for each APIGroup [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] Discovery should validate PreferredVersion for each APIGroup [Conformance]","total":-1,"completed":6,"skipped":54,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:13.252: INFO: Driver hostPathSymlink doesn't support DynamicPV -- skipping
... skipping 37 lines ...
      Driver local doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
SSSSS
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand Verify if offline PVC expansion works","total":-1,"completed":4,"skipped":56,"failed":1,"failures":["[sig-node] Pods should run through the lifecycle of Pods and PodStatus [Conformance]"]}
[BeforeEach] [sig-node] Container Lifecycle Hook
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:55:50.823: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename container-lifecycle-hook
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 35 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  when create a pod with lifecycle hook
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/lifecycle_hook.go:43
    should execute prestop http hook properly [NodeConformance] [Conformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute prestop http hook properly [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":56,"failed":1,"failures":["[sig-node] Pods should run through the lifecycle of Pods and PodStatus [Conformance]"]}

SS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:13.358: INFO: Only supported for providers [gce gke] (not aws)
... skipping 73 lines ...
• [SLOW TEST:7.590 seconds]
[sig-network] Ingress API
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/common/framework.go:23
  should support creating Ingress API operations [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-network] Ingress API should support creating Ingress API operations [Conformance]","total":-1,"completed":6,"skipped":14,"failed":0}

SS
------------------------------
[BeforeEach] [sig-storage] PV Protection
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 22 lines ...
Oct 13 00:56:16.448: INFO: AfterEach: Cleaning up test resources.
Oct 13 00:56:16.448: INFO: pvc is nil
Oct 13 00:56:16.448: INFO: Deleting PersistentVolume "hostpath-cpzrr"

•
------------------------------
{"msg":"PASSED [sig-storage] PV Protection Verify \"immediate\" deletion of a PV that is not bound to a PVC","total":-1,"completed":6,"skipped":60,"failed":1,"failures":["[sig-node] Pods should run through the lifecycle of Pods and PodStatus [Conformance]"]}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:16.698: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 82 lines ...
Oct 13 00:53:57.999: INFO: creating *v1.ClusterRoleBinding: csi-controller-snapshotter-role-csi-mock-volumes-2054
Oct 13 00:53:58.244: INFO: creating *v1.StorageClass: csi-mock-sc-csi-mock-volumes-2054
Oct 13 00:53:58.490: INFO: creating *v1.StatefulSet: csi-mock-volumes-2054-1715/csi-mockplugin
Oct 13 00:53:58.737: INFO: creating *v1.CSIDriver: csi-mock-csi-mock-volumes-2054
Oct 13 00:53:58.982: INFO: waiting up to 4m0s for CSIDriver "csi-mock-csi-mock-volumes-2054"
Oct 13 00:53:59.242: INFO: waiting for CSIDriver csi-mock-csi-mock-volumes-2054 to register on node ip-172-20-43-74.ap-southeast-1.compute.internal
I1013 00:54:24.843631    5511 csi.go:431] gRPCCall: {"Method":"/csi.v1.Identity/Probe","Request":{},"Response":{"ready":{"value":true}},"Error":"","FullError":null}
I1013 00:54:25.117848    5511 csi.go:431] gRPCCall: {"Method":"/csi.v1.Identity/GetPluginInfo","Request":{},"Response":{"name":"csi-mock-csi-mock-volumes-2054","vendor_version":"0.3.0","manifest":{"url":"https://k8s.io/kubernetes/test/e2e/storage/drivers/csi-test/mock"}},"Error":"","FullError":null}
I1013 00:54:25.367729    5511 csi.go:431] gRPCCall: {"Method":"/csi.v1.Identity/GetPluginCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"VolumeExpansion":{"type":1}}}]},"Error":"","FullError":null}
I1013 00:54:25.619853    5511 csi.go:431] gRPCCall: {"Method":"/csi.v1.Controller/ControllerGetCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":10}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":8}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":12}}},{"Type":{"Rpc":{"type":11}}},{"Type":{"Rpc":{"type":9}}}]},"Error":"","FullError":null}
I1013 00:54:26.027926    5511 csi.go:431] gRPCCall: {"Method":"/csi.v1.Identity/GetPluginInfo","Request":{},"Response":{"name":"csi-mock-csi-mock-volumes-2054","vendor_version":"0.3.0","manifest":{"url":"https://k8s.io/kubernetes/test/e2e/storage/drivers/csi-test/mock"}},"Error":"","FullError":null}
I1013 00:54:27.408609    5511 csi.go:431] gRPCCall: {"Method":"/csi.v1.Node/NodeGetInfo","Request":{},"Response":{"node_id":"csi-mock-csi-mock-volumes-2054"},"Error":"","FullError":null}
STEP: Creating pod
Oct 13 00:54:43.017: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Oct 13 00:54:43.273: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-cf2zs] to have phase Bound
I1013 00:54:43.282067    5511 csi.go:431] gRPCCall: {"Method":"/csi.v1.Controller/CreateVolume","Request":{"name":"pvc-5626204f-5750-4d27-a1ab-e6a03c2a8454","capacity_range":{"required_bytes":1073741824},"volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}}]},"Response":null,"Error":"rpc error: code = ResourceExhausted desc = fake error","FullError":{"code":8,"message":"fake error"}}
Oct 13 00:54:43.518: INFO: PersistentVolumeClaim pvc-cf2zs found but phase is Pending instead of Bound.
I1013 00:54:43.574351    5511 csi.go:431] gRPCCall: {"Method":"/csi.v1.Controller/CreateVolume","Request":{"name":"pvc-5626204f-5750-4d27-a1ab-e6a03c2a8454","capacity_range":{"required_bytes":1073741824},"volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}}]},"Response":{"volume":{"capacity_bytes":1073741824,"volume_id":"4","volume_context":{"name":"pvc-5626204f-5750-4d27-a1ab-e6a03c2a8454"}}},"Error":"","FullError":null}
Oct 13 00:54:45.764: INFO: PersistentVolumeClaim pvc-cf2zs found and phase=Bound (2.490825624s)
I1013 00:54:48.036148    5511 csi.go:431] gRPCCall: {"Method":"/csi.v1.Node/NodeGetCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Rpc":{}}},{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":4}}}]},"Error":"","FullError":null}
Oct 13 00:54:48.281: INFO: >>> kubeConfig: /root/.kube/config
I1013 00:54:49.859045    5511 csi.go:431] gRPCCall: {"Method":"/csi.v1.Node/NodeStageVolume","Request":{"volume_id":"4","staging_target_path":"/var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-5626204f-5750-4d27-a1ab-e6a03c2a8454/globalmount","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-5626204f-5750-4d27-a1ab-e6a03c2a8454","storage.kubernetes.io/csiProvisionerIdentity":"1634086465759-8081-csi-mock-csi-mock-volumes-2054"}},"Response":{},"Error":"","FullError":null}
I1013 00:54:50.640486    5511 csi.go:431] gRPCCall: {"Method":"/csi.v1.Node/NodeGetCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Rpc":{}}},{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":4}}}]},"Error":"","FullError":null}
Oct 13 00:54:50.877: INFO: >>> kubeConfig: /root/.kube/config
Oct 13 00:54:52.534: INFO: >>> kubeConfig: /root/.kube/config
Oct 13 00:54:54.082: INFO: >>> kubeConfig: /root/.kube/config
I1013 00:54:55.683761    5511 csi.go:431] gRPCCall: {"Method":"/csi.v1.Node/NodePublishVolume","Request":{"volume_id":"4","staging_target_path":"/var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-5626204f-5750-4d27-a1ab-e6a03c2a8454/globalmount","target_path":"/var/lib/kubelet/pods/723ed28e-aaa7-4fc7-9d16-9a9823492028/volumes/kubernetes.io~csi/pvc-5626204f-5750-4d27-a1ab-e6a03c2a8454/mount","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"name":"pvc-5626204f-5750-4d27-a1ab-e6a03c2a8454","storage.kubernetes.io/csiProvisionerIdentity":"1634086465759-8081-csi-mock-csi-mock-volumes-2054"}},"Response":{},"Error":"","FullError":null}
Oct 13 00:54:59.013: INFO: Deleting pod "pvc-volume-tester-m7d8r" in namespace "csi-mock-volumes-2054"
Oct 13 00:54:59.263: INFO: Wait up to 5m0s for pod "pvc-volume-tester-m7d8r" to be fully deleted
Oct 13 00:55:03.529: INFO: >>> kubeConfig: /root/.kube/config
I1013 00:55:05.129848    5511 csi.go:431] gRPCCall: {"Method":"/csi.v1.Node/NodeGetCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Rpc":{}}},{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":4}}}]},"Error":"","FullError":null}
I1013 00:55:05.293108    5511 csi.go:431] gRPCCall: {"Method":"/csi.v1.Node/NodeUnpublishVolume","Request":{"volume_id":"4","target_path":"/var/lib/kubelet/pods/723ed28e-aaa7-4fc7-9d16-9a9823492028/volumes/kubernetes.io~csi/pvc-5626204f-5750-4d27-a1ab-e6a03c2a8454/mount"},"Response":{},"Error":"","FullError":null}
I1013 00:55:05.378043    5511 csi.go:431] gRPCCall: {"Method":"/csi.v1.Node/NodeGetVolumeStats","Request":{"volume_id":"4","volume_path":"/var/lib/kubelet/pods/723ed28e-aaa7-4fc7-9d16-9a9823492028/volumes/kubernetes.io~csi/pvc-5626204f-5750-4d27-a1ab-e6a03c2a8454/mount"},"Response":{"volume_condition":{"abnormal":true,"message":"volume \"4\" doest not exist on the specified path \"/var/lib/kubelet/pods/723ed28e-aaa7-4fc7-9d16-9a9823492028/volumes/kubernetes.io~csi/pvc-5626204f-5750-4d27-a1ab-e6a03c2a8454/mount\""}},"Error":"rpc error: code = NotFound desc = volume \"4\" doest not exist on the specified path \"/var/lib/kubelet/pods/723ed28e-aaa7-4fc7-9d16-9a9823492028/volumes/kubernetes.io~csi/pvc-5626204f-5750-4d27-a1ab-e6a03c2a8454/mount\"","FullError":{"code":5,"message":"volume \"4\" doest not exist on the specified path \"/var/lib/kubelet/pods/723ed28e-aaa7-4fc7-9d16-9a9823492028/volumes/kubernetes.io~csi/pvc-5626204f-5750-4d27-a1ab-e6a03c2a8454/mount\""}}
I1013 00:55:05.578220    5511 csi.go:431] gRPCCall: {"Method":"/csi.v1.Node/NodeGetCapabilities","Request":{},"Response":{"capabilities":[{"Type":{"Rpc":{}}},{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":4}}}]},"Error":"","FullError":null}
I1013 00:55:05.824558    5511 csi.go:431] gRPCCall: {"Method":"/csi.v1.Node/NodeUnstageVolume","Request":{"volume_id":"4","staging_target_path":"/var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-5626204f-5750-4d27-a1ab-e6a03c2a8454/globalmount"},"Response":{},"Error":"","FullError":null}
I1013 00:55:16.024046    5511 csi.go:431] gRPCCall: {"Method":"/csi.v1.Controller/DeleteVolume","Request":{"volume_id":"4"},"Response":{},"Error":"","FullError":null}
STEP: Checking PVC events
Oct 13 00:55:17.006: INFO: PVC event ADDED: &v1.PersistentVolumeClaim{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-cf2zs", GenerateName:"pvc-", Namespace:"csi-mock-volumes-2054", SelfLink:"", UID:"5626204f-5750-4d27-a1ab-e6a03c2a8454", ResourceVersion:"5492", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63769683283, loc:(*time.Location)(0x9e12f00)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string{"kubernetes.io/pvc-protection"}, ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"e2e.test", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc0026b6ba0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0026b6bb8)}}}, Spec:v1.PersistentVolumeClaimSpec{AccessModes:[]v1.PersistentVolumeAccessMode{"ReadWriteOnce"}, Selector:(*v1.LabelSelector)(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList{"storage":resource.Quantity{i:resource.int64Amount{value:1073741824, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"1Gi", Format:"BinarySI"}}}, VolumeName:"", StorageClassName:(*string)(0xc0026f2560), VolumeMode:(*v1.PersistentVolumeMode)(0xc0026f2570), DataSource:(*v1.TypedLocalObjectReference)(nil)}, Status:v1.PersistentVolumeClaimStatus{Phase:"Pending", AccessModes:[]v1.PersistentVolumeAccessMode(nil), Capacity:v1.ResourceList(nil), Conditions:[]v1.PersistentVolumeClaimCondition(nil)}}
Oct 13 00:55:17.007: INFO: PVC event MODIFIED: &v1.PersistentVolumeClaim{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-cf2zs", GenerateName:"pvc-", Namespace:"csi-mock-volumes-2054", SelfLink:"", UID:"5626204f-5750-4d27-a1ab-e6a03c2a8454", ResourceVersion:"5493", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63769683283, loc:(*time.Location)(0x9e12f00)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string{"volume.beta.kubernetes.io/storage-provisioner":"csi-mock-csi-mock-volumes-2054"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string{"kubernetes.io/pvc-protection"}, ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"e2e.test", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc0026b6c30), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0026b6c48)}, v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc0026b6c60), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0026b6c78)}}}, Spec:v1.PersistentVolumeClaimSpec{AccessModes:[]v1.PersistentVolumeAccessMode{"ReadWriteOnce"}, Selector:(*v1.LabelSelector)(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList{"storage":resource.Quantity{i:resource.int64Amount{value:1073741824, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"1Gi", Format:"BinarySI"}}}, VolumeName:"", StorageClassName:(*string)(0xc0026f25a0), VolumeMode:(*v1.PersistentVolumeMode)(0xc0026f25b0), DataSource:(*v1.TypedLocalObjectReference)(nil)}, Status:v1.PersistentVolumeClaimStatus{Phase:"Pending", AccessModes:[]v1.PersistentVolumeAccessMode(nil), Capacity:v1.ResourceList(nil), Conditions:[]v1.PersistentVolumeClaimCondition(nil)}}
Oct 13 00:55:17.007: INFO: PVC event MODIFIED: &v1.PersistentVolumeClaim{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-cf2zs", GenerateName:"pvc-", Namespace:"csi-mock-volumes-2054", SelfLink:"", UID:"5626204f-5750-4d27-a1ab-e6a03c2a8454", ResourceVersion:"5516", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63769683283, loc:(*time.Location)(0x9e12f00)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string{"pv.kubernetes.io/bind-completed":"yes", "pv.kubernetes.io/bound-by-controller":"yes", "volume.beta.kubernetes.io/storage-provisioner":"csi-mock-csi-mock-volumes-2054"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string{"kubernetes.io/pvc-protection"}, ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"e2e.test", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc0027d2db0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0027d2dc8)}, v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc0027d2de0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0027d2e10)}}}, Spec:v1.PersistentVolumeClaimSpec{AccessModes:[]v1.PersistentVolumeAccessMode{"ReadWriteOnce"}, Selector:(*v1.LabelSelector)(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList{"storage":resource.Quantity{i:resource.int64Amount{value:1073741824, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"1Gi", Format:"BinarySI"}}}, VolumeName:"pvc-5626204f-5750-4d27-a1ab-e6a03c2a8454", StorageClassName:(*string)(0xc0044bc600), VolumeMode:(*v1.PersistentVolumeMode)(0xc0044bc610), DataSource:(*v1.TypedLocalObjectReference)(nil)}, Status:v1.PersistentVolumeClaimStatus{Phase:"Pending", AccessModes:[]v1.PersistentVolumeAccessMode(nil), Capacity:v1.ResourceList(nil), Conditions:[]v1.PersistentVolumeClaimCondition(nil)}}
Oct 13 00:55:17.007: INFO: PVC event MODIFIED: &v1.PersistentVolumeClaim{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-cf2zs", GenerateName:"pvc-", Namespace:"csi-mock-volumes-2054", SelfLink:"", UID:"5626204f-5750-4d27-a1ab-e6a03c2a8454", ResourceVersion:"5517", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63769683283, loc:(*time.Location)(0x9e12f00)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string{"pv.kubernetes.io/bind-completed":"yes", "pv.kubernetes.io/bound-by-controller":"yes", "volume.beta.kubernetes.io/storage-provisioner":"csi-mock-csi-mock-volumes-2054"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string{"kubernetes.io/pvc-protection"}, ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"e2e.test", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc0027d2e40), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0027d2e58)}, v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc0027d2e70), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0027d2e88)}}}, Spec:v1.PersistentVolumeClaimSpec{AccessModes:[]v1.PersistentVolumeAccessMode{"ReadWriteOnce"}, Selector:(*v1.LabelSelector)(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList{"storage":resource.Quantity{i:resource.int64Amount{value:1073741824, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"1Gi", Format:"BinarySI"}}}, VolumeName:"pvc-5626204f-5750-4d27-a1ab-e6a03c2a8454", StorageClassName:(*string)(0xc0044bc640), VolumeMode:(*v1.PersistentVolumeMode)(0xc0044bc650), DataSource:(*v1.TypedLocalObjectReference)(nil)}, Status:v1.PersistentVolumeClaimStatus{Phase:"Bound", AccessModes:[]v1.PersistentVolumeAccessMode{"ReadWriteOnce"}, Capacity:v1.ResourceList{"storage":resource.Quantity{i:resource.int64Amount{value:1073741824, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"1Gi", Format:"BinarySI"}}, Conditions:[]v1.PersistentVolumeClaimCondition(nil)}}
Oct 13 00:55:17.007: INFO: PVC event MODIFIED: &v1.PersistentVolumeClaim{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"pvc-cf2zs", GenerateName:"pvc-", Namespace:"csi-mock-volumes-2054", SelfLink:"", UID:"5626204f-5750-4d27-a1ab-e6a03c2a8454", ResourceVersion:"6602", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63769683283, loc:(*time.Location)(0x9e12f00)}}, DeletionTimestamp:(*v1.Time)(0xc0027d2eb8), DeletionGracePeriodSeconds:(*int64)(0xc002f377b8), Labels:map[string]string(nil), Annotations:map[string]string{"pv.kubernetes.io/bind-completed":"yes", "pv.kubernetes.io/bound-by-controller":"yes", "volume.beta.kubernetes.io/storage-provisioner":"csi-mock-csi-mock-volumes-2054"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string{"kubernetes.io/pvc-protection"}, ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"e2e.test", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc0027d2ed0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0027d2ee8)}, v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"v1", Time:(*v1.Time)(0xc0027d2f00), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0027d2f18)}}}, Spec:v1.PersistentVolumeClaimSpec{AccessModes:[]v1.PersistentVolumeAccessMode{"ReadWriteOnce"}, Selector:(*v1.LabelSelector)(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList{"storage":resource.Quantity{i:resource.int64Amount{value:1073741824, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"1Gi", Format:"BinarySI"}}}, VolumeName:"pvc-5626204f-5750-4d27-a1ab-e6a03c2a8454", StorageClassName:(*string)(0xc0044bc690), VolumeMode:(*v1.PersistentVolumeMode)(0xc0044bc6a0), DataSource:(*v1.TypedLocalObjectReference)(nil)}, Status:v1.PersistentVolumeClaimStatus{Phase:"Bound", AccessModes:[]v1.PersistentVolumeAccessMode{"ReadWriteOnce"}, Capacity:v1.ResourceList{"storage":resource.Quantity{i:resource.int64Amount{value:1073741824, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"1Gi", Format:"BinarySI"}}, Conditions:[]v1.PersistentVolumeClaimCondition(nil)}}
... skipping 48 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  storage capacity
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:900
    exhausted, immediate binding
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:958
------------------------------
{"msg":"PASSED [sig-storage] CSI mock volume storage capacity exhausted, immediate binding","total":-1,"completed":4,"skipped":29,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:18.347: INFO: Driver emptydir doesn't support DynamicPV -- skipping
... skipping 78 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (immediate binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should provision a volume and schedule a pod with AllowedTopologies
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:164
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (immediate binding)] topology should provision a volume and schedule a pod with AllowedTopologies","total":-1,"completed":4,"skipped":33,"failed":0}

SSSS
------------------------------
[BeforeEach] [sig-node] Probing container
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 45 lines ...
• [SLOW TEST:18.155 seconds]
[sig-node] Pods
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should support pod readiness gates [NodeFeature:PodReadinessGate]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/pods.go:777
------------------------------
{"msg":"PASSED [sig-node] Pods should support pod readiness gates [NodeFeature:PodReadinessGate]","total":-1,"completed":10,"skipped":87,"failed":0}

SSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:21.684: INFO: Only supported for providers [openstack] (not aws)
... skipping 165 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  CSIStorageCapacity
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:1134
    CSIStorageCapacity used, insufficient capacity
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:1177
------------------------------
{"msg":"PASSED [sig-storage] CSI mock volume CSIStorageCapacity CSIStorageCapacity used, insufficient capacity","total":-1,"completed":7,"skipped":17,"failed":0}

SS
------------------------------
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 8 lines ...
STEP: Wait for the deployment to be ready
Oct 13 00:56:16.807: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63769683375, loc:(*time.Location)(0x9e12f00)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63769683375, loc:(*time.Location)(0x9e12f00)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63769683376, loc:(*time.Location)(0x9e12f00)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63769683375, loc:(*time.Location)(0x9e12f00)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-78988fc6cd\" is progressing."}}, CollisionCount:(*int32)(nil)}
Oct 13 00:56:19.047: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63769683375, loc:(*time.Location)(0x9e12f00)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63769683375, loc:(*time.Location)(0x9e12f00)}}, Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:v1.Time{Time:time.Time{wall:0x0, ext:63769683376, loc:(*time.Location)(0x9e12f00)}}, LastTransitionTime:v1.Time{Time:time.Time{wall:0x0, ext:63769683375, loc:(*time.Location)(0x9e12f00)}}, Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-78988fc6cd\" is progressing."}}, CollisionCount:(*int32)(nil)}
STEP: Deploying the webhook service
STEP: Verifying the service has paired with the endpoint
Oct 13 00:56:22.292: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
[It] should unconditionally reject operations on fail closed webhook [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Registering a webhook that server cannot talk to, with fail closed policy, via the AdmissionRegistration API
STEP: create a namespace for the webhook
STEP: create a configmap should be unconditionally rejected by the webhook
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:56:24.004: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "webhook-7585" for this suite.
... skipping 2 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102


• [SLOW TEST:12.417 seconds]
[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should unconditionally reject operations on fail closed webhook [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should unconditionally reject operations on fail closed webhook [Conformance]","total":-1,"completed":7,"skipped":64,"failed":0}

SSSSSSS
------------------------------
[BeforeEach] [sig-network] Services
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 160 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:192
    Two pods mounting a local volume at the same time
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:248
      should be able to write from pod1 and read from pod2
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:249
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: blockfswithformat] Two pods mounting a local volume at the same time should be able to write from pod1 and read from pod2","total":-1,"completed":5,"skipped":32,"failed":0}

SSSS
------------------------------
[BeforeEach] [sig-api-machinery] Watchers
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 14 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:56:28.631: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "watch-5183" for this suite.

•
------------------------------
{"msg":"PASSED [sig-api-machinery] Watchers should be able to start watching from a specific resource version [Conformance]","total":-1,"completed":8,"skipped":71,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:29.137: INFO: Driver hostPath doesn't support DynamicPV -- skipping
... skipping 56 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:56:31.603: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "metrics-grabber-8005" for this suite.

•
------------------------------
{"msg":"PASSED [sig-instrumentation] MetricsGrabber should grab all metrics from a Kubelet.","total":-1,"completed":6,"skipped":36,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:32.150: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian)
... skipping 49 lines ...
[It] should allow exec of files on the volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196
Oct 13 00:56:22.933: INFO: In-tree plugin kubernetes.io/empty-dir is not migrated, not validating any metrics
Oct 13 00:56:22.933: INFO: Creating resource for inline volume
STEP: Creating pod exec-volume-test-inlinevolume-prlw
STEP: Creating a pod to test exec-volume-test
Oct 13 00:56:23.177: INFO: Waiting up to 5m0s for pod "exec-volume-test-inlinevolume-prlw" in namespace "volume-3811" to be "Succeeded or Failed"
Oct 13 00:56:23.419: INFO: Pod "exec-volume-test-inlinevolume-prlw": Phase="Pending", Reason="", readiness=false. Elapsed: 242.343039ms
Oct 13 00:56:25.661: INFO: Pod "exec-volume-test-inlinevolume-prlw": Phase="Pending", Reason="", readiness=false. Elapsed: 2.484265516s
Oct 13 00:56:27.904: INFO: Pod "exec-volume-test-inlinevolume-prlw": Phase="Pending", Reason="", readiness=false. Elapsed: 4.726765805s
Oct 13 00:56:30.146: INFO: Pod "exec-volume-test-inlinevolume-prlw": Phase="Pending", Reason="", readiness=false. Elapsed: 6.969605356s
Oct 13 00:56:32.390: INFO: Pod "exec-volume-test-inlinevolume-prlw": Phase="Succeeded", Reason="", readiness=false. Elapsed: 9.21283352s
STEP: Saw pod success
Oct 13 00:56:32.390: INFO: Pod "exec-volume-test-inlinevolume-prlw" satisfied condition "Succeeded or Failed"
Oct 13 00:56:32.635: INFO: Trying to get logs from node ip-172-20-55-159.ap-southeast-1.compute.internal pod exec-volume-test-inlinevolume-prlw container exec-container-inlinevolume-prlw: <nil>
STEP: delete the pod
Oct 13 00:56:33.127: INFO: Waiting for pod exec-volume-test-inlinevolume-prlw to disappear
Oct 13 00:56:33.369: INFO: Pod exec-volume-test-inlinevolume-prlw no longer exists
STEP: Deleting pod exec-volume-test-inlinevolume-prlw
Oct 13 00:56:33.369: INFO: Deleting pod "exec-volume-test-inlinevolume-prlw" in namespace "volume-3811"
... skipping 10 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (default fs)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should allow exec of files on the volume
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] volumes should allow exec of files on the volume","total":-1,"completed":11,"skipped":104,"failed":0}

SS
------------------------------
[BeforeEach] [sig-api-machinery] Garbage collector
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 16 lines ...
• [SLOW TEST:56.935 seconds]
[sig-api-machinery] Garbage collector
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should support orphan deletion of custom resources
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/garbage_collector.go:1055
------------------------------
{"msg":"PASSED [sig-api-machinery] Garbage collector should support orphan deletion of custom resources","total":-1,"completed":8,"skipped":74,"failed":0}

SSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:36.471: INFO: Driver hostPathSymlink doesn't support DynamicPV -- skipping
... skipping 162 lines ...
• [SLOW TEST:16.674 seconds]
[sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should be able to convert from CR v1 to CR v2 [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] should be able to convert from CR v1 to CR v2 [Conformance]","total":-1,"completed":5,"skipped":37,"failed":0}

SS
------------------------------
[BeforeEach] [sig-apps] StatefulSet
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 94 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  Basic StatefulSet functionality [StatefulSetBasic]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:95
    should perform canary updates and phased rolling updates of template modifications [Conformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]","total":-1,"completed":4,"skipped":31,"failed":0}

S
------------------------------
[BeforeEach] [sig-storage] CSI mock volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 103 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  CSI online volume expansion
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:672
    should expand volume without restarting pod if attach=off, nodeExpansion=on
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:687
------------------------------
{"msg":"PASSED [sig-storage] CSI mock volume CSI online volume expansion should expand volume without restarting pod if attach=off, nodeExpansion=on","total":-1,"completed":3,"skipped":8,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:42.734: INFO: Driver supports dynamic provisioning, skipping PreprovisionedPV pattern
[AfterEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 52 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/framework.go:23
  Kubectl apply
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:793
    should reuse port when apply to an existing SVC
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:807
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Kubectl apply should reuse port when apply to an existing SVC","total":-1,"completed":9,"skipped":98,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volume-expand
... skipping 8 lines ...
Oct 13 00:56:10.138: INFO: Creating resource for dynamic PV
Oct 13 00:56:10.138: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(aws) supported size:{ 1Gi} 
STEP: creating a StorageClass volume-expand-7950mp255
STEP: creating a claim
STEP: Expanding non-expandable pvc
Oct 13 00:56:10.858: INFO: currentPvcSize {{1073741824 0} {<nil>} 1Gi BinarySI}, newSize {{2147483648 0} {<nil>}  BinarySI}
Oct 13 00:56:11.340: INFO: Error updating pvc awszq85g: PersistentVolumeClaim "awszq85g" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7950mp255",
  	... // 2 identical fields
  }

Oct 13 00:56:13.820: INFO: Error updating pvc awszq85g: PersistentVolumeClaim "awszq85g" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7950mp255",
  	... // 2 identical fields
  }

Oct 13 00:56:15.820: INFO: Error updating pvc awszq85g: PersistentVolumeClaim "awszq85g" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7950mp255",
  	... // 2 identical fields
  }

Oct 13 00:56:17.820: INFO: Error updating pvc awszq85g: PersistentVolumeClaim "awszq85g" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7950mp255",
  	... // 2 identical fields
  }

Oct 13 00:56:19.820: INFO: Error updating pvc awszq85g: PersistentVolumeClaim "awszq85g" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7950mp255",
  	... // 2 identical fields
  }

Oct 13 00:56:21.821: INFO: Error updating pvc awszq85g: PersistentVolumeClaim "awszq85g" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7950mp255",
  	... // 2 identical fields
  }

Oct 13 00:56:23.821: INFO: Error updating pvc awszq85g: PersistentVolumeClaim "awszq85g" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7950mp255",
  	... // 2 identical fields
  }

Oct 13 00:56:25.820: INFO: Error updating pvc awszq85g: PersistentVolumeClaim "awszq85g" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7950mp255",
  	... // 2 identical fields
  }

Oct 13 00:56:27.822: INFO: Error updating pvc awszq85g: PersistentVolumeClaim "awszq85g" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7950mp255",
  	... // 2 identical fields
  }

Oct 13 00:56:29.821: INFO: Error updating pvc awszq85g: PersistentVolumeClaim "awszq85g" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7950mp255",
  	... // 2 identical fields
  }

Oct 13 00:56:31.823: INFO: Error updating pvc awszq85g: PersistentVolumeClaim "awszq85g" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7950mp255",
  	... // 2 identical fields
  }

Oct 13 00:56:33.821: INFO: Error updating pvc awszq85g: PersistentVolumeClaim "awszq85g" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7950mp255",
  	... // 2 identical fields
  }

Oct 13 00:56:35.841: INFO: Error updating pvc awszq85g: PersistentVolumeClaim "awszq85g" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7950mp255",
  	... // 2 identical fields
  }

Oct 13 00:56:37.830: INFO: Error updating pvc awszq85g: PersistentVolumeClaim "awszq85g" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7950mp255",
  	... // 2 identical fields
  }

Oct 13 00:56:39.820: INFO: Error updating pvc awszq85g: PersistentVolumeClaim "awszq85g" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7950mp255",
  	... // 2 identical fields
  }

Oct 13 00:56:41.830: INFO: Error updating pvc awszq85g: PersistentVolumeClaim "awszq85g" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 5 lines ...
  	},
  	VolumeName:       "",
  	StorageClassName: &"volume-expand-7950mp255",
  	... // 2 identical fields
  }

Oct 13 00:56:42.310: INFO: Error updating pvc awszq85g: PersistentVolumeClaim "awszq85g" is invalid: spec: Forbidden: spec is immutable after creation except resources.requests for bound claims
  core.PersistentVolumeClaimSpec{
  	AccessModes: {"ReadWriteOnce"},
  	Selector:    nil,
  	Resources: core.ResourceRequirements{
  		Limits: nil,
- 		Requests: core.ResourceList{
... skipping 24 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (block volmode)] volume-expand
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should not allow expansion of pvcs without AllowVolumeExpansion property
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:157
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (block volmode)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property","total":-1,"completed":5,"skipped":24,"failed":0}

SSSSSSS
------------------------------
[BeforeEach] [sig-apps] StatefulSet
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 84 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  Basic StatefulSet functionality [StatefulSetBasic]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/statefulset.go:95
    should perform rolling updates and roll backs of template modifications [Conformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]","total":-1,"completed":2,"skipped":18,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:47.699: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 40 lines ...
Oct 13 00:56:15.917: INFO: PersistentVolumeClaim pvc-vzzbx found but phase is Pending instead of Bound.
Oct 13 00:56:18.161: INFO: PersistentVolumeClaim pvc-vzzbx found and phase=Bound (11.4753643s)
Oct 13 00:56:18.161: INFO: Waiting up to 3m0s for PersistentVolume local-svdhc to have phase Bound
Oct 13 00:56:18.404: INFO: PersistentVolume local-svdhc found and phase=Bound (243.663405ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-98tf
STEP: Creating a pod to test atomic-volume-subpath
Oct 13 00:56:19.153: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-98tf" in namespace "provisioning-233" to be "Succeeded or Failed"
Oct 13 00:56:19.396: INFO: Pod "pod-subpath-test-preprovisionedpv-98tf": Phase="Pending", Reason="", readiness=false. Elapsed: 242.989941ms
Oct 13 00:56:21.642: INFO: Pod "pod-subpath-test-preprovisionedpv-98tf": Phase="Pending", Reason="", readiness=false. Elapsed: 2.488474837s
Oct 13 00:56:23.886: INFO: Pod "pod-subpath-test-preprovisionedpv-98tf": Phase="Running", Reason="", readiness=true. Elapsed: 4.732670416s
Oct 13 00:56:26.135: INFO: Pod "pod-subpath-test-preprovisionedpv-98tf": Phase="Running", Reason="", readiness=true. Elapsed: 6.981672462s
Oct 13 00:56:28.379: INFO: Pod "pod-subpath-test-preprovisionedpv-98tf": Phase="Running", Reason="", readiness=true. Elapsed: 9.225910335s
Oct 13 00:56:30.627: INFO: Pod "pod-subpath-test-preprovisionedpv-98tf": Phase="Running", Reason="", readiness=true. Elapsed: 11.473193427s
Oct 13 00:56:32.871: INFO: Pod "pod-subpath-test-preprovisionedpv-98tf": Phase="Running", Reason="", readiness=true. Elapsed: 13.717828727s
Oct 13 00:56:35.116: INFO: Pod "pod-subpath-test-preprovisionedpv-98tf": Phase="Running", Reason="", readiness=true. Elapsed: 15.962322882s
Oct 13 00:56:37.359: INFO: Pod "pod-subpath-test-preprovisionedpv-98tf": Phase="Running", Reason="", readiness=true. Elapsed: 18.205668843s
Oct 13 00:56:39.604: INFO: Pod "pod-subpath-test-preprovisionedpv-98tf": Phase="Running", Reason="", readiness=true. Elapsed: 20.450768483s
Oct 13 00:56:41.848: INFO: Pod "pod-subpath-test-preprovisionedpv-98tf": Phase="Running", Reason="", readiness=true. Elapsed: 22.694667125s
Oct 13 00:56:44.102: INFO: Pod "pod-subpath-test-preprovisionedpv-98tf": Phase="Succeeded", Reason="", readiness=false. Elapsed: 24.948146289s
STEP: Saw pod success
Oct 13 00:56:44.102: INFO: Pod "pod-subpath-test-preprovisionedpv-98tf" satisfied condition "Succeeded or Failed"
Oct 13 00:56:44.349: INFO: Trying to get logs from node ip-172-20-37-188.ap-southeast-1.compute.internal pod pod-subpath-test-preprovisionedpv-98tf container test-container-subpath-preprovisionedpv-98tf: <nil>
STEP: delete the pod
Oct 13 00:56:44.864: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-98tf to disappear
Oct 13 00:56:45.107: INFO: Pod pod-subpath-test-preprovisionedpv-98tf no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-98tf
Oct 13 00:56:45.107: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-98tf" in namespace "provisioning-233"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support file as subpath [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:230
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]","total":-1,"completed":7,"skipped":65,"failed":0}

SSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:48.403: INFO: Only supported for providers [openstack] (not aws)
... skipping 169 lines ...
      Driver emptydir doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
SSS
------------------------------
{"msg":"PASSED [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should have a working scale subresource [Conformance]","total":-1,"completed":5,"skipped":50,"failed":0}
[BeforeEach] [sig-network] Service endpoints latency
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:56:38.117: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename svc-latency
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 421 lines ...
• [SLOW TEST:14.689 seconds]
[sig-network] Service endpoints latency
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/common/framework.go:23
  should not be very high  [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-network] Service endpoints latency should not be very high  [Conformance]","total":-1,"completed":6,"skipped":50,"failed":0}

SSSSS
------------------------------
[BeforeEach] [sig-storage] Volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 42 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  ConfigMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/volumes.go:47
    should be mountable
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/volumes.go:48
------------------------------
{"msg":"PASSED [sig-storage] Volumes ConfigMap should be mountable","total":-1,"completed":8,"skipped":19,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:53.694: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 54 lines ...
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:164

      Driver hostPath doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
{"msg":"PASSED [sig-network] Services should have session affinity timeout work for service with type clusterIP [LinuxOnly] [Conformance]","total":-1,"completed":7,"skipped":33,"failed":0}
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:56:26.199: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename webhook
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 10 lines ...
Oct 13 00:56:35.323: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
[It] should honor timeout [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Setting timeout (1s) shorter than webhook latency (5s)
STEP: Registering slow webhook via the AdmissionRegistration API
STEP: Request fails when timeout (1s) is shorter than slow webhook latency (5s)
STEP: Having no error when timeout is shorter than webhook latency and failure policy is ignore
STEP: Registering slow webhook via the AdmissionRegistration API
STEP: Having no error when timeout is longer than webhook latency
STEP: Registering slow webhook via the AdmissionRegistration API
STEP: Having no error when timeout is empty (defaulted to 10s in v1)
STEP: Registering slow webhook via the AdmissionRegistration API
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:56:52.230: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "webhook-3343" for this suite.
STEP: Destroying namespace "webhook-3343-markers" for this suite.
... skipping 4 lines ...
• [SLOW TEST:27.745 seconds]
[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should honor timeout [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should honor timeout [Conformance]","total":-1,"completed":8,"skipped":33,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:53.952: INFO: Only supported for providers [azure] (not aws)
[AfterEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 40 lines ...
STEP: Building a namespace api object, basename security-context-test
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:46
[It] should allow privilege escalation when not explicitly set and uid != 0 [LinuxOnly] [NodeConformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:335
Oct 13 00:56:44.995: INFO: Waiting up to 5m0s for pod "alpine-nnp-nil-b70e54c0-3508-4c1e-a37e-8041c454bb1b" in namespace "security-context-test-4568" to be "Succeeded or Failed"
Oct 13 00:56:45.235: INFO: Pod "alpine-nnp-nil-b70e54c0-3508-4c1e-a37e-8041c454bb1b": Phase="Pending", Reason="", readiness=false. Elapsed: 240.135515ms
Oct 13 00:56:47.475: INFO: Pod "alpine-nnp-nil-b70e54c0-3508-4c1e-a37e-8041c454bb1b": Phase="Pending", Reason="", readiness=false. Elapsed: 2.48010633s
Oct 13 00:56:49.717: INFO: Pod "alpine-nnp-nil-b70e54c0-3508-4c1e-a37e-8041c454bb1b": Phase="Pending", Reason="", readiness=false. Elapsed: 4.721846735s
Oct 13 00:56:51.957: INFO: Pod "alpine-nnp-nil-b70e54c0-3508-4c1e-a37e-8041c454bb1b": Phase="Pending", Reason="", readiness=false. Elapsed: 6.961914863s
Oct 13 00:56:54.197: INFO: Pod "alpine-nnp-nil-b70e54c0-3508-4c1e-a37e-8041c454bb1b": Phase="Succeeded", Reason="", readiness=false. Elapsed: 9.202416275s
Oct 13 00:56:54.197: INFO: Pod "alpine-nnp-nil-b70e54c0-3508-4c1e-a37e-8041c454bb1b" satisfied condition "Succeeded or Failed"
[AfterEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:56:54.441: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "security-context-test-4568" for this suite.


... skipping 2 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  when creating containers with AllowPrivilegeEscalation
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:296
    should allow privilege escalation when not explicitly set and uid != 0 [LinuxOnly] [NodeConformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:335
------------------------------
{"msg":"PASSED [sig-node] Security Context when creating containers with AllowPrivilegeEscalation should allow privilege escalation when not explicitly set and uid != 0 [LinuxOnly] [NodeConformance]","total":-1,"completed":6,"skipped":31,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:54.945: INFO: Driver aws doesn't support ext3 -- skipping
... skipping 88 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:192
    Two pods mounting a local volume at the same time
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:248
      should be able to write from pod1 and read from pod2
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/persistent_volumes-local.go:249
------------------------------
{"msg":"PASSED [sig-storage] PersistentVolumes-local  [Volume type: dir] Two pods mounting a local volume at the same time should be able to write from pod1 and read from pod2","total":-1,"completed":7,"skipped":42,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:56:57.014: INFO: Only supported for providers [vsphere] (not aws)
... skipping 21 lines ...
Oct 13 00:56:53.719: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename var-expansion
STEP: Waiting for a default service account to be provisioned in namespace
[It] should allow substituting values in a volume subpath [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test substitution in volume subpath
Oct 13 00:56:55.156: INFO: Waiting up to 5m0s for pod "var-expansion-fad55eea-9350-493f-a41b-e6a5e3e81945" in namespace "var-expansion-5625" to be "Succeeded or Failed"
Oct 13 00:56:55.395: INFO: Pod "var-expansion-fad55eea-9350-493f-a41b-e6a5e3e81945": Phase="Pending", Reason="", readiness=false. Elapsed: 238.939805ms
Oct 13 00:56:57.636: INFO: Pod "var-expansion-fad55eea-9350-493f-a41b-e6a5e3e81945": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.479645973s
STEP: Saw pod success
Oct 13 00:56:57.636: INFO: Pod "var-expansion-fad55eea-9350-493f-a41b-e6a5e3e81945" satisfied condition "Succeeded or Failed"
Oct 13 00:56:57.877: INFO: Trying to get logs from node ip-172-20-43-74.ap-southeast-1.compute.internal pod var-expansion-fad55eea-9350-493f-a41b-e6a5e3e81945 container dapi-container: <nil>
STEP: delete the pod
Oct 13 00:56:58.377: INFO: Waiting for pod var-expansion-fad55eea-9350-493f-a41b-e6a5e3e81945 to disappear
Oct 13 00:56:58.618: INFO: Pod var-expansion-fad55eea-9350-493f-a41b-e6a5e3e81945 no longer exists
[AfterEach] [sig-node] Variable Expansion
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:5.384 seconds]
[sig-node] Variable Expansion
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should allow substituting values in a volume subpath [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Variable Expansion should allow substituting values in a volume subpath [Conformance]","total":-1,"completed":9,"skipped":23,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
... skipping 59 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should not mount / map unused volumes in a pod [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:351
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: tmpfs] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":-1,"completed":5,"skipped":32,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:00.833: INFO: Driver supports dynamic provisioning, skipping InlineVolume pattern
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 78 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:38
STEP: Setting up data
[It] should support subpaths with configmap pod with mountPath of existing file [LinuxOnly] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating pod pod-subpath-test-configmap-vmj4
STEP: Creating a pod to test atomic-volume-subpath
Oct 13 00:56:38.568: INFO: Waiting up to 5m0s for pod "pod-subpath-test-configmap-vmj4" in namespace "subpath-6272" to be "Succeeded or Failed"
Oct 13 00:56:38.815: INFO: Pod "pod-subpath-test-configmap-vmj4": Phase="Pending", Reason="", readiness=false. Elapsed: 246.867245ms
Oct 13 00:56:41.059: INFO: Pod "pod-subpath-test-configmap-vmj4": Phase="Running", Reason="", readiness=true. Elapsed: 2.490788484s
Oct 13 00:56:43.302: INFO: Pod "pod-subpath-test-configmap-vmj4": Phase="Running", Reason="", readiness=true. Elapsed: 4.734031865s
Oct 13 00:56:45.548: INFO: Pod "pod-subpath-test-configmap-vmj4": Phase="Running", Reason="", readiness=true. Elapsed: 6.979633654s
Oct 13 00:56:47.792: INFO: Pod "pod-subpath-test-configmap-vmj4": Phase="Running", Reason="", readiness=true. Elapsed: 9.224236877s
Oct 13 00:56:50.040: INFO: Pod "pod-subpath-test-configmap-vmj4": Phase="Running", Reason="", readiness=true. Elapsed: 11.471551735s
Oct 13 00:56:52.284: INFO: Pod "pod-subpath-test-configmap-vmj4": Phase="Running", Reason="", readiness=true. Elapsed: 13.715777436s
Oct 13 00:56:54.531: INFO: Pod "pod-subpath-test-configmap-vmj4": Phase="Running", Reason="", readiness=true. Elapsed: 15.962991994s
Oct 13 00:56:56.775: INFO: Pod "pod-subpath-test-configmap-vmj4": Phase="Running", Reason="", readiness=true. Elapsed: 18.206662769s
Oct 13 00:56:59.024: INFO: Pod "pod-subpath-test-configmap-vmj4": Phase="Running", Reason="", readiness=true. Elapsed: 20.456228648s
Oct 13 00:57:01.269: INFO: Pod "pod-subpath-test-configmap-vmj4": Phase="Succeeded", Reason="", readiness=false. Elapsed: 22.701216776s
STEP: Saw pod success
Oct 13 00:57:01.270: INFO: Pod "pod-subpath-test-configmap-vmj4" satisfied condition "Succeeded or Failed"
Oct 13 00:57:01.544: INFO: Trying to get logs from node ip-172-20-55-159.ap-southeast-1.compute.internal pod pod-subpath-test-configmap-vmj4 container test-container-subpath-configmap-vmj4: <nil>
STEP: delete the pod
Oct 13 00:57:02.050: INFO: Waiting for pod pod-subpath-test-configmap-vmj4 to disappear
Oct 13 00:57:02.295: INFO: Pod pod-subpath-test-configmap-vmj4 no longer exists
STEP: Deleting pod pod-subpath-test-configmap-vmj4
Oct 13 00:57:02.296: INFO: Deleting pod "pod-subpath-test-configmap-vmj4" in namespace "subpath-6272"
... skipping 8 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  Atomic writer volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/subpath.go:34
    should support subpaths with configmap pod with mountPath of existing file [LinuxOnly] [Conformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Subpath Atomic writer volumes should support subpaths with configmap pod with mountPath of existing file [LinuxOnly] [Conformance]","total":-1,"completed":6,"skipped":39,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:03.044: INFO: Driver "local" does not provide raw block - skipping
... skipping 162 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  CSI attach test using mock driver
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:316
    should not require VolumeAttach for drivers without attachment
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:338
------------------------------
{"msg":"PASSED [sig-storage] CSI mock volume CSI attach test using mock driver should not require VolumeAttach for drivers without attachment","total":-1,"completed":7,"skipped":16,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:04.113: INFO: Driver local doesn't support InlineVolume -- skipping
[AfterEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 20 lines ...
Oct 13 00:56:57.021: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename emptydir
STEP: Waiting for a default service account to be provisioned in namespace
[It] should support (non-root,0777,default) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test emptydir 0777 on node default medium
Oct 13 00:56:58.498: INFO: Waiting up to 5m0s for pod "pod-4353d6ff-3162-4294-a66c-6a35077f2243" in namespace "emptydir-4869" to be "Succeeded or Failed"
Oct 13 00:56:58.744: INFO: Pod "pod-4353d6ff-3162-4294-a66c-6a35077f2243": Phase="Pending", Reason="", readiness=false. Elapsed: 246.005554ms
Oct 13 00:57:00.991: INFO: Pod "pod-4353d6ff-3162-4294-a66c-6a35077f2243": Phase="Pending", Reason="", readiness=false. Elapsed: 2.492450932s
Oct 13 00:57:03.237: INFO: Pod "pod-4353d6ff-3162-4294-a66c-6a35077f2243": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.738846707s
STEP: Saw pod success
Oct 13 00:57:03.237: INFO: Pod "pod-4353d6ff-3162-4294-a66c-6a35077f2243" satisfied condition "Succeeded or Failed"
Oct 13 00:57:03.485: INFO: Trying to get logs from node ip-172-20-43-74.ap-southeast-1.compute.internal pod pod-4353d6ff-3162-4294-a66c-6a35077f2243 container test-container: <nil>
STEP: delete the pod
Oct 13 00:57:03.977: INFO: Waiting for pod pod-4353d6ff-3162-4294-a66c-6a35077f2243 to disappear
Oct 13 00:57:04.255: INFO: Pod pod-4353d6ff-3162-4294-a66c-6a35077f2243 no longer exists
[AfterEach] [sig-storage] EmptyDir volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:7.725 seconds]
[sig-storage] EmptyDir volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should support (non-root,0777,default) [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes should support (non-root,0777,default) [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":8,"skipped":45,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:04.761: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 32 lines ...
Oct 13 00:56:35.331: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-2679df9bh
STEP: creating a claim
Oct 13 00:56:35.576: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-hhtp
STEP: Creating a pod to test subpath
Oct 13 00:56:36.329: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-hhtp" in namespace "provisioning-2679" to be "Succeeded or Failed"
Oct 13 00:56:36.571: INFO: Pod "pod-subpath-test-dynamicpv-hhtp": Phase="Pending", Reason="", readiness=false. Elapsed: 242.080723ms
Oct 13 00:56:38.813: INFO: Pod "pod-subpath-test-dynamicpv-hhtp": Phase="Pending", Reason="", readiness=false. Elapsed: 2.484190647s
Oct 13 00:56:41.056: INFO: Pod "pod-subpath-test-dynamicpv-hhtp": Phase="Pending", Reason="", readiness=false. Elapsed: 4.726953808s
Oct 13 00:56:43.298: INFO: Pod "pod-subpath-test-dynamicpv-hhtp": Phase="Pending", Reason="", readiness=false. Elapsed: 6.969010377s
Oct 13 00:56:45.545: INFO: Pod "pod-subpath-test-dynamicpv-hhtp": Phase="Pending", Reason="", readiness=false. Elapsed: 9.215827543s
Oct 13 00:56:47.788: INFO: Pod "pod-subpath-test-dynamicpv-hhtp": Phase="Pending", Reason="", readiness=false. Elapsed: 11.458664728s
Oct 13 00:56:50.031: INFO: Pod "pod-subpath-test-dynamicpv-hhtp": Phase="Pending", Reason="", readiness=false. Elapsed: 13.701924607s
Oct 13 00:56:52.274: INFO: Pod "pod-subpath-test-dynamicpv-hhtp": Phase="Succeeded", Reason="", readiness=false. Elapsed: 15.944631109s
STEP: Saw pod success
Oct 13 00:56:52.274: INFO: Pod "pod-subpath-test-dynamicpv-hhtp" satisfied condition "Succeeded or Failed"
Oct 13 00:56:52.517: INFO: Trying to get logs from node ip-172-20-55-159.ap-southeast-1.compute.internal pod pod-subpath-test-dynamicpv-hhtp container test-container-volume-dynamicpv-hhtp: <nil>
STEP: delete the pod
Oct 13 00:56:53.020: INFO: Waiting for pod pod-subpath-test-dynamicpv-hhtp to disappear
Oct 13 00:56:53.262: INFO: Pod pod-subpath-test-dynamicpv-hhtp no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-hhtp
Oct 13 00:56:53.262: INFO: Deleting pod "pod-subpath-test-dynamicpv-hhtp" in namespace "provisioning-2679"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support non-existent path
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:194
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path","total":-1,"completed":12,"skipped":106,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:05.944: INFO: Only supported for providers [openstack] (not aws)
[AfterEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 210 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (default fs)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should store data
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] volumes should store data","total":-1,"completed":10,"skipped":77,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:06.442: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian)
... skipping 81 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/framework.go:23
  Kubectl diff
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:872
    should check if kubectl diff finds a difference for Deployments [Conformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Kubectl diff should check if kubectl diff finds a difference for Deployments [Conformance]","total":-1,"completed":9,"skipped":59,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:10.171: INFO: Driver local doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 85 lines ...
• [SLOW TEST:7.455 seconds]
[sig-node] Pods
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should support retrieving logs from the container over websockets [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-network] DNS should resolve DNS of partial qualified names for the cluster [LinuxOnly]","total":-1,"completed":5,"skipped":32,"failed":0}
[BeforeEach] [sig-apps] Deployment
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:57:02.087: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename deployment
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 29 lines ...
• [SLOW TEST:9.055 seconds]
[sig-apps] Deployment
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  RollingUpdateDeployment should delete old pods and create new ones [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]","total":-1,"completed":6,"skipped":32,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
... skipping 5 lines ...
[It] should support file as subpath [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:230
Oct 13 00:56:48.930: INFO: In-tree plugin kubernetes.io/empty-dir is not migrated, not validating any metrics
Oct 13 00:56:48.930: INFO: Creating resource for inline volume
STEP: Creating pod pod-subpath-test-inlinevolume-ss6s
STEP: Creating a pod to test atomic-volume-subpath
Oct 13 00:56:49.178: INFO: Waiting up to 5m0s for pod "pod-subpath-test-inlinevolume-ss6s" in namespace "provisioning-2512" to be "Succeeded or Failed"
Oct 13 00:56:49.423: INFO: Pod "pod-subpath-test-inlinevolume-ss6s": Phase="Pending", Reason="", readiness=false. Elapsed: 244.889603ms
Oct 13 00:56:51.670: INFO: Pod "pod-subpath-test-inlinevolume-ss6s": Phase="Pending", Reason="", readiness=false. Elapsed: 2.492009816s
Oct 13 00:56:53.916: INFO: Pod "pod-subpath-test-inlinevolume-ss6s": Phase="Running", Reason="", readiness=true. Elapsed: 4.737841084s
Oct 13 00:56:56.161: INFO: Pod "pod-subpath-test-inlinevolume-ss6s": Phase="Running", Reason="", readiness=true. Elapsed: 6.98310435s
Oct 13 00:56:58.407: INFO: Pod "pod-subpath-test-inlinevolume-ss6s": Phase="Running", Reason="", readiness=true. Elapsed: 9.229034509s
Oct 13 00:57:00.660: INFO: Pod "pod-subpath-test-inlinevolume-ss6s": Phase="Running", Reason="", readiness=true. Elapsed: 11.482132975s
Oct 13 00:57:02.904: INFO: Pod "pod-subpath-test-inlinevolume-ss6s": Phase="Running", Reason="", readiness=true. Elapsed: 13.726649945s
Oct 13 00:57:05.150: INFO: Pod "pod-subpath-test-inlinevolume-ss6s": Phase="Running", Reason="", readiness=true. Elapsed: 15.972050428s
Oct 13 00:57:07.394: INFO: Pod "pod-subpath-test-inlinevolume-ss6s": Phase="Running", Reason="", readiness=true. Elapsed: 18.216653987s
Oct 13 00:57:09.640: INFO: Pod "pod-subpath-test-inlinevolume-ss6s": Phase="Running", Reason="", readiness=true. Elapsed: 20.462416357s
Oct 13 00:57:11.886: INFO: Pod "pod-subpath-test-inlinevolume-ss6s": Phase="Running", Reason="", readiness=true. Elapsed: 22.707741705s
Oct 13 00:57:14.131: INFO: Pod "pod-subpath-test-inlinevolume-ss6s": Phase="Succeeded", Reason="", readiness=false. Elapsed: 24.953445996s
STEP: Saw pod success
Oct 13 00:57:14.131: INFO: Pod "pod-subpath-test-inlinevolume-ss6s" satisfied condition "Succeeded or Failed"
Oct 13 00:57:14.376: INFO: Trying to get logs from node ip-172-20-43-74.ap-southeast-1.compute.internal pod pod-subpath-test-inlinevolume-ss6s container test-container-subpath-inlinevolume-ss6s: <nil>
STEP: delete the pod
Oct 13 00:57:14.880: INFO: Waiting for pod pod-subpath-test-inlinevolume-ss6s to disappear
Oct 13 00:57:15.130: INFO: Pod pod-subpath-test-inlinevolume-ss6s no longer exists
STEP: Deleting pod pod-subpath-test-inlinevolume-ss6s
Oct 13 00:57:15.130: INFO: Deleting pod "pod-subpath-test-inlinevolume-ss6s" in namespace "provisioning-2512"
... skipping 12 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support file as subpath [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:230
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Inline-volume (default fs)] subPath should support file as subpath [LinuxOnly]","total":-1,"completed":3,"skipped":21,"failed":0}

SSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:16.155: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 23 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-storage] Projected downwardAPI
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/projected_downwardapi.go:41
[It] should provide node allocatable (memory) as default memory limit if the limit is not set [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test downward API volume plugin
Oct 13 00:57:12.641: INFO: Waiting up to 5m0s for pod "downwardapi-volume-37c012cc-3fd7-4171-9756-da4c27462b2b" in namespace "projected-1772" to be "Succeeded or Failed"
Oct 13 00:57:12.883: INFO: Pod "downwardapi-volume-37c012cc-3fd7-4171-9756-da4c27462b2b": Phase="Pending", Reason="", readiness=false. Elapsed: 242.607578ms
Oct 13 00:57:15.126: INFO: Pod "downwardapi-volume-37c012cc-3fd7-4171-9756-da4c27462b2b": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.48563882s
STEP: Saw pod success
Oct 13 00:57:15.126: INFO: Pod "downwardapi-volume-37c012cc-3fd7-4171-9756-da4c27462b2b" satisfied condition "Succeeded or Failed"
Oct 13 00:57:15.366: INFO: Trying to get logs from node ip-172-20-55-159.ap-southeast-1.compute.internal pod downwardapi-volume-37c012cc-3fd7-4171-9756-da4c27462b2b container client-container: <nil>
STEP: delete the pod
Oct 13 00:57:15.855: INFO: Waiting for pod downwardapi-volume-37c012cc-3fd7-4171-9756-da4c27462b2b to disappear
Oct 13 00:57:16.104: INFO: Pod downwardapi-volume-37c012cc-3fd7-4171-9756-da4c27462b2b no longer exists
[AfterEach] [sig-storage] Projected downwardAPI
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:5.506 seconds]
[sig-storage] Projected downwardAPI
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should provide node allocatable (memory) as default memory limit if the limit is not set [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Projected downwardAPI should provide node allocatable (memory) as default memory limit if the limit is not set [NodeConformance] [Conformance]","total":-1,"completed":7,"skipped":33,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:16.681: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 73 lines ...
Oct 13 00:56:43.983: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(aws) supported size:{ 1Mi} 
STEP: creating a StorageClass provisioning-6662chfwq
STEP: creating a claim
Oct 13 00:56:44.226: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
STEP: Creating pod pod-subpath-test-dynamicpv-278v
STEP: Creating a pod to test subpath
Oct 13 00:56:44.981: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-278v" in namespace "provisioning-6662" to be "Succeeded or Failed"
Oct 13 00:56:45.224: INFO: Pod "pod-subpath-test-dynamicpv-278v": Phase="Pending", Reason="", readiness=false. Elapsed: 243.494079ms
Oct 13 00:56:47.471: INFO: Pod "pod-subpath-test-dynamicpv-278v": Phase="Pending", Reason="", readiness=false. Elapsed: 2.49083561s
Oct 13 00:56:49.718: INFO: Pod "pod-subpath-test-dynamicpv-278v": Phase="Pending", Reason="", readiness=false. Elapsed: 4.737248882s
Oct 13 00:56:51.962: INFO: Pod "pod-subpath-test-dynamicpv-278v": Phase="Pending", Reason="", readiness=false. Elapsed: 6.98094216s
Oct 13 00:56:54.207: INFO: Pod "pod-subpath-test-dynamicpv-278v": Phase="Pending", Reason="", readiness=false. Elapsed: 9.226151023s
Oct 13 00:56:56.451: INFO: Pod "pod-subpath-test-dynamicpv-278v": Phase="Pending", Reason="", readiness=false. Elapsed: 11.470761339s
Oct 13 00:56:58.710: INFO: Pod "pod-subpath-test-dynamicpv-278v": Phase="Pending", Reason="", readiness=false. Elapsed: 13.72915786s
Oct 13 00:57:00.955: INFO: Pod "pod-subpath-test-dynamicpv-278v": Phase="Pending", Reason="", readiness=false. Elapsed: 15.974689103s
Oct 13 00:57:03.200: INFO: Pod "pod-subpath-test-dynamicpv-278v": Phase="Pending", Reason="", readiness=false. Elapsed: 18.219106645s
Oct 13 00:57:05.445: INFO: Pod "pod-subpath-test-dynamicpv-278v": Phase="Succeeded", Reason="", readiness=false. Elapsed: 20.463997022s
STEP: Saw pod success
Oct 13 00:57:05.445: INFO: Pod "pod-subpath-test-dynamicpv-278v" satisfied condition "Succeeded or Failed"
Oct 13 00:57:05.688: INFO: Trying to get logs from node ip-172-20-43-74.ap-southeast-1.compute.internal pod pod-subpath-test-dynamicpv-278v container test-container-subpath-dynamicpv-278v: <nil>
STEP: delete the pod
Oct 13 00:57:06.214: INFO: Waiting for pod pod-subpath-test-dynamicpv-278v to disappear
Oct 13 00:57:06.457: INFO: Pod pod-subpath-test-dynamicpv-278v no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-278v
Oct 13 00:57:06.457: INFO: Deleting pod "pod-subpath-test-dynamicpv-278v" in namespace "provisioning-6662"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support readOnly directory specified in the volumeMount
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:369
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount","total":-1,"completed":4,"skipped":15,"failed":0}

SSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:19.172: INFO: Driver hostPathSymlink doesn't support DynamicPV -- skipping
... skipping 109 lines ...
  Zone count is 1, only run for multi-zone clusters, skipping test

  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/scheduling/ubernetes_lite.go:55
------------------------------
S
------------------------------
{"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource [Conformance]","total":-1,"completed":10,"skipped":25,"failed":0}
[BeforeEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:57:17.661: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename security-context
STEP: Waiting for a default service account to be provisioned in namespace
[It] should support pod.Spec.SecurityContext.SupplementalGroups [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:69
STEP: Creating a pod to test pod.Spec.SecurityContext.SupplementalGroups
Oct 13 00:57:19.099: INFO: Waiting up to 5m0s for pod "security-context-86e597f1-4e67-4b0a-870d-591c364840eb" in namespace "security-context-8155" to be "Succeeded or Failed"
Oct 13 00:57:19.338: INFO: Pod "security-context-86e597f1-4e67-4b0a-870d-591c364840eb": Phase="Pending", Reason="", readiness=false. Elapsed: 239.114476ms
Oct 13 00:57:21.607: INFO: Pod "security-context-86e597f1-4e67-4b0a-870d-591c364840eb": Phase="Pending", Reason="", readiness=false. Elapsed: 2.508212578s
Oct 13 00:57:23.847: INFO: Pod "security-context-86e597f1-4e67-4b0a-870d-591c364840eb": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.747699578s
STEP: Saw pod success
Oct 13 00:57:23.847: INFO: Pod "security-context-86e597f1-4e67-4b0a-870d-591c364840eb" satisfied condition "Succeeded or Failed"
Oct 13 00:57:24.086: INFO: Trying to get logs from node ip-172-20-48-187.ap-southeast-1.compute.internal pod security-context-86e597f1-4e67-4b0a-870d-591c364840eb container test-container: <nil>
STEP: delete the pod
Oct 13 00:57:24.579: INFO: Waiting for pod security-context-86e597f1-4e67-4b0a-870d-591c364840eb to disappear
Oct 13 00:57:24.818: INFO: Pod security-context-86e597f1-4e67-4b0a-870d-591c364840eb no longer exists
[AfterEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:7.638 seconds]
[sig-node] Security Context
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/framework.go:23
  should support pod.Spec.SecurityContext.SupplementalGroups [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:69
------------------------------
{"msg":"PASSED [sig-node] Security Context should support pod.Spec.SecurityContext.SupplementalGroups [LinuxOnly]","total":-1,"completed":11,"skipped":25,"failed":0}

SS
------------------------------
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 27 lines ...
• [SLOW TEST:9.916 seconds]
[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should deny crd creation [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should deny crd creation [Conformance]","total":-1,"completed":8,"skipped":37,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:26.620: INFO: Driver emptydir doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 127 lines ...
STEP: creating an object not containing a namespace with in-cluster config
Oct 13 00:57:09.264: INFO: Running '/tmp/kubectl1871530180/kubectl --server=https://api.e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-2611 exec httpd -- /bin/sh -x -c /tmp/kubectl create -f /tmp/invalid-configmap-without-namespace.yaml --v=6 2>&1'
Oct 13 00:57:11.908: INFO: rc: 255
STEP: trying to use kubectl with invalid token
Oct 13 00:57:11.908: INFO: Running '/tmp/kubectl1871530180/kubectl --server=https://api.e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-2611 exec httpd -- /bin/sh -x -c /tmp/kubectl get pods --token=invalid --v=7 2>&1'
Oct 13 00:57:14.504: INFO: rc: 255
Oct 13 00:57:14.504: INFO: got err error running /tmp/kubectl1871530180/kubectl --server=https://api.e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-2611 exec httpd -- /bin/sh -x -c /tmp/kubectl get pods --token=invalid --v=7 2>&1:
Command stdout:
I1013 00:57:14.357197     204 merged_client_builder.go:163] Using in-cluster namespace
I1013 00:57:14.357464     204 merged_client_builder.go:121] Using in-cluster configuration
I1013 00:57:14.362541     204 merged_client_builder.go:121] Using in-cluster configuration
I1013 00:57:14.382581     204 merged_client_builder.go:121] Using in-cluster configuration
I1013 00:57:14.382962     204 round_trippers.go:432] GET https://100.64.0.1:443/api/v1/namespaces/kubectl-2611/pods?limit=500
... skipping 8 lines ...
  "metadata": {},
  "status": "Failure",
  "message": "Unauthorized",
  "reason": "Unauthorized",
  "code": 401
}]
F1013 00:57:14.392176     204 helpers.go:115] error: You must be logged in to the server (Unauthorized)
goroutine 1 [running]:
k8s.io/kubernetes/vendor/k8s.io/klog/v2.stacks(0xc00000e001, 0xc000a24000, 0x68, 0x1af)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:1021 +0xb9
k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).output(0x308aa00, 0xc000000003, 0x0, 0x0, 0xc000814e00, 0x261bfd7, 0xa, 0x73, 0x40e300)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:970 +0x191
k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).printDepth(0x308aa00, 0xc000000003, 0x0, 0x0, 0x0, 0x0, 0x2, 0xc000772b40, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:733 +0x16f
k8s.io/kubernetes/vendor/k8s.io/klog/v2.FatalDepth(...)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:1495
k8s.io/kubernetes/vendor/k8s.io/kubectl/pkg/cmd/util.fatal(0xc0005f04c0, 0x3a, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/kubectl/pkg/cmd/util/helpers.go:93 +0x288
k8s.io/kubernetes/vendor/k8s.io/kubectl/pkg/cmd/util.checkErr(0x209ade0, 0xc0005a69f0, 0x1f24400)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/kubectl/pkg/cmd/util/helpers.go:177 +0x8a3
k8s.io/kubernetes/vendor/k8s.io/kubectl/pkg/cmd/util.CheckErr(...)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/kubectl/pkg/cmd/util/helpers.go:115
k8s.io/kubernetes/vendor/k8s.io/kubectl/pkg/cmd/get.NewCmdGet.func1(0xc00049e840, 0xc000561890, 0x1, 0x3)
... skipping 72 lines ...
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/golang.org/x/net/http2/transport.go:705 +0x6c5

stderr:
+ /tmp/kubectl get pods '--token=invalid' '--v=7'
command terminated with exit code 255

error:
exit status 255
STEP: trying to use kubectl with invalid server
Oct 13 00:57:14.504: INFO: Running '/tmp/kubectl1871530180/kubectl --server=https://api.e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-2611 exec httpd -- /bin/sh -x -c /tmp/kubectl get pods --server=invalid --v=6 2>&1'
Oct 13 00:57:17.199: INFO: rc: 255
Oct 13 00:57:17.199: INFO: got err error running /tmp/kubectl1871530180/kubectl --server=https://api.e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-2611 exec httpd -- /bin/sh -x -c /tmp/kubectl get pods --server=invalid --v=6 2>&1:
Command stdout:
I1013 00:57:17.041293     217 merged_client_builder.go:163] Using in-cluster namespace
I1013 00:57:17.054943     217 round_trippers.go:454] GET http://invalid/api?timeout=32s  in 13 milliseconds
I1013 00:57:17.055004     217 cached_discovery.go:121] skipped caching discovery info due to Get "http://invalid/api?timeout=32s": dial tcp: lookup invalid on 100.64.0.10:53: no such host
I1013 00:57:17.061670     217 round_trippers.go:454] GET http://invalid/api?timeout=32s  in 6 milliseconds
I1013 00:57:17.061723     217 cached_discovery.go:121] skipped caching discovery info due to Get "http://invalid/api?timeout=32s": dial tcp: lookup invalid on 100.64.0.10:53: no such host
I1013 00:57:17.061738     217 shortcut.go:89] Error loading discovery information: Get "http://invalid/api?timeout=32s": dial tcp: lookup invalid on 100.64.0.10:53: no such host
I1013 00:57:17.067375     217 round_trippers.go:454] GET http://invalid/api?timeout=32s  in 5 milliseconds
I1013 00:57:17.067426     217 cached_discovery.go:121] skipped caching discovery info due to Get "http://invalid/api?timeout=32s": dial tcp: lookup invalid on 100.64.0.10:53: no such host
I1013 00:57:17.073459     217 round_trippers.go:454] GET http://invalid/api?timeout=32s  in 5 milliseconds
I1013 00:57:17.073541     217 cached_discovery.go:121] skipped caching discovery info due to Get "http://invalid/api?timeout=32s": dial tcp: lookup invalid on 100.64.0.10:53: no such host
I1013 00:57:17.087999     217 round_trippers.go:454] GET http://invalid/api?timeout=32s  in 14 milliseconds
I1013 00:57:17.088081     217 cached_discovery.go:121] skipped caching discovery info due to Get "http://invalid/api?timeout=32s": dial tcp: lookup invalid on 100.64.0.10:53: no such host
I1013 00:57:17.088139     217 helpers.go:234] Connection error: Get http://invalid/api?timeout=32s: dial tcp: lookup invalid on 100.64.0.10:53: no such host
F1013 00:57:17.088185     217 helpers.go:115] Unable to connect to the server: dial tcp: lookup invalid on 100.64.0.10:53: no such host
goroutine 1 [running]:
k8s.io/kubernetes/vendor/k8s.io/klog/v2.stacks(0xc000130001, 0xc0000ea380, 0x88, 0x1b8)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:1021 +0xb9
k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).output(0x308aa00, 0xc000000003, 0x0, 0x0, 0xc00046b260, 0x261bfd7, 0xa, 0x73, 0x40e300)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:970 +0x191
k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).printDepth(0x308aa00, 0xc000000003, 0x0, 0x0, 0x0, 0x0, 0x2, 0xc0003eb320, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:733 +0x16f
k8s.io/kubernetes/vendor/k8s.io/klog/v2.FatalDepth(...)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:1495
k8s.io/kubernetes/vendor/k8s.io/kubectl/pkg/cmd/util.fatal(0xc00068af00, 0x59, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/kubectl/pkg/cmd/util/helpers.go:93 +0x288
k8s.io/kubernetes/vendor/k8s.io/kubectl/pkg/cmd/util.checkErr(0x209a140, 0xc0002c0720, 0x1f24400)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/kubectl/pkg/cmd/util/helpers.go:188 +0x935
k8s.io/kubernetes/vendor/k8s.io/kubectl/pkg/cmd/util.CheckErr(...)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/kubectl/pkg/cmd/util/helpers.go:115
k8s.io/kubernetes/vendor/k8s.io/kubectl/pkg/cmd/get.NewCmdGet.func1(0xc000465080, 0xc000579cb0, 0x1, 0x3)
... skipping 24 lines ...
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/kubectl/pkg/util/logs/logs.go:51 +0x96

stderr:
+ /tmp/kubectl get pods '--server=invalid' '--v=6'
command terminated with exit code 255

error:
exit status 255
STEP: trying to use kubectl with invalid namespace
Oct 13 00:57:17.199: INFO: Running '/tmp/kubectl1871530180/kubectl --server=https://api.e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-2611 exec httpd -- /bin/sh -x -c /tmp/kubectl get pods --namespace=invalid --v=6 2>&1'
Oct 13 00:57:19.776: INFO: stderr: "+ /tmp/kubectl get pods '--namespace=invalid' '--v=6'\n"
Oct 13 00:57:19.776: INFO: stdout: "I1013 00:57:19.633030     226 merged_client_builder.go:121] Using in-cluster configuration\nI1013 00:57:19.640518     226 merged_client_builder.go:121] Using in-cluster configuration\nI1013 00:57:19.647445     226 merged_client_builder.go:121] Using in-cluster configuration\nI1013 00:57:19.656126     226 round_trippers.go:454] GET https://100.64.0.1:443/api/v1/namespaces/invalid/pods?limit=500 200 OK in 8 milliseconds\nNo resources found in invalid namespace.\n"
Oct 13 00:57:19.776: INFO: stdout: I1013 00:57:19.633030     226 merged_client_builder.go:121] Using in-cluster configuration
... skipping 74 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/framework.go:23
  Simple pod
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:376
    should handle in-cluster config
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:636
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Simple pod should handle in-cluster config","total":-1,"completed":11,"skipped":78,"failed":0}

S
------------------------------
{"msg":"PASSED [sig-scheduling] LimitRange should create a LimitRange with defaults and ensure pod has those defaults applied. [Conformance]","total":-1,"completed":4,"skipped":40,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:55:58.870: INFO: >>> kubeConfig: /root/.kube/config
... skipping 122 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_volumes.go:40
    [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      Verify if offline PVC expansion works
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:174
------------------------------
{"msg":"PASSED [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand Verify if offline PVC expansion works","total":-1,"completed":5,"skipped":40,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:27.099: INFO: Driver local doesn't support DynamicPV -- skipping
[AfterEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 72 lines ...
Oct 13 00:57:04.164: INFO: Pod aws-client still exists
Oct 13 00:57:05.921: INFO: Waiting for pod aws-client to disappear
Oct 13 00:57:06.161: INFO: Pod aws-client still exists
Oct 13 00:57:07.922: INFO: Waiting for pod aws-client to disappear
Oct 13 00:57:08.163: INFO: Pod aws-client no longer exists
STEP: cleaning the environment after aws
Oct 13 00:57:08.492: INFO: Couldn't delete PD "aws://ap-southeast-1a/vol-0f99a6b8ab2c504f6", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0f99a6b8ab2c504f6 is currently attached to i-01c329ed580b28ce5
	status code: 400, request id: af19e0ff-200d-4170-9918-b507ec25f613
Oct 13 00:57:14.559: INFO: Couldn't delete PD "aws://ap-southeast-1a/vol-0f99a6b8ab2c504f6", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0f99a6b8ab2c504f6 is currently attached to i-01c329ed580b28ce5
	status code: 400, request id: a173482f-ad4c-4775-bc9b-f732cb14573c
Oct 13 00:57:20.621: INFO: Couldn't delete PD "aws://ap-southeast-1a/vol-0f99a6b8ab2c504f6", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0f99a6b8ab2c504f6 is currently attached to i-01c329ed580b28ce5
	status code: 400, request id: 66a1b624-b421-40f9-a243-13ca7fa73263
Oct 13 00:57:26.792: INFO: Successfully deleted PD "aws://ap-southeast-1a/vol-0f99a6b8ab2c504f6".
[AfterEach] [Testpattern: Inline-volume (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:57:26.793: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volume-4680" for this suite.
... skipping 6 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Inline-volume (default fs)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should store data
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Inline-volume (default fs)] volumes should store data","total":-1,"completed":4,"skipped":15,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] volumes
... skipping 19 lines ...
Oct 13 00:57:16.421: INFO: PersistentVolumeClaim pvc-vfh45 found but phase is Pending instead of Bound.
Oct 13 00:57:18.668: INFO: PersistentVolumeClaim pvc-vfh45 found and phase=Bound (11.481800992s)
Oct 13 00:57:18.668: INFO: Waiting up to 3m0s for PersistentVolume local-wwdjd to have phase Bound
Oct 13 00:57:18.912: INFO: PersistentVolume local-wwdjd found and phase=Bound (244.615132ms)
STEP: Creating pod exec-volume-test-preprovisionedpv-8kl7
STEP: Creating a pod to test exec-volume-test
Oct 13 00:57:19.649: INFO: Waiting up to 5m0s for pod "exec-volume-test-preprovisionedpv-8kl7" in namespace "volume-2220" to be "Succeeded or Failed"
Oct 13 00:57:19.894: INFO: Pod "exec-volume-test-preprovisionedpv-8kl7": Phase="Pending", Reason="", readiness=false. Elapsed: 244.86058ms
Oct 13 00:57:22.140: INFO: Pod "exec-volume-test-preprovisionedpv-8kl7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.490976666s
Oct 13 00:57:24.386: INFO: Pod "exec-volume-test-preprovisionedpv-8kl7": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.737540633s
STEP: Saw pod success
Oct 13 00:57:24.386: INFO: Pod "exec-volume-test-preprovisionedpv-8kl7" satisfied condition "Succeeded or Failed"
Oct 13 00:57:24.631: INFO: Trying to get logs from node ip-172-20-48-187.ap-southeast-1.compute.internal pod exec-volume-test-preprovisionedpv-8kl7 container exec-container-preprovisionedpv-8kl7: <nil>
STEP: delete the pod
Oct 13 00:57:25.135: INFO: Waiting for pod exec-volume-test-preprovisionedpv-8kl7 to disappear
Oct 13 00:57:25.380: INFO: Pod exec-volume-test-preprovisionedpv-8kl7 no longer exists
STEP: Deleting pod exec-volume-test-preprovisionedpv-8kl7
Oct 13 00:57:25.380: INFO: Deleting pod "exec-volume-test-preprovisionedpv-8kl7" in namespace "volume-2220"
... skipping 17 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should allow exec of files on the volume
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-bindmounted] [Testpattern: Pre-provisioned PV (default fs)] volumes should allow exec of files on the volume","total":-1,"completed":6,"skipped":40,"failed":0}

SSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:28.406: INFO: Driver local doesn't support InlineVolume -- skipping
... skipping 85 lines ...
Oct 13 00:57:16.922: INFO: PersistentVolumeClaim pvc-zgmrj found but phase is Pending instead of Bound.
Oct 13 00:57:19.167: INFO: PersistentVolumeClaim pvc-zgmrj found and phase=Bound (4.735060647s)
Oct 13 00:57:19.167: INFO: Waiting up to 3m0s for PersistentVolume local-2thvf to have phase Bound
Oct 13 00:57:19.410: INFO: PersistentVolume local-2thvf found and phase=Bound (243.18175ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-lcmp
STEP: Creating a pod to test subpath
Oct 13 00:57:20.144: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-lcmp" in namespace "provisioning-4221" to be "Succeeded or Failed"
Oct 13 00:57:20.388: INFO: Pod "pod-subpath-test-preprovisionedpv-lcmp": Phase="Pending", Reason="", readiness=false. Elapsed: 243.527871ms
Oct 13 00:57:22.633: INFO: Pod "pod-subpath-test-preprovisionedpv-lcmp": Phase="Pending", Reason="", readiness=false. Elapsed: 2.489013618s
Oct 13 00:57:24.877: INFO: Pod "pod-subpath-test-preprovisionedpv-lcmp": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.733274574s
STEP: Saw pod success
Oct 13 00:57:24.877: INFO: Pod "pod-subpath-test-preprovisionedpv-lcmp" satisfied condition "Succeeded or Failed"
Oct 13 00:57:25.122: INFO: Trying to get logs from node ip-172-20-55-159.ap-southeast-1.compute.internal pod pod-subpath-test-preprovisionedpv-lcmp container test-container-subpath-preprovisionedpv-lcmp: <nil>
STEP: delete the pod
Oct 13 00:57:25.617: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-lcmp to disappear
Oct 13 00:57:25.861: INFO: Pod pod-subpath-test-preprovisionedpv-lcmp no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-lcmp
Oct 13 00:57:25.861: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-lcmp" in namespace "provisioning-4221"
... skipping 70 lines ...
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-storage] Downward API volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/downwardapi_volume.go:41
[It] should provide node allocatable (cpu) as default cpu limit if the limit is not set [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test downward API volume plugin
Oct 13 00:57:26.761: INFO: Waiting up to 5m0s for pod "downwardapi-volume-668a0cb7-9b5c-4c70-9d16-6b33cf890f28" in namespace "downward-api-379" to be "Succeeded or Failed"
Oct 13 00:57:27.000: INFO: Pod "downwardapi-volume-668a0cb7-9b5c-4c70-9d16-6b33cf890f28": Phase="Pending", Reason="", readiness=false. Elapsed: 239.386338ms
Oct 13 00:57:29.241: INFO: Pod "downwardapi-volume-668a0cb7-9b5c-4c70-9d16-6b33cf890f28": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.480641022s
STEP: Saw pod success
Oct 13 00:57:29.241: INFO: Pod "downwardapi-volume-668a0cb7-9b5c-4c70-9d16-6b33cf890f28" satisfied condition "Succeeded or Failed"
Oct 13 00:57:29.481: INFO: Trying to get logs from node ip-172-20-48-187.ap-southeast-1.compute.internal pod downwardapi-volume-668a0cb7-9b5c-4c70-9d16-6b33cf890f28 container client-container: <nil>
STEP: delete the pod
Oct 13 00:57:29.983: INFO: Waiting for pod downwardapi-volume-668a0cb7-9b5c-4c70-9d16-6b33cf890f28 to disappear
Oct 13 00:57:30.222: INFO: Pod downwardapi-volume-668a0cb7-9b5c-4c70-9d16-6b33cf890f28 no longer exists
[AfterEach] [sig-storage] Downward API volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:5.389 seconds]
[sig-storage] Downward API volume
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should provide node allocatable (cpu) as default cpu limit if the limit is not set [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Downward API volume should provide node allocatable (cpu) as default cpu limit if the limit is not set [NodeConformance] [Conformance]","total":-1,"completed":12,"skipped":27,"failed":0}

SS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:30.722: INFO: Only supported for providers [openstack] (not aws)
... skipping 122 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  CSI attach test using mock driver
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:316
    should require VolumeAttach for drivers with attachment
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:338
------------------------------
{"msg":"PASSED [sig-storage] CSI mock volume CSI attach test using mock driver should require VolumeAttach for drivers with attachment","total":-1,"completed":6,"skipped":53,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:30.918: INFO: Driver aws doesn't support ext3 -- skipping
... skipping 41 lines ...
Oct 13 00:57:01.008: INFO: PersistentVolumeClaim pvc-v27dg found but phase is Pending instead of Bound.
Oct 13 00:57:03.247: INFO: PersistentVolumeClaim pvc-v27dg found and phase=Bound (13.673120632s)
Oct 13 00:57:03.247: INFO: Waiting up to 3m0s for PersistentVolume local-crlzd to have phase Bound
Oct 13 00:57:03.485: INFO: PersistentVolume local-crlzd found and phase=Bound (238.21364ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-v4bg
STEP: Creating a pod to test atomic-volume-subpath
Oct 13 00:57:04.196: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-v4bg" in namespace "provisioning-6585" to be "Succeeded or Failed"
Oct 13 00:57:04.433: INFO: Pod "pod-subpath-test-preprovisionedpv-v4bg": Phase="Pending", Reason="", readiness=false. Elapsed: 236.16724ms
Oct 13 00:57:06.669: INFO: Pod "pod-subpath-test-preprovisionedpv-v4bg": Phase="Pending", Reason="", readiness=false. Elapsed: 2.472650834s
Oct 13 00:57:08.907: INFO: Pod "pod-subpath-test-preprovisionedpv-v4bg": Phase="Running", Reason="", readiness=true. Elapsed: 4.71029184s
Oct 13 00:57:11.144: INFO: Pod "pod-subpath-test-preprovisionedpv-v4bg": Phase="Running", Reason="", readiness=true. Elapsed: 6.947486069s
Oct 13 00:57:13.386: INFO: Pod "pod-subpath-test-preprovisionedpv-v4bg": Phase="Running", Reason="", readiness=true. Elapsed: 9.189950359s
Oct 13 00:57:15.624: INFO: Pod "pod-subpath-test-preprovisionedpv-v4bg": Phase="Running", Reason="", readiness=true. Elapsed: 11.427313963s
Oct 13 00:57:17.861: INFO: Pod "pod-subpath-test-preprovisionedpv-v4bg": Phase="Running", Reason="", readiness=true. Elapsed: 13.664927308s
Oct 13 00:57:20.098: INFO: Pod "pod-subpath-test-preprovisionedpv-v4bg": Phase="Running", Reason="", readiness=true. Elapsed: 15.901944451s
Oct 13 00:57:22.336: INFO: Pod "pod-subpath-test-preprovisionedpv-v4bg": Phase="Running", Reason="", readiness=true. Elapsed: 18.13924993s
Oct 13 00:57:24.572: INFO: Pod "pod-subpath-test-preprovisionedpv-v4bg": Phase="Running", Reason="", readiness=true. Elapsed: 20.375665295s
Oct 13 00:57:26.808: INFO: Pod "pod-subpath-test-preprovisionedpv-v4bg": Phase="Succeeded", Reason="", readiness=false. Elapsed: 22.612017299s
STEP: Saw pod success
Oct 13 00:57:26.808: INFO: Pod "pod-subpath-test-preprovisionedpv-v4bg" satisfied condition "Succeeded or Failed"
Oct 13 00:57:27.045: INFO: Trying to get logs from node ip-172-20-55-159.ap-southeast-1.compute.internal pod pod-subpath-test-preprovisionedpv-v4bg container test-container-subpath-preprovisionedpv-v4bg: <nil>
STEP: delete the pod
Oct 13 00:57:27.532: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-v4bg to disappear
Oct 13 00:57:27.768: INFO: Pod pod-subpath-test-preprovisionedpv-v4bg no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-v4bg
Oct 13 00:57:27.768: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-v4bg" in namespace "provisioning-6585"
... skipping 19 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support file as subpath [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:230
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-bindmounted] [Testpattern: Pre-provisioned PV (default fs)] subPath should support file as subpath [LinuxOnly]","total":-1,"completed":10,"skipped":99,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:31.063: INFO: Only supported for providers [azure] (not aws)
... skipping 64 lines ...
• [SLOW TEST:260.636 seconds]
[sig-node] Probing container
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should *not* be restarted with a exec "cat /tmp/health" liveness probe [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Probing container should *not* be restarted with a exec \"cat /tmp/health\" liveness probe [NodeConformance] [Conformance]","total":-1,"completed":3,"skipped":23,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:31.852: INFO: Only supported for providers [azure] (not aws)
[AfterEach] [Testpattern: Dynamic PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 117 lines ...
STEP: Deleting pod hostexec-ip-172-20-43-74.ap-southeast-1.compute.internal-wz4mb in namespace volumemode-1055
Oct 13 00:57:16.740: INFO: Deleting pod "pod-072b6ba2-9da4-448b-809a-91cf8ac28dae" in namespace "volumemode-1055"
Oct 13 00:57:16.986: INFO: Wait up to 5m0s for pod "pod-072b6ba2-9da4-448b-809a-91cf8ac28dae" to be fully deleted
STEP: Deleting pv and pvc
Oct 13 00:57:25.476: INFO: Deleting PersistentVolumeClaim "pvc-8xdc6"
Oct 13 00:57:25.720: INFO: Deleting PersistentVolume "aws-k6bxg"
Oct 13 00:57:26.329: INFO: Couldn't delete PD "aws://ap-southeast-1a/vol-0c111c66c9e0ce45b", sleeping 5s: error deleting EBS volumes: VolumeInUse: Volume vol-0c111c66c9e0ce45b is currently attached to i-01c329ed580b28ce5
	status code: 400, request id: 30c15406-6cc7-4b55-a4c1-8135307486d3
Oct 13 00:57:32.465: INFO: Successfully deleted PD "aws://ap-southeast-1a/vol-0c111c66c9e0ce45b".
[AfterEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:57:32.465: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "volumemode-1055" for this suite.
... skipping 6 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should not mount / map unused volumes in a pod [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:351
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: aws] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":-1,"completed":7,"skipped":55,"failed":0}

SS
------------------------------
[BeforeEach] [sig-cli] Kubectl client
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 13 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:57:34.118: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "kubectl-6342" for this suite.

•
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Kubectl create quota should create a quota without scopes","total":-1,"completed":4,"skipped":29,"failed":0}

S
------------------------------
[BeforeEach] [sig-node] Pods
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 11 lines ...
Oct 13 00:57:33.227: INFO: The status of Pod pod-update-activedeadlineseconds-b86fbaeb-3a14-4481-a4e7-4346d78f5cd2 is Running (Ready = true)
STEP: verifying the pod is in kubernetes
STEP: updating the pod
Oct 13 00:57:34.694: INFO: Successfully updated pod "pod-update-activedeadlineseconds-b86fbaeb-3a14-4481-a4e7-4346d78f5cd2"
Oct 13 00:57:34.694: INFO: Waiting up to 5m0s for pod "pod-update-activedeadlineseconds-b86fbaeb-3a14-4481-a4e7-4346d78f5cd2" in namespace "pods-8896" to be "terminated due to deadline exceeded"
Oct 13 00:57:34.935: INFO: Pod "pod-update-activedeadlineseconds-b86fbaeb-3a14-4481-a4e7-4346d78f5cd2": Phase="Running", Reason="", readiness=true. Elapsed: 240.542705ms
Oct 13 00:57:37.177: INFO: Pod "pod-update-activedeadlineseconds-b86fbaeb-3a14-4481-a4e7-4346d78f5cd2": Phase="Failed", Reason="DeadlineExceeded", readiness=false. Elapsed: 2.483246296s
Oct 13 00:57:37.177: INFO: Pod "pod-update-activedeadlineseconds-b86fbaeb-3a14-4481-a4e7-4346d78f5cd2" satisfied condition "terminated due to deadline exceeded"
[AfterEach] [sig-node] Pods
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:57:37.177: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "pods-8896" for this suite.


• [SLOW TEST:10.374 seconds]
[sig-node] Pods
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Pods should allow activeDeadlineSeconds to be updated [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":16,"failed":0}

SS
------------------------------
[BeforeEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:57:27.127: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename security-context-test
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:46
[It] should run the container with writable rootfs when readOnlyRootFilesystem=false [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
Oct 13 00:57:28.596: INFO: Waiting up to 5m0s for pod "busybox-readonly-false-b8e60b24-aba6-4ebf-8620-fdde0f9f2a09" in namespace "security-context-test-8032" to be "Succeeded or Failed"
Oct 13 00:57:28.839: INFO: Pod "busybox-readonly-false-b8e60b24-aba6-4ebf-8620-fdde0f9f2a09": Phase="Pending", Reason="", readiness=false. Elapsed: 242.43668ms
Oct 13 00:57:31.082: INFO: Pod "busybox-readonly-false-b8e60b24-aba6-4ebf-8620-fdde0f9f2a09": Phase="Pending", Reason="", readiness=false. Elapsed: 2.485497226s
Oct 13 00:57:33.325: INFO: Pod "busybox-readonly-false-b8e60b24-aba6-4ebf-8620-fdde0f9f2a09": Phase="Pending", Reason="", readiness=false. Elapsed: 4.729074334s
Oct 13 00:57:35.568: INFO: Pod "busybox-readonly-false-b8e60b24-aba6-4ebf-8620-fdde0f9f2a09": Phase="Pending", Reason="", readiness=false. Elapsed: 6.971884029s
Oct 13 00:57:37.812: INFO: Pod "busybox-readonly-false-b8e60b24-aba6-4ebf-8620-fdde0f9f2a09": Phase="Succeeded", Reason="", readiness=false. Elapsed: 9.215578633s
Oct 13 00:57:37.812: INFO: Pod "busybox-readonly-false-b8e60b24-aba6-4ebf-8620-fdde0f9f2a09" satisfied condition "Succeeded or Failed"
[AfterEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:57:37.812: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "security-context-test-8032" for this suite.


... skipping 63 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should not mount / map unused volumes in a pod [LinuxOnly]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:351
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link-bindmounted] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":-1,"completed":10,"skipped":67,"failed":0}

SS
------------------------------
{"msg":"PASSED [sig-node] Security Context When creating a pod with readOnlyRootFilesystem should run the container with writable rootfs when readOnlyRootFilesystem=false [NodeConformance] [Conformance]","total":-1,"completed":6,"skipped":47,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:38.305: INFO: Only supported for node OS distro [gci ubuntu custom] (not debian)
[AfterEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 20 lines ...
Oct 13 00:57:28.449: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename downward-api
STEP: Waiting for a default service account to be provisioned in namespace
[It] should provide pod name, namespace and IP address as env vars [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test downward api env vars
Oct 13 00:57:29.927: INFO: Waiting up to 5m0s for pod "downward-api-afb7f092-4f0f-4279-b786-88e92e742068" in namespace "downward-api-8281" to be "Succeeded or Failed"
Oct 13 00:57:30.172: INFO: Pod "downward-api-afb7f092-4f0f-4279-b786-88e92e742068": Phase="Pending", Reason="", readiness=false. Elapsed: 244.865506ms
Oct 13 00:57:32.417: INFO: Pod "downward-api-afb7f092-4f0f-4279-b786-88e92e742068": Phase="Pending", Reason="", readiness=false. Elapsed: 2.49010994s
Oct 13 00:57:34.663: INFO: Pod "downward-api-afb7f092-4f0f-4279-b786-88e92e742068": Phase="Pending", Reason="", readiness=false. Elapsed: 4.735880132s
Oct 13 00:57:36.910: INFO: Pod "downward-api-afb7f092-4f0f-4279-b786-88e92e742068": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.982641326s
STEP: Saw pod success
Oct 13 00:57:36.910: INFO: Pod "downward-api-afb7f092-4f0f-4279-b786-88e92e742068" satisfied condition "Succeeded or Failed"
Oct 13 00:57:37.155: INFO: Trying to get logs from node ip-172-20-48-187.ap-southeast-1.compute.internal pod downward-api-afb7f092-4f0f-4279-b786-88e92e742068 container dapi-container: <nil>
STEP: delete the pod
Oct 13 00:57:37.668: INFO: Waiting for pod downward-api-afb7f092-4f0f-4279-b786-88e92e742068 to disappear
Oct 13 00:57:37.913: INFO: Pod downward-api-afb7f092-4f0f-4279-b786-88e92e742068 no longer exists
[AfterEach] [sig-node] Downward API
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:9.956 seconds]
[sig-node] Downward API
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should provide pod name, namespace and IP address as env vars [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Downward API should provide pod name, namespace and IP address as env vars [NodeConformance] [Conformance]","total":-1,"completed":7,"skipped":54,"failed":0}

SS
------------------------------
[BeforeEach] [sig-storage] Projected configMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:57:30.926: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename projected
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable from pods in volume with mappings and Item mode set [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating configMap with name projected-configmap-test-volume-map-9b9466aa-5e60-4f10-8979-2d1cad5eed71
STEP: Creating a pod to test consume configMaps
Oct 13 00:57:32.579: INFO: Waiting up to 5m0s for pod "pod-projected-configmaps-e7e3540e-106f-4cee-a88f-a40a5faed37f" in namespace "projected-242" to be "Succeeded or Failed"
Oct 13 00:57:32.815: INFO: Pod "pod-projected-configmaps-e7e3540e-106f-4cee-a88f-a40a5faed37f": Phase="Pending", Reason="", readiness=false. Elapsed: 235.488339ms
Oct 13 00:57:35.051: INFO: Pod "pod-projected-configmaps-e7e3540e-106f-4cee-a88f-a40a5faed37f": Phase="Pending", Reason="", readiness=false. Elapsed: 2.471939712s
Oct 13 00:57:37.287: INFO: Pod "pod-projected-configmaps-e7e3540e-106f-4cee-a88f-a40a5faed37f": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.707344191s
STEP: Saw pod success
Oct 13 00:57:37.287: INFO: Pod "pod-projected-configmaps-e7e3540e-106f-4cee-a88f-a40a5faed37f" satisfied condition "Succeeded or Failed"
Oct 13 00:57:37.522: INFO: Trying to get logs from node ip-172-20-48-187.ap-southeast-1.compute.internal pod pod-projected-configmaps-e7e3540e-106f-4cee-a88f-a40a5faed37f container agnhost-container: <nil>
STEP: delete the pod
Oct 13 00:57:38.002: INFO: Waiting for pod pod-projected-configmaps-e7e3540e-106f-4cee-a88f-a40a5faed37f to disappear
Oct 13 00:57:38.237: INFO: Pod pod-projected-configmaps-e7e3540e-106f-4cee-a88f-a40a5faed37f no longer exists
[AfterEach] [sig-storage] Projected configMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:7.786 seconds]
[sig-storage] Projected configMap
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should be consumable from pods in volume with mappings and Item mode set [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Projected configMap should be consumable from pods in volume with mappings and Item mode set [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":7,"skipped":55,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-storage] ConfigMap
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 35 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:57:39.984: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "kubectl-3048" for this suite.

•
------------------------------
{"msg":"PASSED [sig-cli] Kubectl client Kubectl create quota should reject quota with invalid scopes","total":-1,"completed":8,"skipped":58,"failed":0}

SSS
------------------------------
{"msg":"PASSED [sig-storage] ConfigMap binary data should be reflected in volume [NodeConformance] [Conformance]","total":-1,"completed":13,"skipped":30,"failed":0}
[BeforeEach] [sig-node] Secrets
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:57:40.120: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename secrets
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 8 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:57:42.765: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "secrets-6441" for this suite.

•
------------------------------
{"msg":"PASSED [sig-node] Secrets should patch a secret [Conformance]","total":-1,"completed":14,"skipped":30,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:43.255: INFO: Driver "csi-hostpath" does not support FsGroup - skipping
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 45 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:57:44.472: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "emptydir-372" for this suite.

•
------------------------------
{"msg":"PASSED [sig-storage] EmptyDir volumes pod should support memory backed volumes of specified size","total":-1,"completed":15,"skipped":32,"failed":0}

SSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:44.983: INFO: Only supported for providers [gce gke] (not aws)
... skipping 58 lines ...
      Driver hostPath doesn't support DynamicPV -- skipping

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:116
------------------------------
SSSSS
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: dir-link] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing single file [LinuxOnly]","total":-1,"completed":11,"skipped":85,"failed":0}
[BeforeEach] [sig-apps] Deployment
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:57:29.086: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename deployment
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 33 lines ...
STEP: Building a namespace api object, basename projected
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be consumable in multiple volumes in a pod [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating secret with name projected-secret-test-3ffc9717-78eb-4b3d-8fb8-c472bda57389
STEP: Creating a pod to test consume secrets
Oct 13 00:57:39.371: INFO: Waiting up to 5m0s for pod "pod-projected-secrets-2168e8c5-df36-43f5-b2a6-d48f4e7e4dd6" in namespace "projected-2538" to be "Succeeded or Failed"
Oct 13 00:57:39.611: INFO: Pod "pod-projected-secrets-2168e8c5-df36-43f5-b2a6-d48f4e7e4dd6": Phase="Pending", Reason="", readiness=false. Elapsed: 240.397533ms
Oct 13 00:57:41.853: INFO: Pod "pod-projected-secrets-2168e8c5-df36-43f5-b2a6-d48f4e7e4dd6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.482015412s
Oct 13 00:57:44.094: INFO: Pod "pod-projected-secrets-2168e8c5-df36-43f5-b2a6-d48f4e7e4dd6": Phase="Pending", Reason="", readiness=false. Elapsed: 4.723296546s
Oct 13 00:57:46.335: INFO: Pod "pod-projected-secrets-2168e8c5-df36-43f5-b2a6-d48f4e7e4dd6": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.964286374s
STEP: Saw pod success
Oct 13 00:57:46.335: INFO: Pod "pod-projected-secrets-2168e8c5-df36-43f5-b2a6-d48f4e7e4dd6" satisfied condition "Succeeded or Failed"
Oct 13 00:57:46.576: INFO: Trying to get logs from node ip-172-20-48-187.ap-southeast-1.compute.internal pod pod-projected-secrets-2168e8c5-df36-43f5-b2a6-d48f4e7e4dd6 container secret-volume-test: <nil>
STEP: delete the pod
Oct 13 00:57:47.069: INFO: Waiting for pod pod-projected-secrets-2168e8c5-df36-43f5-b2a6-d48f4e7e4dd6 to disappear
Oct 13 00:57:47.309: INFO: Pod pod-projected-secrets-2168e8c5-df36-43f5-b2a6-d48f4e7e4dd6 no longer exists
[AfterEach] [sig-storage] Projected secret
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:10.111 seconds]
[sig-storage] Projected secret
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should be consumable in multiple volumes in a pod [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-storage] Projected secret should be consumable in multiple volumes in a pod [NodeConformance] [Conformance]","total":-1,"completed":6,"skipped":18,"failed":0}

S
------------------------------
[BeforeEach] [sig-apps] DisruptionController
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 15 lines ...
• [SLOW TEST:9.440 seconds]
[sig-apps] DisruptionController
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  evictions: too few pods, absolute => should not allow an eviction
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/disruption.go:267
------------------------------
{"msg":"PASSED [sig-apps] DisruptionController evictions: too few pods, absolute =\u003e should not allow an eviction","total":-1,"completed":8,"skipped":56,"failed":0}

SSS
------------------------------
[BeforeEach] [sig-storage] Projected secret
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:57:34.608: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename projected
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be able to mount in a volume regardless of a different secret existing with same name in different namespace [NodeConformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/projected_secret.go:90
STEP: Creating projection with secret that has name projected-secret-test-e76e688f-24c2-4302-9b76-4d3938754865
STEP: Creating a pod to test consume secrets
Oct 13 00:57:37.214: INFO: Waiting up to 5m0s for pod "pod-projected-secrets-eac0b12b-bf72-46a6-bf03-152ef37dc6ce" in namespace "projected-6843" to be "Succeeded or Failed"
Oct 13 00:57:37.450: INFO: Pod "pod-projected-secrets-eac0b12b-bf72-46a6-bf03-152ef37dc6ce": Phase="Pending", Reason="", readiness=false. Elapsed: 236.471213ms
Oct 13 00:57:39.688: INFO: Pod "pod-projected-secrets-eac0b12b-bf72-46a6-bf03-152ef37dc6ce": Phase="Pending", Reason="", readiness=false. Elapsed: 2.474130643s
Oct 13 00:57:41.925: INFO: Pod "pod-projected-secrets-eac0b12b-bf72-46a6-bf03-152ef37dc6ce": Phase="Pending", Reason="", readiness=false. Elapsed: 4.711357136s
Oct 13 00:57:44.163: INFO: Pod "pod-projected-secrets-eac0b12b-bf72-46a6-bf03-152ef37dc6ce": Phase="Pending", Reason="", readiness=false. Elapsed: 6.94890341s
Oct 13 00:57:46.400: INFO: Pod "pod-projected-secrets-eac0b12b-bf72-46a6-bf03-152ef37dc6ce": Phase="Succeeded", Reason="", readiness=false. Elapsed: 9.185647976s
STEP: Saw pod success
Oct 13 00:57:46.400: INFO: Pod "pod-projected-secrets-eac0b12b-bf72-46a6-bf03-152ef37dc6ce" satisfied condition "Succeeded or Failed"
Oct 13 00:57:46.636: INFO: Trying to get logs from node ip-172-20-48-187.ap-southeast-1.compute.internal pod pod-projected-secrets-eac0b12b-bf72-46a6-bf03-152ef37dc6ce container projected-secret-volume-test: <nil>
STEP: delete the pod
Oct 13 00:57:47.127: INFO: Waiting for pod pod-projected-secrets-eac0b12b-bf72-46a6-bf03-152ef37dc6ce to disappear
Oct 13 00:57:47.363: INFO: Pod pod-projected-secrets-eac0b12b-bf72-46a6-bf03-152ef37dc6ce no longer exists
[AfterEach] [sig-storage] Projected secret
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 5 lines ...
• [SLOW TEST:13.467 seconds]
[sig-storage] Projected secret
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/framework.go:23
  should be able to mount in a volume regardless of a different secret existing with same name in different namespace [NodeConformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/storage/projected_secret.go:90
------------------------------
{"msg":"PASSED [sig-storage] Projected secret should be able to mount in a volume regardless of a different secret existing with same name in different namespace [NodeConformance]","total":-1,"completed":5,"skipped":30,"failed":0}

S
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:48.089: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 44 lines ...
Oct 13 00:57:30.994: INFO: PersistentVolumeClaim pvc-5kcgk found but phase is Pending instead of Bound.
Oct 13 00:57:33.238: INFO: PersistentVolumeClaim pvc-5kcgk found and phase=Bound (9.225592678s)
Oct 13 00:57:33.238: INFO: Waiting up to 3m0s for PersistentVolume local-bvjgh to have phase Bound
Oct 13 00:57:33.483: INFO: PersistentVolume local-bvjgh found and phase=Bound (244.567029ms)
STEP: Creating pod pod-subpath-test-preprovisionedpv-kjsj
STEP: Creating a pod to test subpath
Oct 13 00:57:34.217: INFO: Waiting up to 5m0s for pod "pod-subpath-test-preprovisionedpv-kjsj" in namespace "provisioning-8841" to be "Succeeded or Failed"
Oct 13 00:57:34.461: INFO: Pod "pod-subpath-test-preprovisionedpv-kjsj": Phase="Pending", Reason="", readiness=false. Elapsed: 243.972351ms
Oct 13 00:57:36.707: INFO: Pod "pod-subpath-test-preprovisionedpv-kjsj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.489435988s
Oct 13 00:57:38.953: INFO: Pod "pod-subpath-test-preprovisionedpv-kjsj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.735440103s
Oct 13 00:57:41.197: INFO: Pod "pod-subpath-test-preprovisionedpv-kjsj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.980230422s
STEP: Saw pod success
Oct 13 00:57:41.198: INFO: Pod "pod-subpath-test-preprovisionedpv-kjsj" satisfied condition "Succeeded or Failed"
Oct 13 00:57:41.442: INFO: Trying to get logs from node ip-172-20-55-159.ap-southeast-1.compute.internal pod pod-subpath-test-preprovisionedpv-kjsj container test-container-volume-preprovisionedpv-kjsj: <nil>
STEP: delete the pod
Oct 13 00:57:41.942: INFO: Waiting for pod pod-subpath-test-preprovisionedpv-kjsj to disappear
Oct 13 00:57:42.186: INFO: Pod pod-subpath-test-preprovisionedpv-kjsj no longer exists
STEP: Deleting pod pod-subpath-test-preprovisionedpv-kjsj
Oct 13 00:57:42.186: INFO: Deleting pod "pod-subpath-test-preprovisionedpv-kjsj" in namespace "provisioning-8841"
... skipping 24 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Pre-provisioned PV (default fs)] subPath
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should support existing directory
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:205
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: block] [Testpattern: Pre-provisioned PV (default fs)] subPath should support existing directory","total":-1,"completed":4,"skipped":29,"failed":0}
[BeforeEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:48.590: INFO: Only supported for providers [vsphere] (not aws)
[AfterEach] [Testpattern: Inline-volume (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 136 lines ...
[sig-storage] In-tree Volumes
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  [Driver: windows-gcepd]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (immediate binding)] topology
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

      Only supported for providers [gce gke] (not aws)

      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/drivers/in_tree.go:1301
------------------------------
... skipping 103 lines ...
• [SLOW TEST:19.408 seconds]
[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  listing validating webhooks should work [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] listing validating webhooks should work [Conformance]","total":-1,"completed":8,"skipped":57,"failed":0}

SSS
------------------------------
{"msg":"PASSED [sig-apps] Deployment deployment should delete old replica sets [Conformance]","total":-1,"completed":12,"skipped":85,"failed":0}
[BeforeEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:57:46.221: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename security-context
STEP: Waiting for a default service account to be provisioned in namespace
[It] should support seccomp runtime/default [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/node/security_context.go:176
STEP: Creating a pod to test seccomp.security.alpha.kubernetes.io/pod
Oct 13 00:57:47.685: INFO: Waiting up to 5m0s for pod "security-context-35c30cfe-fd96-485c-ab34-5a52c676a187" in namespace "security-context-4002" to be "Succeeded or Failed"
Oct 13 00:57:47.928: INFO: Pod "security-context-35c30cfe-fd96-485c-ab34-5a52c676a187": Phase="Pending", Reason="", readiness=false. Elapsed: 243.513745ms
Oct 13 00:57:50.172: INFO: Pod "security-context-35c30cfe-fd96-485c-ab34-5a52c676a187": Phase="Pending", Reason="", readiness=false. Elapsed: 2.487212635s
Oct 13 00:57:52.416: INFO: Pod "security-context-35c30cfe-fd96-485c-ab34-5a52c676a187": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.731538916s
STEP: Saw pod success
Oct 13 00:57:52.416: INFO: Pod "security-context-35c30cfe-fd96-485c-ab34-5a52c676a187" satisfied condition "Succeeded or Failed"
Oct 13 00:57:52.661: INFO: Trying to get logs from node ip-172-20-48-187.ap-southeast-1.compute.internal pod security-context-35c30cfe-fd96-485c-ab34-5a52c676a187 container test-container: <nil>
STEP: delete the pod
Oct 13 00:57:53.164: INFO: Waiting for pod security-context-35c30cfe-fd96-485c-ab34-5a52c676a187 to disappear
Oct 13 00:57:53.411: INFO: Pod security-context-35c30cfe-fd96-485c-ab34-5a52c676a187 no longer exists
[AfterEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 14 lines ...
STEP: Building a namespace api object, basename security-context-test
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:46
[It] should not allow privilege escalation when false [LinuxOnly] [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
Oct 13 00:57:49.528: INFO: Waiting up to 5m0s for pod "alpine-nnp-false-9d916a2a-6e8a-4741-9462-69d27880306e" in namespace "security-context-test-9301" to be "Succeeded or Failed"
Oct 13 00:57:49.764: INFO: Pod "alpine-nnp-false-9d916a2a-6e8a-4741-9462-69d27880306e": Phase="Pending", Reason="", readiness=false. Elapsed: 236.147863ms
Oct 13 00:57:52.001: INFO: Pod "alpine-nnp-false-9d916a2a-6e8a-4741-9462-69d27880306e": Phase="Pending", Reason="", readiness=false. Elapsed: 2.472696464s
Oct 13 00:57:54.238: INFO: Pod "alpine-nnp-false-9d916a2a-6e8a-4741-9462-69d27880306e": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.71018986s
Oct 13 00:57:54.238: INFO: Pod "alpine-nnp-false-9d916a2a-6e8a-4741-9462-69d27880306e" satisfied condition "Succeeded or Failed"
[AfterEach] [sig-node] Security Context
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
Oct 13 00:57:54.478: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "security-context-test-9301" for this suite.


... skipping 2 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  when creating containers with AllowPrivilegeEscalation
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/security_context.go:296
    should not allow privilege escalation when false [LinuxOnly] [NodeConformance] [Conformance]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Security Context when creating containers with AllowPrivilegeEscalation should not allow privilege escalation when false [LinuxOnly] [NodeConformance] [Conformance]","total":-1,"completed":6,"skipped":35,"failed":0}

S
------------------------------
[BeforeEach] [sig-api-machinery] Watchers
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 28 lines ...
• [SLOW TEST:14.720 seconds]
[sig-api-machinery] Watchers
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/framework.go:23
  should observe an object deletion if it stops meeting the requirements of the selector [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-api-machinery] Watchers should observe an object deletion if it stops meeting the requirements of the selector [Conformance]","total":-1,"completed":9,"skipped":61,"failed":0}

SSSS
------------------------------
[BeforeEach] [sig-node] Probing container
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
... skipping 19 lines ...
• [SLOW TEST:24.743 seconds]
[sig-node] Probing container
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should be restarted with a local redirect http liveness probe
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/container_probe.go:274
------------------------------
{"msg":"PASSED [sig-node] Probing container should be restarted with a local redirect http liveness probe","total":-1,"completed":11,"skipped":114,"failed":0}
[BeforeEach] [sig-apps] ReplicaSet
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:57:55.858: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename replicaset
STEP: Waiting for a default service account to be provisioned in namespace
... skipping 114 lines ...
Oct 13 00:57:48.729: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename downward-api
STEP: Waiting for a default service account to be provisioned in namespace
[It] should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test downward api env vars
Oct 13 00:57:50.201: INFO: Waiting up to 5m0s for pod "downward-api-7fabd9b8-1c9d-4615-8d56-1d1ba5813ad3" in namespace "downward-api-7112" to be "Succeeded or Failed"
Oct 13 00:57:50.445: INFO: Pod "downward-api-7fabd9b8-1c9d-4615-8d56-1d1ba5813ad3": Phase="Pending", Reason="", readiness=false. Elapsed: 244.282834ms
Oct 13 00:57:52.690: INFO: Pod "downward-api-7fabd9b8-1c9d-4615-8d56-1d1ba5813ad3": Phase="Pending", Reason="", readiness=false. Elapsed: 2.488878564s
Oct 13 00:57:54.935: INFO: Pod "downward-api-7fabd9b8-1c9d-4615-8d56-1d1ba5813ad3": Phase="Pending", Reason="", readiness=false. Elapsed: 4.73404048s
Oct 13 00:57:57.180: INFO: Pod "downward-api-7fabd9b8-1c9d-4615-8d56-1d1ba5813ad3": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.979655051s
STEP: Saw pod success
Oct 13 00:57:57.180: INFO: Pod "downward-api-7fabd9b8-1c9d-4615-8d56-1d1ba5813ad3" satisfied condition "Succeeded or Failed"
Oct 13 00:57:57.425: INFO: Trying to get logs from node ip-172-20-37-188.ap-southeast-1.compute.internal pod downward-api-7fabd9b8-1c9d-4615-8d56-1d1ba5813ad3 container dapi-container: <nil>
STEP: delete the pod
Oct 13 00:57:57.972: INFO: Waiting for pod downward-api-7fabd9b8-1c9d-4615-8d56-1d1ba5813ad3 to disappear
Oct 13 00:57:58.217: INFO: Pod downward-api-7fabd9b8-1c9d-4615-8d56-1d1ba5813ad3 no longer exists
[AfterEach] [sig-node] Downward API
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:9.978 seconds]
[sig-node] Downward API
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Downward API should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance]","total":-1,"completed":5,"skipped":56,"failed":0}

SSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:57:58.737: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 91 lines ...
Oct 13 00:57:11.374: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-svxpt] to have phase Bound
Oct 13 00:57:11.614: INFO: PersistentVolumeClaim pvc-svxpt found and phase=Bound (240.141826ms)
STEP: Deleting the previously created pod
Oct 13 00:57:28.837: INFO: Deleting pod "pvc-volume-tester-5km6w" in namespace "csi-mock-volumes-1774"
Oct 13 00:57:29.078: INFO: Wait up to 5m0s for pod "pvc-volume-tester-5km6w" to be fully deleted
STEP: Checking CSI driver logs
Oct 13 00:57:35.806: INFO: Found NodeUnpublishVolume: {json: {"Method":"/csi.v1.Node/NodeUnpublishVolume","Request":{"volume_id":"4","target_path":"/var/lib/kubelet/pods/799dfda1-fed6-4165-8598-87601156aa1f/volumes/kubernetes.io~csi/pvc-2dd1af87-45b9-47ea-a53e-28d1bc2e55e2/mount"},"Response":{},"Error":"","FullError":null} Method:NodeUnpublishVolume Request:{VolumeContext:map[]} FullError:{Code:OK Message:} Error:}
STEP: Deleting pod pvc-volume-tester-5km6w
Oct 13 00:57:35.806: INFO: Deleting pod "pvc-volume-tester-5km6w" in namespace "csi-mock-volumes-1774"
STEP: Deleting claim pvc-svxpt
Oct 13 00:57:36.532: INFO: Waiting up to 2m0s for PersistentVolume pvc-2dd1af87-45b9-47ea-a53e-28d1bc2e55e2 to get deleted
Oct 13 00:57:36.772: INFO: PersistentVolume pvc-2dd1af87-45b9-47ea-a53e-28d1bc2e55e2 found and phase=Released (239.545947ms)
Oct 13 00:57:39.011: INFO: PersistentVolume pvc-2dd1af87-45b9-47ea-a53e-28d1bc2e55e2 found and phase=Released (2.479028118s)
... skipping 45 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/framework.go:23
  CSI workload information using mock driver
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:443
    should not be passed when CSIDriver does not exist
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/csi_mock_volume.go:493
------------------------------
{"msg":"PASSED [sig-storage] CSI mock volume CSI workload information using mock driver should not be passed when CSIDriver does not exist","total":-1,"completed":7,"skipped":43,"failed":0}

S
------------------------------
[BeforeEach] [sig-node] Docker Containers
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:57:55.223: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename containers
STEP: Waiting for a default service account to be provisioned in namespace
[It] should be able to override the image's default arguments (docker cmd) [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
STEP: Creating a pod to test override arguments
Oct 13 00:57:56.639: INFO: Waiting up to 5m0s for pod "client-containers-52b18dd3-87ea-4120-b487-825c213a1e14" in namespace "containers-6327" to be "Succeeded or Failed"
Oct 13 00:57:56.875: INFO: Pod "client-containers-52b18dd3-87ea-4120-b487-825c213a1e14": Phase="Pending", Reason="", readiness=false. Elapsed: 235.25555ms
Oct 13 00:57:59.110: INFO: Pod "client-containers-52b18dd3-87ea-4120-b487-825c213a1e14": Phase="Pending", Reason="", readiness=false. Elapsed: 2.470875673s
Oct 13 00:58:01.346: INFO: Pod "client-containers-52b18dd3-87ea-4120-b487-825c213a1e14": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.706574143s
STEP: Saw pod success
Oct 13 00:58:01.346: INFO: Pod "client-containers-52b18dd3-87ea-4120-b487-825c213a1e14" satisfied condition "Succeeded or Failed"
Oct 13 00:58:01.581: INFO: Trying to get logs from node ip-172-20-55-159.ap-southeast-1.compute.internal pod client-containers-52b18dd3-87ea-4120-b487-825c213a1e14 container agnhost-container: <nil>
STEP: delete the pod
Oct 13 00:58:02.063: INFO: Waiting for pod client-containers-52b18dd3-87ea-4120-b487-825c213a1e14 to disappear
Oct 13 00:58:02.299: INFO: Pod client-containers-52b18dd3-87ea-4120-b487-825c213a1e14 no longer exists
[AfterEach] [sig-node] Docker Containers
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
... skipping 4 lines ...
• [SLOW TEST:7.548 seconds]
[sig-node] Docker Containers
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/node/framework.go:23
  should be able to override the image's default arguments (docker cmd) [NodeConformance] [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-node] Docker Containers should be able to override the image's default arguments (docker cmd) [NodeConformance] [Conformance]","total":-1,"completed":10,"skipped":65,"failed":0}

SSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:58:02.798: INFO: Driver csi-hostpath doesn't support InlineVolume -- skipping
... skipping 87 lines ...
• [SLOW TEST:36.276 seconds]
[sig-network] EndpointSlice
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/common/framework.go:23
  should create Endpoints and EndpointSlices for Pods matching a Service [Conformance]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:630
------------------------------
{"msg":"PASSED [sig-network] EndpointSlice should create Endpoints and EndpointSlices for Pods matching a Service [Conformance]","total":-1,"completed":9,"skipped":40,"failed":0}

SSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Oct 13 00:58:02.945: INFO: Driver local doesn't support DynamicPV -- skipping
... skipping 101 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/in_tree_volumes.go:58
    [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
      (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents
      /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
------------------------------
{"msg":"PASSED [sig-auth] Certificates API [Privileged:ClusterAdmin] should support CSR API operations [Conformance]","total":-1,"completed":5,"skipped":27,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:57:29.146: INFO: >>> kubeConfig: /root/.kube/config
... skipping 62 lines ...
Oct 13 00:56:29.171: INFO: >>> kubeConfig: /root/.kube/config
STEP: Building a namespace api object, basename cronjob
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-apps] CronJob
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/cronjob.go:63
W1013 00:56:30.617465    5330 warnings.go:70] batch/v1beta1 CronJob is deprecated in v1.21+, unavailable in v1.25+; use batch/v1 CronJob
[It] should delete failed finished jobs with limit of one job
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/cronjob.go:294
STEP: Creating an AllowConcurrent cronjob with custom history limit
STEP: Ensuring a finished job exists
STEP: Ensuring a finished job exists by listing jobs explicitly
STEP: Ensuring this job and its pods does not exist anymore
STEP: Ensuring there is 1 finished job by listing jobs explicitly
... skipping 4 lines ...
STEP: Destroying namespace "cronjob-3222" for this suite.


• [SLOW TEST:101.614 seconds]
[sig-apps] CronJob
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/framework.go:23
  should delete failed finished jobs with limit of one job
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apps/cronjob.go:294
------------------------------
{"msg":"PASSED [sig-apps] CronJob should delete failed finished jobs with limit of one job","total":-1,"completed":9,"skipped":80,"failed":0}

S
------------------------------
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: block] [Testpattern: Pre-provisioned PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]","total":-1,"completed":6,"skipped":27,"failed":0}
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Oct 13 00:58:09.857: INFO: >>> kubeConfig: /root/.kube/config
... skipping 34 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:241
[It] should check if cluster-info dump succeeds
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:1078
STEP: running cluster-info dump
Oct 13 00:58:00.042: INFO: Running '/tmp/kubectl1871530180/kubectl --server=https://api.e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-9769 cluster-info dump'
Oct 13 00:58:12.365: INFO: stderr: ""
Oct 13 00:58:12.368: INFO: stdout: "{\n    \"kind\": \"NodeList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"14131\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\",\n                \"uid\": \"280ebf8d-7784-49a3-90cd-4f0b0473ae8b\",\n                \"resourceVersion\": \"14081\",\n                \"creationTimestamp\": \"2021-10-13T00:49:27Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"ap-southeast-1\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"ap-southeast-1a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-ap-southeast-1a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"node\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"topology.hostpath.csi/node\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\",\n                    \"topology.kubernetes.io/region\": \"ap-southeast-1\",\n                    \"topology.kubernetes.io/zone\": \"ap-southeast-1a\"\n                },\n                \"annotations\": {\n                    \"csi.volume.kubernetes.io/nodeid\": \"{\\\"csi-hostpath-ephemeral-1532\\\":\\\"ip-172-20-37-188.ap-southeast-1.compute.internal\\\",\\\"csi-hostpath-provisioning-9457\\\":\\\"ip-172-20-37-188.ap-southeast-1.compute.internal\\\",\\\"csi-mock-csi-mock-volumes-6651\\\":\\\"csi-mock-csi-mock-volumes-6651\\\"}\",\n                    \"flannel.alpha.coreos.com/backend-data\": \"{\\\"VtepMAC\\\":\\\"9e:d1:aa:bd:93:7f\\\"}\",\n                    \"flannel.alpha.coreos.com/backend-type\": \"vxlan\",\n                    \"flannel.alpha.coreos.com/kube-subnet-manager\": \"true\",\n                    \"flannel.alpha.coreos.com/public-ip\": \"172.20.37.188\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.3.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.3.0/24\"\n                ],\n                \"providerID\": \"aws:///ap-southeast-1a/i-0b6f882429d7b2838\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"48725632Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3964584Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"44905542377\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3862184Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:49:43Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:43Z\",\n                        \"reason\": \"FlannelIsUp\",\n                        \"message\": \"Flannel is running on this node\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:57:59Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:27Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:57:59Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:27Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:57:59Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:27Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:57:59Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:47Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status. AppArmor enabled\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.37.188\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"54.251.230.64\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-54-251-230-64.ap-southeast-1.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec283455f9dece95e1b6868098d37249\",\n                    \"systemUUID\": \"ec283455-f9de-ce95-e1b6-868098d37249\",\n                    \"bootID\": \"85bd1383-082d-4d33-9ef2-af209a359868\",\n                    \"kernelVersion\": \"5.11.0-1019-aws\",\n                    \"osImage\": \"Ubuntu 20.04.3 LTS\",\n                    \"containerRuntimeVersion\": \"docker://20.10.9\",\n                    \"kubeletVersion\": \"v1.21.5\",\n                    \"kubeProxyVersion\": \"v1.21.5\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89\",\n                            \"k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4\"\n                        ],\n                        \"sizeBytes\": 253371792\n                    },\n                    {\n                        \"names\": [\n                            \"nginx@sha256:155238fc7fdea5b7d4e5cf026f268a03f87741e511bdd225b89cea084544a8fb\",\n                            \"nginx:latest\"\n                        ],\n                        \"sizeBytes\": 133277153\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0\",\n                            \"k8s.gcr.io/e2e-test-images/httpd:2.4.39-1\"\n                        ],\n                        \"sizeBytes\": 126894770\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1\",\n                            \"k8s.gcr.io/e2e-test-images/agnhost:2.32\"\n                        ],\n                        \"sizeBytes\": 125930239\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50\",\n                            \"k8s.gcr.io/e2e-test-images/httpd:2.4.38-1\"\n                        ],\n                        \"sizeBytes\": 123781643\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 103542696\n                    },\n                    {\n                        \"names\": [\n                            \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                            \"quay.io/coreos/flannel:v0.13.0\"\n                        ],\n                        \"sizeBytes\": 57156911\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:695505fcfcc69f1cf35665dce487aad447adbb9af69b796d6437f869015d1157\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v2.1.1\"\n                        ],\n                        \"sizeBytes\": 51658444\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 51645752\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter@sha256:51f2dfde5bccac7854b3704689506aeecfb793328427b91115ba253a93e60782\",\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter:v4.0.0\"\n                        ],\n                        \"sizeBytes\": 49559562\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09\",\n                            \"k8s.gcr.io/sig-storage/csi-attacher:v3.1.0\"\n                        ],\n                        \"sizeBytes\": 49195358\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a\",\n                            \"k8s.gcr.io/sig-storage/csi-resizer:v1.1.0\"\n                        ],\n                        \"sizeBytes\": 49176472\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/coredns/coredns@sha256:43a9f52f5dce39bf1816afe6141724cc2d08811e466dd46e6628c925e2419bdc\",\n                            \"k8s.gcr.io/coredns/coredns:v1.8.5\"\n                        ],\n                        \"sizeBytes\": 46776035\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c\",\n                            \"k8s.gcr.io/sig-storage/csi-resizer:v0.5.0\"\n                        ],\n                        \"sizeBytes\": 46041582\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5\",\n                            \"k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0\"\n                        ],\n                        \"sizeBytes\": 27762720\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 19662887\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1\"\n                        ],\n                        \"sizeBytes\": 17997083\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/livenessprobe@sha256:48da0e4ed7238ad461ea05f68c25921783c37b315f21a5c5a2780157a6460994\",\n                            \"k8s.gcr.io/sig-storage/livenessprobe:v2.2.0\"\n                        ],\n                        \"sizeBytes\": 17776649\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793\",\n                            \"k8s.gcr.io/sig-storage/mock-driver:v4.1.0\"\n                        ],\n                        \"sizeBytes\": 17680993\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b\",\n                            \"k8s.gcr.io/e2e-test-images/nginx:1.14-1\"\n                        ],\n                        \"sizeBytes\": 16032814\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac\",\n                            \"k8s.gcr.io/e2e-test-images/nonewprivs:1.3\"\n                        ],\n                        \"sizeBytes\": 7107254\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592\",\n                            \"k8s.gcr.io/e2e-test-images/busybox:1.29-1\"\n                        ],\n                        \"sizeBytes\": 1154361\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07\",\n                            \"k8s.gcr.io/pause:3.5\"\n                        ],\n                        \"sizeBytes\": 682696\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:6c3835cab3980f11b83277305d0d736051c32b17606f5ec59f1dda67c9ba3810\",\n                            \"k8s.gcr.io/pause:3.4.1\"\n                        ],\n                        \"sizeBytes\": 682696\n                    }\n                ],\n                \"volumesInUse\": [\n                    \"kubernetes.io/aws-ebs/aws://ap-southeast-1a/vol-0b9b24442108c0eba\",\n                    \"kubernetes.io/csi/csi-hostpath-ephemeral-1532^984d2f06-2bc0-11ec-8256-6ec8fcdeb20a\",\n                    \"kubernetes.io/csi/csi-hostpath-provisioning-9457^9b04ac15-2bc0-11ec-bc5f-8e378d05b206\"\n                ],\n                \"volumesAttached\": [\n                    {\n                        \"name\": \"kubernetes.io/aws-ebs/aws://ap-southeast-1a/vol-0b9b24442108c0eba\",\n                        \"devicePath\": \"/dev/xvdbg\"\n                    },\n                    {\n                        \"name\": \"kubernetes.io/csi/csi-hostpath-ephemeral-1532^984d2f06-2bc0-11ec-8256-6ec8fcdeb20a\",\n                        \"devicePath\": \"\"\n                    },\n                    {\n                        \"name\": \"kubernetes.io/csi/csi-hostpath-provisioning-9457^9b04ac15-2bc0-11ec-bc5f-8e378d05b206\",\n                        \"devicePath\": \"\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-43-74.ap-southeast-1.compute.internal\",\n                \"uid\": \"b7880c43-0dbf-4e62-b5fe-a119073c3dda\",\n                \"resourceVersion\": \"13930\",\n                \"creationTimestamp\": \"2021-10-13T00:49:35Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"ap-southeast-1\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"ap-southeast-1a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-ap-southeast-1a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-43-74.ap-southeast-1.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"node\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"topology.hostpath.csi/node\": \"ip-172-20-43-74.ap-southeast-1.compute.internal\",\n                    \"topology.kubernetes.io/region\": \"ap-southeast-1\",\n                    \"topology.kubernetes.io/zone\": \"ap-southeast-1a\"\n                },\n                \"annotations\": {\n                    \"csi.volume.kubernetes.io/nodeid\": \"{\\\"csi-hostpath-ephemeral-7285\\\":\\\"ip-172-20-43-74.ap-southeast-1.compute.internal\\\"}\",\n                    \"flannel.alpha.coreos.com/backend-data\": \"{\\\"VtepMAC\\\":\\\"ae:c5:86:53:a6:d2\\\"}\",\n                    \"flannel.alpha.coreos.com/backend-type\": \"vxlan\",\n                    \"flannel.alpha.coreos.com/kube-subnet-manager\": \"true\",\n                    \"flannel.alpha.coreos.com/public-ip\": \"172.20.43.74\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.4.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.4.0/24\"\n                ],\n                \"providerID\": \"aws:///ap-southeast-1a/i-01c329ed580b28ce5\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"48725632Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3964592Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"44905542377\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3862192Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:49:52Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:52Z\",\n                        \"reason\": \"FlannelIsUp\",\n                        \"message\": \"Flannel is running on this node\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:57:38Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:35Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:57:38Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:35Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:57:38Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:35Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:57:38Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:55Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status. AppArmor enabled\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.43.74\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"54.169.95.20\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-43-74.ap-southeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-43-74.ap-southeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-54-169-95-20.ap-southeast-1.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec2e2df8f169441c363933a36f3a485b\",\n                    \"systemUUID\": \"ec2e2df8-f169-441c-3639-33a36f3a485b\",\n                    \"bootID\": \"5654d2ff-84ae-4f09-8f3c-1f28a787421d\",\n                    \"kernelVersion\": \"5.11.0-1019-aws\",\n                    \"osImage\": \"Ubuntu 20.04.3 LTS\",\n                    \"containerRuntimeVersion\": \"docker://20.10.9\",\n                    \"kubeletVersion\": \"v1.21.5\",\n                    \"kubeProxyVersion\": \"v1.21.5\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89\",\n                            \"k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4\"\n                        ],\n                        \"sizeBytes\": 253371792\n                    },\n                    {\n                        \"names\": [\n                            \"nginx@sha256:155238fc7fdea5b7d4e5cf026f268a03f87741e511bdd225b89cea084544a8fb\",\n                            \"nginx:latest\"\n                        ],\n                        \"sizeBytes\": 133277153\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0\",\n                            \"k8s.gcr.io/e2e-test-images/httpd:2.4.39-1\"\n                        ],\n                        \"sizeBytes\": 126894770\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1\",\n                            \"k8s.gcr.io/e2e-test-images/agnhost:2.32\"\n                        ],\n                        \"sizeBytes\": 125930239\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50\",\n                            \"k8s.gcr.io/e2e-test-images/httpd:2.4.38-1\"\n                        ],\n                        \"sizeBytes\": 123781643\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 103542696\n                    },\n                    {\n                        \"names\": [\n                            \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                            \"quay.io/coreos/flannel:v0.13.0\"\n                        ],\n                        \"sizeBytes\": 57156911\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:695505fcfcc69f1cf35665dce487aad447adbb9af69b796d6437f869015d1157\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v2.1.1\"\n                        ],\n                        \"sizeBytes\": 51658444\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 51645752\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter@sha256:51f2dfde5bccac7854b3704689506aeecfb793328427b91115ba253a93e60782\",\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter:v4.0.0\"\n                        ],\n                        \"sizeBytes\": 49559562\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09\",\n                            \"k8s.gcr.io/sig-storage/csi-attacher:v3.1.0\"\n                        ],\n                        \"sizeBytes\": 49195358\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a\",\n                            \"k8s.gcr.io/sig-storage/csi-resizer:v1.1.0\"\n                        ],\n                        \"sizeBytes\": 49176472\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab\",\n                            \"k8s.gcr.io/sig-storage/csi-attacher:v2.2.0\"\n                        ],\n                        \"sizeBytes\": 46131354\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5\",\n                            \"k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0\"\n                        ],\n                        \"sizeBytes\": 27762720\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 19662887\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1\"\n                        ],\n                        \"sizeBytes\": 17997083\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/livenessprobe@sha256:48da0e4ed7238ad461ea05f68c25921783c37b315f21a5c5a2780157a6460994\",\n                            \"k8s.gcr.io/sig-storage/livenessprobe:v2.2.0\"\n                        ],\n                        \"sizeBytes\": 17776649\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793\",\n                            \"k8s.gcr.io/sig-storage/mock-driver:v4.1.0\"\n                        ],\n                        \"sizeBytes\": 17680993\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b\",\n                            \"k8s.gcr.io/e2e-test-images/nginx:1.14-1\"\n                        ],\n                        \"sizeBytes\": 16032814\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac\",\n                            \"k8s.gcr.io/e2e-test-images/nonewprivs:1.3\"\n                        ],\n                        \"sizeBytes\": 7107254\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/busybox@sha256:d8d3bc2c183ed2f9f10e7258f84971202325ee6011ba137112e01e30f206de67\",\n                            \"k8s.gcr.io/busybox:latest\"\n                        ],\n                        \"sizeBytes\": 2433303\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592\",\n                            \"k8s.gcr.io/e2e-test-images/busybox:1.29-1\"\n                        ],\n                        \"sizeBytes\": 1154361\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07\",\n                            \"k8s.gcr.io/pause:3.5\"\n                        ],\n                        \"sizeBytes\": 682696\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:6c3835cab3980f11b83277305d0d736051c32b17606f5ec59f1dda67c9ba3810\",\n                            \"k8s.gcr.io/pause:3.4.1\"\n                        ],\n                        \"sizeBytes\": 682696\n                    }\n                ],\n                \"volumesInUse\": [\n                    \"kubernetes.io/aws-ebs/aws://ap-southeast-1a/vol-070a5915ec276f291\"\n                ],\n                \"volumesAttached\": [\n                    {\n                        \"name\": \"kubernetes.io/aws-ebs/aws://ap-southeast-1a/vol-070a5915ec276f291\",\n                        \"devicePath\": \"/dev/xvdbh\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-48-187.ap-southeast-1.compute.internal\",\n                \"uid\": \"1ee500c6-31fa-429b-a2fa-4839b6c9f01b\",\n                \"resourceVersion\": \"14037\",\n                \"creationTimestamp\": \"2021-10-13T00:49:25Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"ap-southeast-1\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"ap-southeast-1a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-ap-southeast-1a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-48-187.ap-southeast-1.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"node\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"topology.hostpath.csi/node\": \"ip-172-20-48-187.ap-southeast-1.compute.internal\",\n                    \"topology.kubernetes.io/region\": \"ap-southeast-1\",\n                    \"topology.kubernetes.io/zone\": \"ap-southeast-1a\"\n                },\n                \"annotations\": {\n                    \"flannel.alpha.coreos.com/backend-data\": \"{\\\"VtepMAC\\\":\\\"4a:05:ae:40:cb:f6\\\"}\",\n                    \"flannel.alpha.coreos.com/backend-type\": \"vxlan\",\n                    \"flannel.alpha.coreos.com/kube-subnet-manager\": \"true\",\n                    \"flannel.alpha.coreos.com/public-ip\": \"172.20.48.187\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.2.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.2.0/24\"\n                ],\n                \"providerID\": \"aws:///ap-southeast-1a/i-0856c3c3c0ee2f508\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"48725632Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3964592Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"44905542377\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3862192Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:49:42Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:42Z\",\n                        \"reason\": \"FlannelIsUp\",\n                        \"message\": \"Flannel is running on this node\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:57:57Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:25Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:57:57Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:25Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:57:57Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:25Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:57:57Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:45Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status. AppArmor enabled\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.48.187\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"52.221.224.4\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-48-187.ap-southeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-48-187.ap-southeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-52-221-224-4.ap-southeast-1.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec2aa23cad5c8f02494edb582f4bdee0\",\n                    \"systemUUID\": \"ec2aa23c-ad5c-8f02-494e-db582f4bdee0\",\n                    \"bootID\": \"7c185af5-8692-474c-bbf4-f4fa0d793baf\",\n                    \"kernelVersion\": \"5.11.0-1019-aws\",\n                    \"osImage\": \"Ubuntu 20.04.3 LTS\",\n                    \"containerRuntimeVersion\": \"docker://20.10.9\",\n                    \"kubeletVersion\": \"v1.21.5\",\n                    \"kubeProxyVersion\": \"v1.21.5\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/volume/nfs@sha256:124a375b4f930627c65b2f84c0d0f09229a96bc527eec18ad0eeac150b96d1c2\",\n                            \"k8s.gcr.io/e2e-test-images/volume/nfs:1.2\"\n                        ],\n                        \"sizeBytes\": 263881150\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0\",\n                            \"k8s.gcr.io/e2e-test-images/httpd:2.4.39-1\"\n                        ],\n                        \"sizeBytes\": 126894770\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1\",\n                            \"k8s.gcr.io/e2e-test-images/agnhost:2.32\"\n                        ],\n                        \"sizeBytes\": 125930239\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50\",\n                            \"k8s.gcr.io/e2e-test-images/httpd:2.4.38-1\"\n                        ],\n                        \"sizeBytes\": 123781643\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 103542696\n                    },\n                    {\n                        \"names\": [\n                            \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                            \"quay.io/coreos/flannel:v0.13.0\"\n                        ],\n                        \"sizeBytes\": 57156911\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:695505fcfcc69f1cf35665dce487aad447adbb9af69b796d6437f869015d1157\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v2.1.1\"\n                        ],\n                        \"sizeBytes\": 51658444\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 51645752\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter@sha256:51f2dfde5bccac7854b3704689506aeecfb793328427b91115ba253a93e60782\",\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter:v4.0.0\"\n                        ],\n                        \"sizeBytes\": 49559562\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09\",\n                            \"k8s.gcr.io/sig-storage/csi-attacher:v3.1.0\"\n                        ],\n                        \"sizeBytes\": 49195358\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a\",\n                            \"k8s.gcr.io/sig-storage/csi-resizer:v1.1.0\"\n                        ],\n                        \"sizeBytes\": 49176472\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab\",\n                            \"k8s.gcr.io/sig-storage/csi-attacher:v2.2.0\"\n                        ],\n                        \"sizeBytes\": 46131354\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c\",\n                            \"k8s.gcr.io/sig-storage/csi-resizer:v0.5.0\"\n                        ],\n                        \"sizeBytes\": 46041582\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5\",\n                            \"k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0\"\n                        ],\n                        \"sizeBytes\": 27762720\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 19662887\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1\"\n                        ],\n                        \"sizeBytes\": 17997083\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/livenessprobe@sha256:48da0e4ed7238ad461ea05f68c25921783c37b315f21a5c5a2780157a6460994\",\n                            \"k8s.gcr.io/sig-storage/livenessprobe:v2.2.0\"\n                        ],\n                        \"sizeBytes\": 17776649\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793\",\n                            \"k8s.gcr.io/sig-storage/mock-driver:v4.1.0\"\n                        ],\n                        \"sizeBytes\": 17680993\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b\",\n                            \"k8s.gcr.io/e2e-test-images/nginx:1.14-1\"\n                        ],\n                        \"sizeBytes\": 16032814\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/busybox@sha256:d8d3bc2c183ed2f9f10e7258f84971202325ee6011ba137112e01e30f206de67\",\n                            \"k8s.gcr.io/busybox:latest\"\n                        ],\n                        \"sizeBytes\": 2433303\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592\",\n                            \"k8s.gcr.io/e2e-test-images/busybox:1.29-1\"\n                        ],\n                        \"sizeBytes\": 1154361\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07\",\n                            \"k8s.gcr.io/pause:3.5\"\n                        ],\n                        \"sizeBytes\": 682696\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:6c3835cab3980f11b83277305d0d736051c32b17606f5ec59f1dda67c9ba3810\",\n                            \"k8s.gcr.io/pause:3.4.1\"\n                        ],\n                        \"sizeBytes\": 682696\n                    }\n                ],\n                \"volumesInUse\": [\n                    \"kubernetes.io/aws-ebs/aws://ap-southeast-1a/vol-0c4f178ccf8881aa0\"\n                ],\n                \"volumesAttached\": [\n                    {\n                        \"name\": \"kubernetes.io/aws-ebs/aws://ap-southeast-1a/vol-0c4f178ccf8881aa0\",\n                        \"devicePath\": \"/dev/xvdbx\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\",\n                \"uid\": \"952ff1e1-0a7e-408d-8586-045640dcbbb1\",\n                \"resourceVersion\": \"13856\",\n                \"creationTimestamp\": \"2021-10-13T00:49:21Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"ap-southeast-1\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"ap-southeast-1a\",\n                    \"kops.k8s.io/instancegroup\": \"nodes-ap-southeast-1a\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"node\",\n                    \"node-role.kubernetes.io/node\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"t3.medium\",\n                    \"topology.hostpath.csi/node\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\",\n                    \"topology.kubernetes.io/region\": \"ap-southeast-1\",\n                    \"topology.kubernetes.io/zone\": \"ap-southeast-1a\"\n                },\n                \"annotations\": {\n                    \"flannel.alpha.coreos.com/backend-data\": \"{\\\"VtepMAC\\\":\\\"02:fd:d7:f3:97:19\\\"}\",\n                    \"flannel.alpha.coreos.com/backend-type\": \"vxlan\",\n                    \"flannel.alpha.coreos.com/kube-subnet-manager\": \"true\",\n                    \"flannel.alpha.coreos.com/public-ip\": \"172.20.55.159\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.1.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.1.0/24\"\n                ],\n                \"providerID\": \"aws:///ap-southeast-1a/i-013f1dc877ccbb565\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"48725632Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3964584Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"44905542377\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3862184Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:49:37Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:37Z\",\n                        \"reason\": \"FlannelIsUp\",\n                        \"message\": \"Flannel is running on this node\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:57:53Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:21Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:57:53Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:21Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:57:53Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:21Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:57:53Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:41Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status. AppArmor enabled\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.55.159\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"13.250.51.60\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-13-250-51-60.ap-southeast-1.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec2524328ff93830f705ac9255f5e86b\",\n                    \"systemUUID\": \"ec252432-8ff9-3830-f705-ac9255f5e86b\",\n                    \"bootID\": \"890e3587-5478-4eb1-b7ac-45d5312c19c8\",\n                    \"kernelVersion\": \"5.11.0-1019-aws\",\n                    \"osImage\": \"Ubuntu 20.04.3 LTS\",\n                    \"containerRuntimeVersion\": \"docker://20.10.9\",\n                    \"kubeletVersion\": \"v1.21.5\",\n                    \"kubeProxyVersion\": \"v1.21.5\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/volume/nfs@sha256:124a375b4f930627c65b2f84c0d0f09229a96bc527eec18ad0eeac150b96d1c2\",\n                            \"k8s.gcr.io/e2e-test-images/volume/nfs:1.2\"\n                        ],\n                        \"sizeBytes\": 263881150\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:702a992280fb7c3303e84a5801acbb4c9c7fcf48cffe0e9c8be3f0c60f74cf89\",\n                            \"k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.4\"\n                        ],\n                        \"sizeBytes\": 253371792\n                    },\n                    {\n                        \"names\": [\n                            \"nginx@sha256:155238fc7fdea5b7d4e5cf026f268a03f87741e511bdd225b89cea084544a8fb\",\n                            \"nginx:latest\"\n                        ],\n                        \"sizeBytes\": 133277153\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/httpd@sha256:716d2f68314c5c4ddd5ecdb45183fcb4ed8019015982c1321571f863989b70b0\",\n                            \"k8s.gcr.io/e2e-test-images/httpd:2.4.39-1\"\n                        ],\n                        \"sizeBytes\": 126894770\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/agnhost@sha256:758db666ac7028534dba72e7e9bb1e57bb81b8196f976f7a5cc351ef8b3529e1\",\n                            \"k8s.gcr.io/e2e-test-images/agnhost:2.32\"\n                        ],\n                        \"sizeBytes\": 125930239\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/httpd@sha256:b913fa234cc3473cfe16e937d106b455a7609f927f59031c81aca791e2689b50\",\n                            \"k8s.gcr.io/e2e-test-images/httpd:2.4.38-1\"\n                        ],\n                        \"sizeBytes\": 123781643\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 103542696\n                    },\n                    {\n                        \"names\": [\n                            \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                            \"quay.io/coreos/flannel:v0.13.0\"\n                        ],\n                        \"sizeBytes\": 57156911\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:695505fcfcc69f1cf35665dce487aad447adbb9af69b796d6437f869015d1157\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v2.1.1\"\n                        ],\n                        \"sizeBytes\": 51658444\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2\",\n                            \"k8s.gcr.io/sig-storage/csi-provisioner:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 51645752\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter@sha256:51f2dfde5bccac7854b3704689506aeecfb793328427b91115ba253a93e60782\",\n                            \"k8s.gcr.io/sig-storage/csi-snapshotter:v4.0.0\"\n                        ],\n                        \"sizeBytes\": 49559562\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09\",\n                            \"k8s.gcr.io/sig-storage/csi-attacher:v3.1.0\"\n                        ],\n                        \"sizeBytes\": 49195358\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a\",\n                            \"k8s.gcr.io/sig-storage/csi-resizer:v1.1.0\"\n                        ],\n                        \"sizeBytes\": 49176472\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/coredns/coredns@sha256:43a9f52f5dce39bf1816afe6141724cc2d08811e466dd46e6628c925e2419bdc\",\n                            \"k8s.gcr.io/coredns/coredns:v1.8.5\"\n                        ],\n                        \"sizeBytes\": 46776035\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab\",\n                            \"k8s.gcr.io/sig-storage/csi-attacher:v2.2.0\"\n                        ],\n                        \"sizeBytes\": 46131354\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c\",\n                            \"k8s.gcr.io/sig-storage/csi-resizer:v0.5.0\"\n                        ],\n                        \"sizeBytes\": 46041582\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nonroot@sha256:4051e85640c22f8e00c34dbd273576fc9e1e2829992656588062be9c0f69b04b\",\n                            \"k8s.gcr.io/e2e-test-images/nonroot:1.1\"\n                        ],\n                        \"sizeBytes\": 42321438\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def\",\n                            \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\"\n                        ],\n                        \"sizeBytes\": 40678121\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5\",\n                            \"k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0\"\n                        ],\n                        \"sizeBytes\": 27762720\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0\"\n                        ],\n                        \"sizeBytes\": 19662887\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:e07f914c32f0505e4c470a62a40ee43f84cbf8dc46ff861f31b14457ccbad108\",\n                            \"k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1\"\n                        ],\n                        \"sizeBytes\": 17997083\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/livenessprobe@sha256:48da0e4ed7238ad461ea05f68c25921783c37b315f21a5c5a2780157a6460994\",\n                            \"k8s.gcr.io/sig-storage/livenessprobe:v2.2.0\"\n                        ],\n                        \"sizeBytes\": 17776649\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793\",\n                            \"k8s.gcr.io/sig-storage/mock-driver:v4.1.0\"\n                        ],\n                        \"sizeBytes\": 17680993\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/nginx@sha256:503b7abb89e57383eba61cc8a9cb0b495ea575c516108f7d972a6ff6e1ab3c9b\",\n                            \"k8s.gcr.io/e2e-test-images/nginx:1.14-1\"\n                        ],\n                        \"sizeBytes\": 16032814\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592\",\n                            \"k8s.gcr.io/e2e-test-images/busybox:1.29-1\"\n                        ],\n                        \"sizeBytes\": 1154361\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07\",\n                            \"k8s.gcr.io/pause:3.5\"\n                        ],\n                        \"sizeBytes\": 682696\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:6c3835cab3980f11b83277305d0d736051c32b17606f5ec59f1dda67c9ba3810\",\n                            \"k8s.gcr.io/pause:3.4.1\"\n                        ],\n                        \"sizeBytes\": 682696\n                    }\n                ],\n                \"volumesInUse\": [\n                    \"kubernetes.io/aws-ebs/aws://ap-southeast-1a/vol-02eb42f0b57c4c5d0\",\n                    \"kubernetes.io/aws-ebs/aws://ap-southeast-1a/vol-080082e8d79601ba7\"\n                ],\n                \"volumesAttached\": [\n                    {\n                        \"name\": \"kubernetes.io/aws-ebs/aws://ap-southeast-1a/vol-02eb42f0b57c4c5d0\",\n                        \"devicePath\": \"/dev/xvdck\"\n                    },\n                    {\n                        \"name\": \"kubernetes.io/aws-ebs/aws://ap-southeast-1a/vol-080082e8d79601ba7\",\n                        \"devicePath\": \"/dev/xvdbu\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"ce168b11-9bb9-4272-a5f6-c36a10d997e5\",\n                \"resourceVersion\": \"4322\",\n                \"creationTimestamp\": \"2021-10-13T00:47:59Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"c5.large\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"ap-southeast-1\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"ap-southeast-1a\",\n                    \"kops.k8s.io/instancegroup\": \"master-ap-southeast-1a\",\n                    \"kops.k8s.io/kops-controller-pki\": \"\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                    \"kubernetes.io/os\": \"linux\",\n                    \"kubernetes.io/role\": \"master\",\n                    \"node-role.kubernetes.io/control-plane\": \"\",\n                    \"node-role.kubernetes.io/master\": \"\",\n                    \"node.kubernetes.io/exclude-from-external-load-balancers\": \"\",\n                    \"node.kubernetes.io/instance-type\": \"c5.large\",\n                    \"topology.kubernetes.io/region\": \"ap-southeast-1\",\n                    \"topology.kubernetes.io/zone\": \"ap-southeast-1a\"\n                },\n                \"annotations\": {\n                    \"flannel.alpha.coreos.com/backend-data\": \"{\\\"VtepMAC\\\":\\\"e6:d7:a7:35:3d:99\\\"}\",\n                    \"flannel.alpha.coreos.com/backend-type\": \"vxlan\",\n                    \"flannel.alpha.coreos.com/kube-subnet-manager\": \"true\",\n                    \"flannel.alpha.coreos.com/public-ip\": \"172.20.60.219\",\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"100.96.0.0/24\",\n                \"podCIDRs\": [\n                    \"100.96.0.0/24\"\n                ],\n                \"providerID\": \"aws:///ap-southeast-1a/i-070c6cee7b25f4796\",\n                \"taints\": [\n                    {\n                        \"key\": \"node-role.kubernetes.io/master\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ]\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"48725632Ki\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3808940Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-aws-ebs\": \"25\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"44905542377\",\n                    \"hugepages-1Gi\": \"0\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3706540Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:48:49Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:48:49Z\",\n                        \"reason\": \"FlannelIsUp\",\n                        \"message\": \"Flannel is running on this node\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:54:10Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:47:52Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:54:10Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:47:52Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:54:10Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:47:52Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2021-10-13T00:54:10Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:48:59Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status. AppArmor enabled\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"172.20.60.219\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"54.255.92.189\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n                    },\n                    {\n                        \"type\": \"ExternalDNS\",\n                        \"address\": \"ec2-54-255-92-189.ap-southeast-1.compute.amazonaws.com\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"ec2b0541140b2186cbdb3338b30ed8f8\",\n                    \"systemUUID\": \"ec2b0541-140b-2186-cbdb-3338b30ed8f8\",\n                    \"bootID\": \"70a3572d-bbed-4208-87d9-4c1f2af3f0cb\",\n                    \"kernelVersion\": \"5.11.0-1019-aws\",\n                    \"osImage\": \"Ubuntu 20.04.3 LTS\",\n                    \"containerRuntimeVersion\": \"docker://20.10.9\",\n                    \"kubeletVersion\": \"v1.21.5\",\n                    \"kubeProxyVersion\": \"v1.21.5\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/etcdadm/etcd-manager@sha256:36a55fd68b835aace1533cb4310f464a7f02d884fd7d4c3f528775e39f6bdb9f\",\n                            \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20211007\"\n                        ],\n                        \"sizeBytes\": 509896311\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-apiserver-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 125850013\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-controller-manager-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 119886835\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kops/kops-controller:1.23.0-alpha.1\"\n                        ],\n                        \"sizeBytes\": 113242495\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kops/dns-controller:1.23.0-alpha.1\"\n                        ],\n                        \"sizeBytes\": 113040137\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 103542696\n                    },\n                    {\n                        \"names\": [\n                            \"quay.io/coreos/flannel@sha256:ac5322604bcab484955e6dbc507f45a906bde79046667322e3918a8578ab08c8\",\n                            \"quay.io/coreos/flannel:v0.13.0\"\n                        ],\n                        \"sizeBytes\": 57156911\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-scheduler-amd64:v1.21.5\"\n                        ],\n                        \"sizeBytes\": 50848503\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kops/kube-apiserver-healthcheck:1.23.0-alpha.1\"\n                        ],\n                        \"sizeBytes\": 26202632\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:1ff6c18fbef2045af6b9c16bf034cc421a29027b800e4f9b68ae9b1cb3e9ae07\",\n                            \"k8s.gcr.io/pause:3.5\"\n                        ],\n                        \"sizeBytes\": 682696\n                    }\n                ]\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"EventList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"5562\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"coredns-6c8944dbdc-7bfp8.16ad70bac9206f7c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f1f45ef1-300b-45d6-871a-29f8dc5e95be\",\n                \"resourceVersion\": \"265\",\n                \"creationTimestamp\": \"2021-10-13T00:49:47Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-6c8944dbdc-7bfp8\",\n                \"uid\": \"dde5ceca-80ee-4d42-a471-3bf57f7eb3ad\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"755\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/coredns-6c8944dbdc-7bfp8 to ip-172-20-37-188.ap-southeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:47Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:47Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-6c8944dbdc-7bfp8.16ad70bb01ae792b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d1cf3336-489a-4a0d-89cc-f38a527c23a0\",\n                \"resourceVersion\": \"266\",\n                \"creationTimestamp\": \"2021-10-13T00:49:48Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-6c8944dbdc-7bfp8\",\n                \"uid\": \"dde5ceca-80ee-4d42-a471-3bf57f7eb3ad\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"759\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/coredns/coredns:v1.8.5\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:48Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:48Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-6c8944dbdc-7bfp8.16ad70bb76f74f34\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2f31416d-3f7a-45fa-9d96-2f8d71b2a177\",\n                \"resourceVersion\": \"267\",\n                \"creationTimestamp\": \"2021-10-13T00:49:50Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-6c8944dbdc-7bfp8\",\n                \"uid\": \"dde5ceca-80ee-4d42-a471-3bf57f7eb3ad\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"759\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/coredns/coredns:v1.8.5\\\" in 1.967696702s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:50Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:50Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-6c8944dbdc-7bfp8.16ad70bb7f13790f\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c549af9d-6d53-48f4-892a-338ff08cae3d\",\n                \"resourceVersion\": \"268\",\n                \"creationTimestamp\": \"2021-10-13T00:49:50Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-6c8944dbdc-7bfp8\",\n                \"uid\": \"dde5ceca-80ee-4d42-a471-3bf57f7eb3ad\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"759\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:50Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:50Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-6c8944dbdc-7bfp8.16ad70bb850f899d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4e24b29a-c4f3-452b-b064-ceca1a436d09\",\n                \"resourceVersion\": \"269\",\n                \"creationTimestamp\": \"2021-10-13T00:49:50Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-6c8944dbdc-7bfp8\",\n                \"uid\": \"dde5ceca-80ee-4d42-a471-3bf57f7eb3ad\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"759\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:50Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:50Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-6c8944dbdc-ccddt.16ad70a99452d71d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b283979c-c7a4-4321-8f05-17b040a74fe8\",\n                \"resourceVersion\": \"97\",\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-6c8944dbdc-ccddt\",\n                \"uid\": \"f5fb9642-8e13-4fd0-92c1-083631c86731\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"454\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/1 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:10Z\",\n            \"count\": 6,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-6c8944dbdc-ccddt.16ad70b4afff7604\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"788e52ec-c357-44b6-a794-5d46c57ee606\",\n                \"resourceVersion\": \"99\",\n                \"creationTimestamp\": \"2021-10-13T00:49:21Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-6c8944dbdc-ccddt\",\n                \"uid\": \"f5fb9642-8e13-4fd0-92c1-083631c86731\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"459\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/2 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate, 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:21Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:21Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-6c8944dbdc-ccddt.16ad70b7206c288b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d29e1c5a-6f51-4cfb-a2aa-12d224e99aba\",\n                \"resourceVersion\": \"171\",\n                \"creationTimestamp\": \"2021-10-13T00:49:31Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-6c8944dbdc-ccddt\",\n                \"uid\": \"f5fb9642-8e13-4fd0-92c1-083631c86731\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"603\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/4 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate, 3 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:31Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:31Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-6c8944dbdc-ccddt.16ad70b97509cb86\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"13d8969b-d668-445c-8106-c2bf6ccade39\",\n                \"resourceVersion\": \"245\",\n                \"creationTimestamp\": \"2021-10-13T00:49:41Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-6c8944dbdc-ccddt\",\n                \"uid\": \"f5fb9642-8e13-4fd0-92c1-083631c86731\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"661\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/coredns-6c8944dbdc-ccddt to ip-172-20-55-159.ap-southeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:41Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:41Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-6c8944dbdc-ccddt.16ad70b9ad1e71f2\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"383e4a30-edac-4ce1-a5a2-31657284d555\",\n                \"resourceVersion\": \"250\",\n                \"creationTimestamp\": \"2021-10-13T00:49:42Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-6c8944dbdc-ccddt\",\n                \"uid\": \"f5fb9642-8e13-4fd0-92c1-083631c86731\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"708\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/coredns/coredns:v1.8.5\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:42Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:42Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-6c8944dbdc-ccddt.16ad70b9b19b3ca7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5c53debc-8dee-4cda-bb88-6f64f3d11c3a\",\n                \"resourceVersion\": \"253\",\n                \"creationTimestamp\": \"2021-10-13T00:49:42Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-6c8944dbdc-ccddt\"\n            },\n            \"reason\": \"TaintManagerEviction\",\n            \"message\": \"Cancelling deletion of Pod kube-system/coredns-6c8944dbdc-ccddt\",\n            \"source\": {\n                \"component\": \"taint-controller\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:42Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:42Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-6c8944dbdc-ccddt.16ad70ba29bbf622\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"87ecd69a-542d-4ceb-8059-cbd91ba7536f\",\n                \"resourceVersion\": \"257\",\n                \"creationTimestamp\": \"2021-10-13T00:49:44Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-6c8944dbdc-ccddt\",\n                \"uid\": \"f5fb9642-8e13-4fd0-92c1-083631c86731\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"708\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/coredns/coredns:v1.8.5\\\" in 2.090687917s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:44Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:44Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-6c8944dbdc-ccddt.16ad70ba31649953\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"0e0173c9-5358-4158-9d5b-089c2c29d8b0\",\n                \"resourceVersion\": \"258\",\n                \"creationTimestamp\": \"2021-10-13T00:49:44Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-6c8944dbdc-ccddt\",\n                \"uid\": \"f5fb9642-8e13-4fd0-92c1-083631c86731\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"708\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:44Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:44Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-6c8944dbdc-ccddt.16ad70ba37305402\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"75ff1aa3-a8c5-4557-b30a-a0875f8a7d33\",\n                \"resourceVersion\": \"259\",\n                \"creationTimestamp\": \"2021-10-13T00:49:44Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-6c8944dbdc-ccddt\",\n                \"uid\": \"f5fb9642-8e13-4fd0-92c1-083631c86731\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"708\",\n                \"fieldPath\": \"spec.containers{coredns}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container coredns\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:44Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:44Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-6c8944dbdc.16ad70a99441dd56\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"577898ff-8893-44c3-a136-52b9e80dff32\",\n                \"resourceVersion\": \"67\",\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-6c8944dbdc\",\n                \"uid\": \"f83bdf7e-851e-40b4-8fb4-146ac4839008\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"442\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: coredns-6c8944dbdc-ccddt\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-6c8944dbdc.16ad70bac8786be3\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"68fa8330-e461-4d88-8e53-ad858ea29af3\",\n                \"resourceVersion\": \"264\",\n                \"creationTimestamp\": \"2021-10-13T00:49:47Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-6c8944dbdc\",\n                \"uid\": \"f83bdf7e-851e-40b4-8fb4-146ac4839008\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"753\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: coredns-6c8944dbdc-7bfp8\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:47Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:47Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-dxjsp.16ad70a995458323\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c176c1f2-8bcc-4c9b-b277-6d9b6fe4c13a\",\n                \"resourceVersion\": \"98\",\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-dxjsp\",\n                \"uid\": \"535f2276-8f96-4caa-93fc-e6e525769bde\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"456\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/1 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:10Z\",\n            \"count\": 6,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-dxjsp.16ad70b4b190cbbc\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d9afff65-88a7-4db2-886e-474b7a5593bf\",\n                \"resourceVersion\": \"100\",\n                \"creationTimestamp\": \"2021-10-13T00:49:21Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-dxjsp\",\n                \"uid\": \"535f2276-8f96-4caa-93fc-e6e525769bde\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"463\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/2 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate, 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:21Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:21Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-dxjsp.16ad70b72108b42c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b5835815-d141-4044-b88c-9e940e428b36\",\n                \"resourceVersion\": \"172\",\n                \"creationTimestamp\": \"2021-10-13T00:49:31Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-dxjsp\",\n                \"uid\": \"535f2276-8f96-4caa-93fc-e6e525769bde\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"605\"\n            },\n            \"reason\": \"FailedScheduling\",\n            \"message\": \"0/4 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate, 3 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:31Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:31Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-dxjsp.16ad70b9b08e685f\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"25a677d9-0e68-4da3-993f-1ce1c380b867\",\n                \"resourceVersion\": \"252\",\n                \"creationTimestamp\": \"2021-10-13T00:49:42Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-dxjsp\",\n                \"uid\": \"535f2276-8f96-4caa-93fc-e6e525769bde\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"662\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/coredns-autoscaler-84d4cfd89c-dxjsp to ip-172-20-55-159.ap-southeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:42Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:42Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-dxjsp.16ad70b9b19b494b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c2373689-0f55-422e-b015-c1bb1c21a1bd\",\n                \"resourceVersion\": \"254\",\n                \"creationTimestamp\": \"2021-10-13T00:49:42Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-dxjsp\"\n            },\n            \"reason\": \"TaintManagerEviction\",\n            \"message\": \"Cancelling deletion of Pod kube-system/coredns-autoscaler-84d4cfd89c-dxjsp\",\n            \"source\": {\n                \"component\": \"taint-controller\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:42Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:42Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-dxjsp.16ad70b9f16a79d8\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"60705d4d-7211-489f-91e5-eeef1188c534\",\n                \"resourceVersion\": \"256\",\n                \"creationTimestamp\": \"2021-10-13T00:49:43Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-dxjsp\",\n                \"uid\": \"535f2276-8f96-4caa-93fc-e6e525769bde\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"721\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:43Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:43Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-dxjsp.16ad70baab0656c7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"605cfc0d-f0c7-4f8f-8104-a82a0fe4b894\",\n                \"resourceVersion\": \"260\",\n                \"creationTimestamp\": \"2021-10-13T00:49:46Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-dxjsp\",\n                \"uid\": \"535f2276-8f96-4caa-93fc-e6e525769bde\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"721\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\\\" in 3.113988015s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:46Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:46Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-dxjsp.16ad70bab2e3e7b1\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b8af8e33-abe1-4e9d-8bd2-f2d0f2792298\",\n                \"resourceVersion\": \"261\",\n                \"creationTimestamp\": \"2021-10-13T00:49:46Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-dxjsp\",\n                \"uid\": \"535f2276-8f96-4caa-93fc-e6e525769bde\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"721\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container autoscaler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:46Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:46Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-dxjsp.16ad70bab8964e5a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f1a7d2c5-76d6-41b0-9e15-8de1afe26e25\",\n                \"resourceVersion\": \"262\",\n                \"creationTimestamp\": \"2021-10-13T00:49:47Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c-dxjsp\",\n                \"uid\": \"535f2276-8f96-4caa-93fc-e6e525769bde\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"721\",\n                \"fieldPath\": \"spec.containers{autoscaler}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container autoscaler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:47Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:47Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c.16ad70a99514a004\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"445789c8-2e04-4d93-9f0e-5abdd913c192\",\n                \"resourceVersion\": \"72\",\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler-84d4cfd89c\",\n                \"uid\": \"1b6f2bb6-b305-4e71-aa87-58c7994966e9\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"445\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: coredns-autoscaler-84d4cfd89c-dxjsp\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler.16ad70a98cf67cde\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"70be43e1-8ebf-4934-a070-1ff2b577abfd\",\n                \"resourceVersion\": \"64\",\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns-autoscaler\",\n                \"uid\": \"efff0f19-3a62-4c61-a00d-49467e84f063\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"235\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set coredns-autoscaler-84d4cfd89c to 1\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns.16ad70a98c2ad27d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"feac259f-fd3d-4628-8539-9a4643805def\",\n                \"resourceVersion\": \"62\",\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns\",\n                \"uid\": \"dc75094e-453d-4cff-8b98-ed8a89d8fcc2\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"228\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set coredns-6c8944dbdc to 1\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns.16ad70bac7fd09d7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b7e4b7ba-2ff7-4c62-9603-f8b62a07cb26\",\n                \"resourceVersion\": \"263\",\n                \"creationTimestamp\": \"2021-10-13T00:49:47Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"coredns\",\n                \"uid\": \"dc75094e-453d-4cff-8b98-ed8a89d8fcc2\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"752\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set coredns-6c8944dbdc to 2\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:47Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:47Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-5779cbc678-c2kgq.16ad70a995e97821\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"0034b897-4d08-42ac-a256-23558338eba5\",\n                \"resourceVersion\": \"71\",\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-5779cbc678-c2kgq\",\n                \"uid\": \"746dc697-c042-4bc7-b8e8-a293206f5893\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"455\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/dns-controller-5779cbc678-c2kgq to ip-172-20-60-219.ap-southeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-5779cbc678-c2kgq.16ad70a9d52d0c13\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"0e97affa-360b-4766-9393-1a31cffccf82\",\n                \"resourceVersion\": \"76\",\n                \"creationTimestamp\": \"2021-10-13T00:48:34Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-5779cbc678-c2kgq\",\n                \"uid\": \"746dc697-c042-4bc7-b8e8-a293206f5893\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"464\",\n                \"fieldPath\": \"spec.containers{dns-controller}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kops/dns-controller:1.23.0-alpha.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:34Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:34Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-5779cbc678-c2kgq.16ad70a9db53d282\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fc1354e6-8a23-403a-8640-0a8483a0eace\",\n                \"resourceVersion\": \"81\",\n                \"creationTimestamp\": \"2021-10-13T00:48:34Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-5779cbc678-c2kgq\",\n                \"uid\": \"746dc697-c042-4bc7-b8e8-a293206f5893\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"464\",\n                \"fieldPath\": \"spec.containers{dns-controller}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container dns-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:34Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:34Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-5779cbc678-c2kgq.16ad70a9e261e396\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"219258a3-8899-4b03-af0a-d9116dbf96ca\",\n                \"resourceVersion\": \"82\",\n                \"creationTimestamp\": \"2021-10-13T00:48:34Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-5779cbc678-c2kgq\",\n                \"uid\": \"746dc697-c042-4bc7-b8e8-a293206f5893\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"464\",\n                \"fieldPath\": \"spec.containers{dns-controller}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container dns-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:34Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:34Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-5779cbc678.16ad70a9951470e8\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4b10cea3-b320-429e-8210-f1ac31b24be5\",\n                \"resourceVersion\": \"70\",\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ReplicaSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller-5779cbc678\",\n                \"uid\": \"ab84625a-375e-45fa-8436-f5395e2d6162\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"444\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: dns-controller-5779cbc678-c2kgq\",\n            \"source\": {\n                \"component\": \"replicaset-controller\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller.16ad70a98cd2e12c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d1e45143-4719-4c45-b932-9f2bebcc63e4\",\n                \"resourceVersion\": \"63\",\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Deployment\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"dns-controller\",\n                \"uid\": \"4106ff70-89e8-445d-942b-cd12bfad97ae\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"241\"\n            },\n            \"reason\": \"ScalingReplicaSet\",\n            \"message\": \"Scaled up replica set dns-controller-5779cbc678 to 1\",\n            \"source\": {\n                \"component\": \"deployment-controller\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad709969c4afd9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5314e7e8-062f-4ffb-bc3f-63e9e65401b0\",\n                \"resourceVersion\": \"22\",\n                \"creationTimestamp\": \"2021-10-13T00:48:05Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"a3538887f7503b0fab3e30a9abaff78c\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/etcdadm/etcd-manager:3.0.20211007\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:24Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:24Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad709b7dfef00e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8b3f4d36-10ba-4faa-9fce-cb0b3b52b2ea\",\n                \"resourceVersion\": \"37\",\n                \"creationTimestamp\": \"2021-10-13T00:48:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"a3538887f7503b0fab3e30a9abaff78c\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/etcdadm/etcd-manager:3.0.20211007\\\" in 8.929284143s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:32Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:32Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad709bb178c7c5\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e3b553ac-e6a2-4b2c-9387-ca1689d05a6f\",\n                \"resourceVersion\": \"38\",\n                \"creationTimestamp\": \"2021-10-13T00:48:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"a3538887f7503b0fab3e30a9abaff78c\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:33Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad709bb9fcb964\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"115fbb63-54c7-4cb3-9914-85f454de917b\",\n                \"resourceVersion\": \"41\",\n                \"creationTimestamp\": \"2021-10-13T00:48:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-events-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"a3538887f7503b0fab3e30a9abaff78c\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:33Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad70995f042980\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7163d336-c274-45be-8cfe-f96baa230c52\",\n                \"resourceVersion\": \"19\",\n                \"creationTimestamp\": \"2021-10-13T00:48:04Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"d2521ffb3d7f9e8ee9d3afb13576f381\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"k8s.gcr.io/etcdadm/etcd-manager:3.0.20211007\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:23Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:23Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad709b57ae4a89\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"92bdc2b5-fd14-4c18-a621-a41b5a15d9d2\",\n                \"resourceVersion\": \"36\",\n                \"creationTimestamp\": \"2021-10-13T00:48:07Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"d2521ffb3d7f9e8ee9d3afb13576f381\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"k8s.gcr.io/etcdadm/etcd-manager:3.0.20211007\\\" in 8.466853521s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:32Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:32Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad709bb1b0e370\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"faf510ce-efd3-4047-927c-a12f00bdf91a\",\n                \"resourceVersion\": \"39\",\n                \"creationTimestamp\": \"2021-10-13T00:48:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"d2521ffb3d7f9e8ee9d3afb13576f381\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:33Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad709bb96ca893\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f14ce544-ba22-4a64-b97b-42012266ca30\",\n                \"resourceVersion\": \"40\",\n                \"creationTimestamp\": \"2021-10-13T00:48:08Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"etcd-manager-main-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"d2521ffb3d7f9e8ee9d3afb13576f381\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{etcd-manager}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container etcd-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:33Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-2pzlm.16ad70a989b4687e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"86016db5-cfc7-4632-8b95-1e77a4647e20\",\n                \"resourceVersion\": \"61\",\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-2pzlm\",\n                \"uid\": \"97ee37a4-69d1-4e7b-a37b-23d4db656072\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"435\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kops-controller-2pzlm to ip-172-20-60-219.ap-southeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-2pzlm.16ad70a9cd4bdda7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"81adcc17-e06c-4789-894a-eb1dcc2c9bfd\",\n                \"resourceVersion\": \"77\",\n                \"creationTimestamp\": \"2021-10-13T00:48:34Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-2pzlm\",\n                \"uid\": \"97ee37a4-69d1-4e7b-a37b-23d4db656072\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"439\",\n                \"fieldPath\": \"spec.containers{kops-controller}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kops/kops-controller:1.23.0-alpha.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:34Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:34Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-2pzlm.16ad70a9cd4c7a9e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2a3f2813-7674-4009-aeff-62deeffb1ec4\",\n                \"resourceVersion\": \"75\",\n                \"creationTimestamp\": \"2021-10-13T00:48:34Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-2pzlm\",\n                \"uid\": \"97ee37a4-69d1-4e7b-a37b-23d4db656072\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"439\",\n                \"fieldPath\": \"spec.containers{kops-controller}\"\n            },\n            \"reason\": \"Failed\",\n            \"message\": \"Error: services have not yet been read at least once, cannot construct envvars\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:34Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:34Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-2pzlm.16ad70a9dafc7424\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fe9d29b9-f26b-402c-98ed-c6f142cd37ad\",\n                \"resourceVersion\": \"80\",\n                \"creationTimestamp\": \"2021-10-13T00:48:34Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-2pzlm\",\n                \"uid\": \"97ee37a4-69d1-4e7b-a37b-23d4db656072\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"439\",\n                \"fieldPath\": \"spec.containers{kops-controller}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kops-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:34Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:34Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-2pzlm.16ad70a9e2b0c7d3\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"aa23f920-e8a9-44e6-8483-251511c4b171\",\n                \"resourceVersion\": \"83\",\n                \"creationTimestamp\": \"2021-10-13T00:48:34Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-2pzlm\",\n                \"uid\": \"97ee37a4-69d1-4e7b-a37b-23d4db656072\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"439\",\n                \"fieldPath\": \"spec.containers{kops-controller}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kops-controller\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:34Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:34Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller-leader.16ad70aa150d11f0\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"961fb1e9-5eaf-4c10-9e37-d9cf8c9f4de2\",\n                \"resourceVersion\": \"84\",\n                \"creationTimestamp\": \"2021-10-13T00:48:35Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"ConfigMap\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller-leader\",\n                \"uid\": \"e9ba951c-2234-4877-ad96-ca9130e86c92\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"480\"\n            },\n            \"reason\": \"LeaderElection\",\n            \"message\": \"ip-172-20-60-219_27e9a311-1a2d-4b93-94e6-84a9587fbf6b became leader\",\n            \"source\": {\n                \"component\": \"ip-172-20-60-219_27e9a311-1a2d-4b93-94e6-84a9587fbf6b\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:35Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:35Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller.16ad70a9887f6009\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"aa073dc7-968c-403b-a976-914c1ee0193d\",\n                \"resourceVersion\": \"58\",\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kops-controller\",\n                \"uid\": \"27ec6329-6c0e-4b6e-ae98-9a8202e1ad54\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"261\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kops-controller-2pzlm\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad7099934d2046\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"67087723-160c-44f8-8702-ed8eb429941f\",\n                \"resourceVersion\": \"45\",\n                \"creationTimestamp\": \"2021-10-13T00:48:05Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"08f381bd3f8ae58ab2907673ffc6d62e\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-apiserver}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-apiserver-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:24Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:46Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad709997a89bb2\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"04c41a20-d92d-498b-8994-701a2f955a30\",\n                \"resourceVersion\": \"46\",\n                \"creationTimestamp\": \"2021-10-13T00:48:06Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"08f381bd3f8ae58ab2907673ffc6d62e\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-apiserver}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-apiserver\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:24Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:46Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad7099a228cb0e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a291c416-45fb-417c-801f-86ed0c9dea13\",\n                \"resourceVersion\": \"47\",\n                \"creationTimestamp\": \"2021-10-13T00:48:06Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"08f381bd3f8ae58ab2907673ffc6d62e\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-apiserver}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-apiserver\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:24Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:46Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad7099a28760e9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"36b15a11-13a1-4c35-be4f-a531cec2aea5\",\n                \"resourceVersion\": \"32\",\n                \"creationTimestamp\": \"2021-10-13T00:48:07Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"08f381bd3f8ae58ab2907673ffc6d62e\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{healthcheck}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kops/kube-apiserver-healthcheck:1.23.0-alpha.1\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:24Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:24Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad7099a949d089\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8bfb509c-eebd-468e-990b-dcb6beaab2db\",\n                \"resourceVersion\": \"34\",\n                \"creationTimestamp\": \"2021-10-13T00:48:07Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"08f381bd3f8ae58ab2907673ffc6d62e\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{healthcheck}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container healthcheck\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:25Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:25Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-apiserver-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad7099b426bc78\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d6560380-69cd-4ddc-9b9f-1f186472e2ee\",\n                \"resourceVersion\": \"35\",\n                \"creationTimestamp\": \"2021-10-13T00:48:07Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-apiserver-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"08f381bd3f8ae58ab2907673ffc6d62e\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{healthcheck}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container healthcheck\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:25Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:25Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad709997fda911\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"414490fb-6d09-42e0-999d-0d9dcd56223c\",\n                \"resourceVersion\": \"53\",\n                \"creationTimestamp\": \"2021-10-13T00:48:06Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"f876ee1044aaa860c02a7acb02fc5536\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-controller-manager-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:24Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:17Z\",\n            \"count\": 3,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad70999c56477d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"458eded9-5ec3-4a17-bd50-3ad9ce4daf01\",\n                \"resourceVersion\": \"54\",\n                \"creationTimestamp\": \"2021-10-13T00:48:06Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"f876ee1044aaa860c02a7acb02fc5536\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-controller-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:24Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:17Z\",\n            \"count\": 3,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad7099a5d6a115\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5476510d-c961-45be-8a50-ce7b259afb97\",\n                \"resourceVersion\": \"55\",\n                \"creationTimestamp\": \"2021-10-13T00:48:07Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"f876ee1044aaa860c02a7acb02fc5536\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-controller-manager\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:25Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:17Z\",\n            \"count\": 3,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad70a113f296c3\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f7ee48a7-3ff5-4474-9d8c-32bf28fce0d3\",\n                \"resourceVersion\": \"49\",\n                \"creationTimestamp\": \"2021-10-13T00:48:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"f876ee1044aaa860c02a7acb02fc5536\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"Unhealthy\",\n            \"message\": \"Liveness probe failed: Get \\\"https://127.0.0.1:10257/healthz\\\": read tcp 127.0.0.1:56540-\\u003e127.0.0.1:10257: read: connection reset by peer\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:56Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:56Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad70a12a321878\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7561be28-17dc-4b75-bd8b-217c5c25a26d\",\n                \"resourceVersion\": \"52\",\n                \"creationTimestamp\": \"2021-10-13T00:48:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"f876ee1044aaa860c02a7acb02fc5536\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-controller-manager}\"\n            },\n            \"reason\": \"BackOff\",\n            \"message\": \"Back-off restarting failed container\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:57Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:03Z\",\n            \"count\": 3,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-controller-manager.16ad70a60898e2f4\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2abb4d97-66f4-45ae-87e3-44803affdc31\",\n                \"resourceVersion\": \"56\",\n                \"creationTimestamp\": \"2021-10-13T00:48:18Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Lease\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-controller-manager\",\n                \"uid\": \"df078914-fa91-4ba7-920f-ffb56e9418b5\",\n                \"apiVersion\": \"coordination.k8s.io/v1\",\n                \"resourceVersion\": \"279\"\n            },\n            \"reason\": \"LeaderElection\",\n            \"message\": \"ip-172-20-60-219_a9fbf370-9873-4486-abcd-4f6e5cf6ddfe became leader\",\n            \"source\": {\n                \"component\": \"kube-controller-manager\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:18Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:18Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-dns.16ad70a96a043cdd\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"13bdf953-83e7-4980-a4d6-13f39b6c3625\",\n                \"resourceVersion\": \"66\",\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"PodDisruptionBudget\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-dns\",\n                \"uid\": \"c2209900-58fa-4dff-b36f-3c8a420df716\",\n                \"apiVersion\": \"policy/v1\",\n                \"resourceVersion\": \"231\"\n            },\n            \"reason\": \"NoPods\",\n            \"message\": \"No matching pods found\",\n            \"source\": {\n                \"component\": \"controllermanager\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:32Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"count\": 2,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-78xlx.16ad70b80226e77e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e6054451-60f4-4a8b-bb04-b65ce02b3ea1\",\n                \"resourceVersion\": \"184\",\n                \"creationTimestamp\": \"2021-10-13T00:49:35Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-78xlx\",\n                \"uid\": \"9c3a8199-10b9-4f26-bea2-74666ce3cd2c\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"674\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kube-flannel-ds-78xlx to ip-172-20-43-74.ap-southeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:35Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:35Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-78xlx.16ad70b89637ba3c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"b8b17071-7b96-4eb0-a3a8-ed6cac8e4b37\",\n                \"resourceVersion\": \"238\",\n                \"creationTimestamp\": \"2021-10-13T00:49:40Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-78xlx\",\n                \"uid\": \"9c3a8199-10b9-4f26-bea2-74666ce3cd2c\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"676\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"quay.io/coreos/flannel:v0.13.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-74.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:37Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:37Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-78xlx.16ad70bb9c4b0273\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4ec1cfd0-8769-45df-a95c-77a64f730c37\",\n                \"resourceVersion\": \"270\",\n                \"creationTimestamp\": \"2021-10-13T00:49:50Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-78xlx\",\n                \"uid\": \"9c3a8199-10b9-4f26-bea2-74666ce3cd2c\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"676\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"quay.io/coreos/flannel:v0.13.0\\\" in 12.9868142s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-74.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:50Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:50Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-78xlx.16ad70bba483c25e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"43d844cf-4662-4216-8359-b4fd0126207e\",\n                \"resourceVersion\": \"271\",\n                \"creationTimestamp\": \"2021-10-13T00:49:51Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-78xlx\",\n                \"uid\": \"9c3a8199-10b9-4f26-bea2-74666ce3cd2c\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"676\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-74.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:51Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:51Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-78xlx.16ad70bbab944bea\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3e1409ba-73a0-425e-ab48-4b7c63e5f634\",\n                \"resourceVersion\": \"272\",\n                \"creationTimestamp\": \"2021-10-13T00:49:51Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-78xlx\",\n                \"uid\": \"9c3a8199-10b9-4f26-bea2-74666ce3cd2c\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"676\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-74.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:51Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:51Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-78xlx.16ad70bbbda76055\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"8ea91e55-98d8-4506-8cb0-29fbb1bad833\",\n                \"resourceVersion\": \"273\",\n                \"creationTimestamp\": \"2021-10-13T00:49:51Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-78xlx\",\n                \"uid\": \"9c3a8199-10b9-4f26-bea2-74666ce3cd2c\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"676\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"quay.io/coreos/flannel:v0.13.0\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-74.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:51Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:51Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-78xlx.16ad70bbbfe5d0f9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"70f9069d-1d9c-4fb4-ae85-78fe83571ac1\",\n                \"resourceVersion\": \"274\",\n                \"creationTimestamp\": \"2021-10-13T00:49:51Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-78xlx\",\n                \"uid\": \"9c3a8199-10b9-4f26-bea2-74666ce3cd2c\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"676\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-74.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:51Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:51Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-78xlx.16ad70bbc666e2eb\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1cda51d6-e460-421c-948a-b84f5a7b76fe\",\n                \"resourceVersion\": \"275\",\n                \"creationTimestamp\": \"2021-10-13T00:49:51Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-78xlx\",\n                \"uid\": \"9c3a8199-10b9-4f26-bea2-74666ce3cd2c\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"676\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-74.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:51Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:51Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-dxnsw.16ad70b613cd47f4\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"159a9383-90ff-48e5-8cb6-411c3fe5edf0\",\n                \"resourceVersion\": \"152\",\n                \"creationTimestamp\": \"2021-10-13T00:49:27Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-dxnsw\",\n                \"uid\": \"61a731c7-b72f-47fe-bf5d-49e252e58f4a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"641\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kube-flannel-ds-dxnsw to ip-172-20-37-188.ap-southeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:27Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:27Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-dxnsw.16ad70b665aef421\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"e94ddecf-5b07-40ff-9ae3-4e9df2e0b28d\",\n                \"resourceVersion\": \"229\",\n                \"creationTimestamp\": \"2021-10-13T00:49:39Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-dxnsw\",\n                \"uid\": \"61a731c7-b72f-47fe-bf5d-49e252e58f4a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"642\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"quay.io/coreos/flannel:v0.13.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:28Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:28Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-dxnsw.16ad70b976d9423c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"bfef32a9-1d3f-4878-a713-f4982f468bf3\",\n                \"resourceVersion\": \"246\",\n                \"creationTimestamp\": \"2021-10-13T00:49:41Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-dxnsw\",\n                \"uid\": \"61a731c7-b72f-47fe-bf5d-49e252e58f4a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"642\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"quay.io/coreos/flannel:v0.13.0\\\" in 13.172855136s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:41Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:41Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-dxnsw.16ad70b97fe6f14a\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"eebb9196-da07-4007-9289-77d467ebb4ad\",\n                \"resourceVersion\": \"247\",\n                \"creationTimestamp\": \"2021-10-13T00:49:41Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-dxnsw\",\n                \"uid\": \"61a731c7-b72f-47fe-bf5d-49e252e58f4a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"642\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:41Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:41Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-dxnsw.16ad70b987785573\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1e88edf7-2473-4565-9605-fec763e41411\",\n                \"resourceVersion\": \"248\",\n                \"creationTimestamp\": \"2021-10-13T00:49:41Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-dxnsw\",\n                \"uid\": \"61a731c7-b72f-47fe-bf5d-49e252e58f4a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"642\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:41Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:41Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-dxnsw.16ad70b9ac4fbf37\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"93790162-8404-42c7-984c-6d6a4f8eb55c\",\n                \"resourceVersion\": \"249\",\n                \"creationTimestamp\": \"2021-10-13T00:49:42Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-dxnsw\",\n                \"uid\": \"61a731c7-b72f-47fe-bf5d-49e252e58f4a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"642\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"quay.io/coreos/flannel:v0.13.0\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:42Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:42Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-dxnsw.16ad70b9aea5ffea\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"9b8d4b02-e783-46a2-ba4e-51758108897b\",\n                \"resourceVersion\": \"251\",\n                \"creationTimestamp\": \"2021-10-13T00:49:42Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-dxnsw\",\n                \"uid\": \"61a731c7-b72f-47fe-bf5d-49e252e58f4a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"642\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:42Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:42Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-dxnsw.16ad70b9b41ea9df\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5c97d2a8-e92d-4bd9-82ad-40c787347bfd\",\n                \"resourceVersion\": \"255\",\n                \"creationTimestamp\": \"2021-10-13T00:49:42Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-dxnsw\",\n                \"uid\": \"61a731c7-b72f-47fe-bf5d-49e252e58f4a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"642\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:42Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:42Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-fd845.16ad70a989ac61c8\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d866ca5c-b8c5-44ab-afa0-d9e8c68140b1\",\n                \"resourceVersion\": \"60\",\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-fd845\",\n                \"uid\": \"6f1ce97e-121f-4d90-83fb-79a4bfe04fb9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"436\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kube-flannel-ds-fd845 to ip-172-20-60-219.ap-southeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-fd845.16ad70a9cbbb2caf\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d816c0f7-24be-4805-bfde-1f53b36891d4\",\n                \"resourceVersion\": \"73\",\n                \"creationTimestamp\": \"2021-10-13T00:48:34Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-fd845\",\n                \"uid\": \"6f1ce97e-121f-4d90-83fb-79a4bfe04fb9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"440\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"quay.io/coreos/flannel:v0.13.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:34Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:34Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-fd845.16ad70acc8579278\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"53384a14-e712-43af-8763-1bd0306bc3df\",\n                \"resourceVersion\": \"87\",\n                \"creationTimestamp\": \"2021-10-13T00:48:47Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-fd845\",\n                \"uid\": \"6f1ce97e-121f-4d90-83fb-79a4bfe04fb9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"440\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"quay.io/coreos/flannel:v0.13.0\\\" in 12.828029727s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:47Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:47Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-fd845.16ad70acdcfe1a25\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"608b4d53-8c1d-4b49-8773-d8e15a9018ea\",\n                \"resourceVersion\": \"88\",\n                \"creationTimestamp\": \"2021-10-13T00:48:47Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-fd845\",\n                \"uid\": \"6f1ce97e-121f-4d90-83fb-79a4bfe04fb9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"440\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:47Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:47Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-fd845.16ad70ace8b3d112\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"2218db64-666b-4d96-94ff-cccb02af8472\",\n                \"resourceVersion\": \"89\",\n                \"creationTimestamp\": \"2021-10-13T00:48:47Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-fd845\",\n                \"uid\": \"6f1ce97e-121f-4d90-83fb-79a4bfe04fb9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"440\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:47Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:47Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-fd845.16ad70ad22e43c16\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5c85b1ea-d628-4684-b32f-6f25b614688e\",\n                \"resourceVersion\": \"90\",\n                \"creationTimestamp\": \"2021-10-13T00:48:48Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-fd845\",\n                \"uid\": \"6f1ce97e-121f-4d90-83fb-79a4bfe04fb9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"440\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"quay.io/coreos/flannel:v0.13.0\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:48Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:48Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-fd845.16ad70ad25964da9\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3517fcf5-e5dc-447a-9d83-924ef420a18e\",\n                \"resourceVersion\": \"91\",\n                \"creationTimestamp\": \"2021-10-13T00:48:48Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-fd845\",\n                \"uid\": \"6f1ce97e-121f-4d90-83fb-79a4bfe04fb9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"440\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:48Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:48Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-fd845.16ad70ad2d3cb0bd\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fddf5144-d1b5-4244-838a-74e8993ba0e4\",\n                \"resourceVersion\": \"92\",\n                \"creationTimestamp\": \"2021-10-13T00:48:48Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-fd845\",\n                \"uid\": \"6f1ce97e-121f-4d90-83fb-79a4bfe04fb9\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"440\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:48Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:48Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-qp2bm.16ad70b5ba813dc2\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"46f8788c-7c43-45bd-9e08-f0c090498add\",\n                \"resourceVersion\": \"127\",\n                \"creationTimestamp\": \"2021-10-13T00:49:25Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-qp2bm\",\n                \"uid\": \"3c76c527-5c2e-4f4d-8f89-2eb9fe1cc40a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"625\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kube-flannel-ds-qp2bm to ip-172-20-48-187.ap-southeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:25Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:25Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-qp2bm.16ad70b655b4667d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"361d9dca-7cf9-4d3a-9cf1-544f957f8cd6\",\n                \"resourceVersion\": \"169\",\n                \"creationTimestamp\": \"2021-10-13T00:49:29Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-qp2bm\",\n                \"uid\": \"3c76c527-5c2e-4f4d-8f89-2eb9fe1cc40a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"628\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"quay.io/coreos/flannel:v0.13.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-187.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:28Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:28Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-qp2bm.16ad70b948debc21\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5f88fb7e-4b45-4209-8dac-bb6eb7b8595d\",\n                \"resourceVersion\": \"239\",\n                \"creationTimestamp\": \"2021-10-13T00:49:40Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-qp2bm\",\n                \"uid\": \"3c76c527-5c2e-4f4d-8f89-2eb9fe1cc40a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"628\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"quay.io/coreos/flannel:v0.13.0\\\" in 12.669558799s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-187.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:40Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:40Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-qp2bm.16ad70b9513429d0\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"993d5cff-2153-4e53-a58f-6170b4026965\",\n                \"resourceVersion\": \"240\",\n                \"creationTimestamp\": \"2021-10-13T00:49:41Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-qp2bm\",\n                \"uid\": \"3c76c527-5c2e-4f4d-8f89-2eb9fe1cc40a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"628\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-187.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:41Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:41Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-qp2bm.16ad70b95a6f2d9b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"0e90b830-75c2-4a84-a2df-65f8475bba52\",\n                \"resourceVersion\": \"241\",\n                \"creationTimestamp\": \"2021-10-13T00:49:41Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-qp2bm\",\n                \"uid\": \"3c76c527-5c2e-4f4d-8f89-2eb9fe1cc40a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"628\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-187.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:41Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:41Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-qp2bm.16ad70b95ff34543\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6dfb15ae-c262-48db-b9e8-68ef51d2e5b3\",\n                \"resourceVersion\": \"242\",\n                \"creationTimestamp\": \"2021-10-13T00:49:41Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-qp2bm\",\n                \"uid\": \"3c76c527-5c2e-4f4d-8f89-2eb9fe1cc40a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"628\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"quay.io/coreos/flannel:v0.13.0\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-187.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:41Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:41Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-qp2bm.16ad70b9625e54f7\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3a679ddc-c9d2-40fa-933e-925755159bba\",\n                \"resourceVersion\": \"243\",\n                \"creationTimestamp\": \"2021-10-13T00:49:41Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-qp2bm\",\n                \"uid\": \"3c76c527-5c2e-4f4d-8f89-2eb9fe1cc40a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"628\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-187.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:41Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:41Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-qp2bm.16ad70b968ed72ea\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"83ae2d3b-7157-4348-a08f-447c8b1aea9f\",\n                \"resourceVersion\": \"244\",\n                \"creationTimestamp\": \"2021-10-13T00:49:41Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-qp2bm\",\n                \"uid\": \"3c76c527-5c2e-4f4d-8f89-2eb9fe1cc40a\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"628\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-187.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:41Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:41Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-wn9rb.16ad70b4b2b7e726\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"449852d0-81a1-4f69-a552-de06fff1f3a7\",\n                \"resourceVersion\": \"102\",\n                \"creationTimestamp\": \"2021-10-13T00:49:21Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-wn9rb\",\n                \"uid\": \"59637c98-c904-40f5-8c8f-489b63ba3e48\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"606\"\n            },\n            \"reason\": \"Scheduled\",\n            \"message\": \"Successfully assigned kube-system/kube-flannel-ds-wn9rb to ip-172-20-55-159.ap-southeast-1.compute.internal\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:21Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:21Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-wn9rb.16ad70b53d2f089e\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6377f8e0-72a7-43c0-b915-8fac716fc90a\",\n                \"resourceVersion\": \"153\",\n                \"creationTimestamp\": \"2021-10-13T00:49:27Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-wn9rb\",\n                \"uid\": \"59637c98-c904-40f5-8c8f-489b63ba3e48\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"608\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulling\",\n            \"message\": \"Pulling image \\\"quay.io/coreos/flannel:v0.13.0\\\"\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:23Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:23Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-wn9rb.16ad70b817d78ae8\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"cf01e1ea-9b5e-417e-b422-52d7926b3cbb\",\n                \"resourceVersion\": \"187\",\n                \"creationTimestamp\": \"2021-10-13T00:49:35Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-wn9rb\",\n                \"uid\": \"59637c98-c904-40f5-8c8f-489b63ba3e48\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"608\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Successfully pulled image \\\"quay.io/coreos/flannel:v0.13.0\\\" in 12.258401337s\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:35Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:35Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-wn9rb.16ad70b82114542b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"037020ea-0838-44d8-a547-1474960f6d51\",\n                \"resourceVersion\": \"188\",\n                \"creationTimestamp\": \"2021-10-13T00:49:35Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-wn9rb\",\n                \"uid\": \"59637c98-c904-40f5-8c8f-489b63ba3e48\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"608\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:35Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:35Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-wn9rb.16ad70b8290722fb\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"98bc317b-7717-4f18-8acb-5c19fc8b0e8b\",\n                \"resourceVersion\": \"190\",\n                \"creationTimestamp\": \"2021-10-13T00:49:36Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-wn9rb\",\n                \"uid\": \"59637c98-c904-40f5-8c8f-489b63ba3e48\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"608\",\n                \"fieldPath\": \"spec.initContainers{install-cni}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container install-cni\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:36Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:36Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-wn9rb.16ad70b846542bba\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c0205453-b2e4-4970-8eb0-79c296870787\",\n                \"resourceVersion\": \"194\",\n                \"creationTimestamp\": \"2021-10-13T00:49:36Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-wn9rb\",\n                \"uid\": \"59637c98-c904-40f5-8c8f-489b63ba3e48\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"608\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"quay.io/coreos/flannel:v0.13.0\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:36Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:36Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-wn9rb.16ad70b848fb246f\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"50365c54-25c6-4496-b6d8-3314e90a5635\",\n                \"resourceVersion\": \"195\",\n                \"creationTimestamp\": \"2021-10-13T00:49:36Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-wn9rb\",\n                \"uid\": \"59637c98-c904-40f5-8c8f-489b63ba3e48\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"608\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:36Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:36Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds-wn9rb.16ad70b84eaf9c22\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5d75d7bf-87c8-4ddf-b965-d5eab40fca6f\",\n                \"resourceVersion\": \"196\",\n                \"creationTimestamp\": \"2021-10-13T00:49:36Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds-wn9rb\",\n                \"uid\": \"59637c98-c904-40f5-8c8f-489b63ba3e48\",\n                \"apiVersion\": \"v1\",\n                \"resourceVersion\": \"608\",\n                \"fieldPath\": \"spec.containers{kube-flannel}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-flannel\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:36Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:36Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds.16ad70a988beb000\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3da9bc98-12d3-4018-b3c0-3aa0e55ac693\",\n                \"resourceVersion\": \"59\",\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds\",\n                \"uid\": \"6a459f19-b155-444f-a6f7-8ba33cf96297\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"258\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kube-flannel-ds-fd845\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:33Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds.16ad70b4b245280f\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"76555269-5406-4bd8-a113-4dd43a5aa120\",\n                \"resourceVersion\": \"101\",\n                \"creationTimestamp\": \"2021-10-13T00:49:21Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds\",\n                \"uid\": \"6a459f19-b155-444f-a6f7-8ba33cf96297\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"523\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kube-flannel-ds-wn9rb\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:21Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:21Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds.16ad70b5b956c7c1\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"566e2a63-41ed-4ba1-889e-bc31dcf9d3cf\",\n                \"resourceVersion\": \"126\",\n                \"creationTimestamp\": \"2021-10-13T00:49:25Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds\",\n                \"uid\": \"6a459f19-b155-444f-a6f7-8ba33cf96297\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"607\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kube-flannel-ds-qp2bm\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:25Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:25Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds.16ad70b6135bc806\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"7c8c5c7c-aae7-47ed-b5ad-2b50ad7f0e21\",\n                \"resourceVersion\": \"151\",\n                \"creationTimestamp\": \"2021-10-13T00:49:27Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds\",\n                \"uid\": \"6a459f19-b155-444f-a6f7-8ba33cf96297\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"630\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kube-flannel-ds-dxnsw\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:27Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:27Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds.16ad70b801cbf50d\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"ab06a54d-e002-4c4a-ac29-15ebc04eae7b\",\n                \"resourceVersion\": \"183\",\n                \"creationTimestamp\": \"2021-10-13T00:49:35Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"DaemonSet\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-flannel-ds\",\n                \"uid\": \"6a459f19-b155-444f-a6f7-8ba33cf96297\",\n                \"apiVersion\": \"apps/v1\",\n                \"resourceVersion\": \"646\"\n            },\n            \"reason\": \"SuccessfulCreate\",\n            \"message\": \"Created pod: kube-flannel-ds-78xlx\",\n            \"source\": {\n                \"component\": \"daemonset-controller\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:35Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:35Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-37-188.ap-southeast-1.compute.internal.16ad70af898f9439\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a458fe18-628e-4c29-ab69-eab1579d6383\",\n                \"resourceVersion\": \"192\",\n                \"creationTimestamp\": \"2021-10-13T00:49:36Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-37-188.ap-southeast-1.compute.internal\",\n                \"uid\": \"7a286015bf3a237156e0efa82fd9ae6e\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-proxy-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:59Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:59Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-37-188.ap-southeast-1.compute.internal.16ad70af8d4c1ebe\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"a9eb90bf-7f8e-4d04-b300-c9d8ca66d761\",\n                \"resourceVersion\": \"199\",\n                \"creationTimestamp\": \"2021-10-13T00:49:37Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-37-188.ap-southeast-1.compute.internal\",\n                \"uid\": \"7a286015bf3a237156e0efa82fd9ae6e\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:59Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:59Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-37-188.ap-southeast-1.compute.internal.16ad70af94d0ab18\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fc0cbcd4-ac63-480b-bde8-bc753bd59c4e\",\n                \"resourceVersion\": \"200\",\n                \"creationTimestamp\": \"2021-10-13T00:49:37Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-37-188.ap-southeast-1.compute.internal\",\n                \"uid\": \"7a286015bf3a237156e0efa82fd9ae6e\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:59Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:59Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-43-74.ap-southeast-1.compute.internal.16ad70b18930b2da\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"94bde0d8-bf10-416f-95c0-d079acb6f083\",\n                \"resourceVersion\": \"221\",\n                \"creationTimestamp\": \"2021-10-13T00:49:38Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-43-74.ap-southeast-1.compute.internal\",\n                \"uid\": \"ccf4fbef4d73f178b3f7f63b9c972e80\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-proxy-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-74.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:07Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:07Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-43-74.ap-southeast-1.compute.internal.16ad70b18cd55dcb\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6094c241-f951-4b2c-8149-4194af772d02\",\n                \"resourceVersion\": \"223\",\n                \"creationTimestamp\": \"2021-10-13T00:49:38Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-43-74.ap-southeast-1.compute.internal\",\n                \"uid\": \"ccf4fbef4d73f178b3f7f63b9c972e80\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-74.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:07Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:07Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-43-74.ap-southeast-1.compute.internal.16ad70b195ca5471\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"5cb657f9-2df6-49f8-9d5f-e8f32c1cd854\",\n                \"resourceVersion\": \"225\",\n                \"creationTimestamp\": \"2021-10-13T00:49:38Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-43-74.ap-southeast-1.compute.internal\",\n                \"uid\": \"ccf4fbef4d73f178b3f7f63b9c972e80\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-43-74.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:49:07Z\",\n            \"lastTimestamp\": \"2021-10-13T00:49:07Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-48-187.ap-southeast-1.compute.internal.16ad70af308420e3\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"340bf38b-ba56-4737-b4b5-29844fc9bba1\",\n                \"resourceVersion\": \"148\",\n                \"creationTimestamp\": \"2021-10-13T00:49:26Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-48-187.ap-southeast-1.compute.internal\",\n                \"uid\": \"ad065fa6979186de42d12bae2334fda1\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-proxy-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-187.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:57Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:57Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-48-187.ap-southeast-1.compute.internal.16ad70af3496dd60\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"23886b36-128f-4251-a11e-2a3c95984285\",\n                \"resourceVersion\": \"156\",\n                \"creationTimestamp\": \"2021-10-13T00:49:27Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-48-187.ap-southeast-1.compute.internal\",\n                \"uid\": \"ad065fa6979186de42d12bae2334fda1\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-187.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:57Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:57Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-48-187.ap-southeast-1.compute.internal.16ad70af3ba9d273\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f1e2e974-fba4-40c8-a088-126bc813b494\",\n                \"resourceVersion\": \"159\",\n                \"creationTimestamp\": \"2021-10-13T00:49:27Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-48-187.ap-southeast-1.compute.internal\",\n                \"uid\": \"ad065fa6979186de42d12bae2334fda1\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-48-187.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:57Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:57Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-55-159.ap-southeast-1.compute.internal.16ad70ae2902b8cc\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"546c340d-e072-40f7-9cf8-f54a8898eb0e\",\n                \"resourceVersion\": \"118\",\n                \"creationTimestamp\": \"2021-10-13T00:49:24Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-55-159.ap-southeast-1.compute.internal\",\n                \"uid\": \"9c556ec192845fd65f50fe37a5b075e0\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-proxy-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:53Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:53Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-55-159.ap-southeast-1.compute.internal.16ad70ae2c08548c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"3a7dccac-1e60-4ef0-a101-c63e461e0b57\",\n                \"resourceVersion\": \"123\",\n                \"creationTimestamp\": \"2021-10-13T00:49:25Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-55-159.ap-southeast-1.compute.internal\",\n                \"uid\": \"9c556ec192845fd65f50fe37a5b075e0\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:53Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:53Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-55-159.ap-southeast-1.compute.internal.16ad70ae33598240\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"12be3be3-59ad-498c-80a4-b87088b3f888\",\n                \"resourceVersion\": \"124\",\n                \"creationTimestamp\": \"2021-10-13T00:49:25Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-55-159.ap-southeast-1.compute.internal\",\n                \"uid\": \"9c556ec192845fd65f50fe37a5b075e0\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:53Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:53Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad709960701b2f\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"bcc2c722-b7c3-42f7-96ea-5ae22c6ba744\",\n                \"resourceVersion\": \"20\",\n                \"creationTimestamp\": \"2021-10-13T00:48:04Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"30f68fdb478e75f0f5ae90814ac6ff29\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-proxy-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:23Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:23Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad7099666a2784\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"fd208966-1a68-4c00-88b2-ca552c20ad85\",\n                \"resourceVersion\": \"21\",\n                \"creationTimestamp\": \"2021-10-13T00:48:04Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"30f68fdb478e75f0f5ae90814ac6ff29\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:23Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:23Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-proxy-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad709978cc5976\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"893e89a6-5ced-42b0-b5ff-c7cef7aabfb1\",\n                \"resourceVersion\": \"23\",\n                \"creationTimestamp\": \"2021-10-13T00:48:05Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-proxy-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"30f68fdb478e75f0f5ae90814ac6ff29\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-proxy}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-proxy\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:24Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:24Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad70998fdc7dbc\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"990fb176-0850-4b60-bf09-78b4026d3ab7\",\n                \"resourceVersion\": \"24\",\n                \"creationTimestamp\": \"2021-10-13T00:48:05Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"91f404e574baa940e02ec0517077ee83\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-scheduler}\"\n            },\n            \"reason\": \"Pulled\",\n            \"message\": \"Container image \\\"k8s.gcr.io/kube-scheduler-amd64:v1.21.5\\\" already present on machine\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:24Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:24Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad709995486b33\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"79de0fa3-d9f6-4f91-81c3-6b970fdded47\",\n                \"resourceVersion\": \"26\",\n                \"creationTimestamp\": \"2021-10-13T00:48:05Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"91f404e574baa940e02ec0517077ee83\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-scheduler}\"\n            },\n            \"reason\": \"Created\",\n            \"message\": \"Created container kube-scheduler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:24Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:24Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad70999df9c632\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"c08e3e6b-e4d0-47d6-9bae-8032051b3076\",\n                \"resourceVersion\": \"30\",\n                \"creationTimestamp\": \"2021-10-13T00:48:06Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"91f404e574baa940e02ec0517077ee83\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-scheduler}\"\n            },\n            \"reason\": \"Started\",\n            \"message\": \"Started container kube-scheduler\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:24Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:24Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler-ip-172-20-60-219.ap-southeast-1.compute.internal.16ad70a103b8ad6b\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1b7c7d76-64e6-4855-aa6a-d039f7ef04d9\",\n                \"resourceVersion\": \"48\",\n                \"creationTimestamp\": \"2021-10-13T00:48:10Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Pod\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"uid\": \"91f404e574baa940e02ec0517077ee83\",\n                \"apiVersion\": \"v1\",\n                \"fieldPath\": \"spec.containers{kube-scheduler}\"\n            },\n            \"reason\": \"Unhealthy\",\n            \"message\": \"Liveness probe failed: Get \\\"http://127.0.0.1:10251/healthz\\\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)\",\n            \"source\": {\n                \"component\": \"kubelet\",\n                \"host\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:47:56Z\",\n            \"lastTimestamp\": \"2021-10-13T00:47:56Z\",\n            \"count\": 1,\n            \"type\": \"Warning\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-scheduler.16ad70a29fb48fb3\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"15d60b67-61a7-4081-8b71-921d46db0d09\",\n                \"resourceVersion\": \"14\",\n                \"creationTimestamp\": \"2021-10-13T00:48:03Z\"\n            },\n            \"involvedObject\": {\n                \"kind\": \"Lease\",\n                \"namespace\": \"kube-system\",\n                \"name\": \"kube-scheduler\",\n                \"uid\": \"71e0ed91-1b0b-4e17-b90e-afe904c36509\",\n                \"apiVersion\": \"coordination.k8s.io/v1\",\n                \"resourceVersion\": \"222\"\n            },\n            \"reason\": \"LeaderElection\",\n            \"message\": \"ip-172-20-60-219_e5a319dd-9063-414c-9253-b0d6237e1632 became leader\",\n            \"source\": {\n                \"component\": \"default-scheduler\"\n            },\n            \"firstTimestamp\": \"2021-10-13T00:48:03Z\",\n            \"lastTimestamp\": \"2021-10-13T00:48:03Z\",\n            \"count\": 1,\n            \"type\": \"Normal\",\n            \"eventTime\": null,\n            \"reportingComponent\": \"\",\n            \"reportingInstance\": \"\"\n        }\n    ]\n}\n{\n    \"kind\": \"ReplicationControllerList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"14143\"\n    },\n    \"items\": []\n}\n{\n    \"kind\": \"ServiceList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"14147\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"kube-dns\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"ee3fb9d3-6a93-4b9c-b46f-33b0366f980e\",\n                \"resourceVersion\": \"230\",\n                \"creationTimestamp\": \"2021-10-13T00:48:03Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"coredns.addons.k8s.io\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"coredns.addons.k8s.io\",\n                    \"k8s-app\": \"kube-dns\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"kubernetes.io/name\": \"CoreDNS\"\n                },\n                \"annotations\": {\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"v1\\\",\\\"kind\\\":\\\"Service\\\",\\\"metadata\\\":{\\\"annotations\\\":{\\\"prometheus.io/port\\\":\\\"9153\\\",\\\"prometheus.io/scrape\\\":\\\"true\\\"},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"coredns.addons.k8s.io\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"coredns.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"kube-dns\\\",\\\"kubernetes.io/cluster-service\\\":\\\"true\\\",\\\"kubernetes.io/name\\\":\\\"CoreDNS\\\"},\\\"name\\\":\\\"kube-dns\\\",\\\"namespace\\\":\\\"kube-system\\\",\\\"resourceVersion\\\":\\\"0\\\"},\\\"spec\\\":{\\\"clusterIP\\\":\\\"100.64.0.10\\\",\\\"ports\\\":[{\\\"name\\\":\\\"dns\\\",\\\"port\\\":53,\\\"protocol\\\":\\\"UDP\\\"},{\\\"name\\\":\\\"dns-tcp\\\",\\\"port\\\":53,\\\"protocol\\\":\\\"TCP\\\"},{\\\"name\\\":\\\"metrics\\\",\\\"port\\\":9153,\\\"protocol\\\":\\\"TCP\\\"}],\\\"selector\\\":{\\\"k8s-app\\\":\\\"kube-dns\\\"}}}\\n\",\n                    \"prometheus.io/port\": \"9153\",\n                    \"prometheus.io/scrape\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"ports\": [\n                    {\n                        \"name\": \"dns\",\n                        \"protocol\": \"UDP\",\n                        \"port\": 53,\n                        \"targetPort\": 53\n                    },\n                    {\n                        \"name\": \"dns-tcp\",\n                        \"protocol\": \"TCP\",\n                        \"port\": 53,\n                        \"targetPort\": 53\n                    },\n                    {\n                        \"name\": \"metrics\",\n                        \"protocol\": \"TCP\",\n                        \"port\": 9153,\n                        \"targetPort\": 9153\n                    }\n                ],\n                \"selector\": {\n                    \"k8s-app\": \"kube-dns\"\n                },\n                \"clusterIP\": \"100.64.0.10\",\n                \"clusterIPs\": [\n                    \"100.64.0.10\"\n                ],\n                \"type\": \"ClusterIP\",\n                \"sessionAffinity\": \"None\",\n                \"ipFamilies\": [\n                    \"IPv4\"\n                ],\n                \"ipFamilyPolicy\": \"SingleStack\"\n            },\n            \"status\": {\n                \"loadBalancer\": {}\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"DaemonSetList\",\n    \"apiVersion\": \"apps/v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"14153\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"kops-controller\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"27ec6329-6c0e-4b6e-ae98-9a8202e1ad54\",\n                \"resourceVersion\": \"479\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-10-13T00:48:07Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"kops-controller.addons.k8s.io\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"kops-controller.addons.k8s.io\",\n                    \"k8s-app\": \"kops-controller\",\n                    \"version\": \"v1.23.0-alpha.1\"\n                },\n                \"annotations\": {\n                    \"deprecated.daemonset.template.generation\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"DaemonSet\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"kops-controller.addons.k8s.io\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"kops-controller.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"kops-controller\\\",\\\"version\\\":\\\"v1.23.0-alpha.1\\\"},\\\"name\\\":\\\"kops-controller\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"selector\\\":{\\\"matchLabels\\\":{\\\"k8s-app\\\":\\\"kops-controller\\\"}},\\\"template\\\":{\\\"metadata\\\":{\\\"annotations\\\":{\\\"dns.alpha.kubernetes.io/internal\\\":\\\"kops-controller.internal.e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io\\\"},\\\"labels\\\":{\\\"k8s-addon\\\":\\\"kops-controller.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"kops-controller\\\",\\\"version\\\":\\\"v1.23.0-alpha.1\\\"}},\\\"spec\\\":{\\\"containers\\\":[{\\\"command\\\":[\\\"/kops-controller\\\",\\\"--v=2\\\",\\\"--conf=/etc/kubernetes/kops-controller/config/config.yaml\\\"],\\\"env\\\":[{\\\"name\\\":\\\"KUBERNETES_SERVICE_HOST\\\",\\\"value\\\":\\\"127.0.0.1\\\"}],\\\"image\\\":\\\"k8s.gcr.io/kops/kops-controller:1.23.0-alpha.1\\\",\\\"name\\\":\\\"kops-controller\\\",\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"50m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"securityContext\\\":{\\\"runAsNonRoot\\\":true},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/kops-controller/config/\\\",\\\"name\\\":\\\"kops-controller-config\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/kops-controller/pki/\\\",\\\"name\\\":\\\"kops-controller-pki\\\"}]}],\\\"dnsPolicy\\\":\\\"Default\\\",\\\"hostNetwork\\\":true,\\\"nodeSelector\\\":{\\\"kops.k8s.io/kops-controller-pki\\\":\\\"\\\",\\\"node-role.kubernetes.io/master\\\":\\\"\\\"},\\\"priorityClassName\\\":\\\"system-cluster-critical\\\",\\\"serviceAccount\\\":\\\"kops-controller\\\",\\\"tolerations\\\":[{\\\"key\\\":\\\"node.cloudprovider.kubernetes.io/uninitialized\\\",\\\"operator\\\":\\\"Exists\\\"},{\\\"key\\\":\\\"node.kubernetes.io/not-ready\\\",\\\"operator\\\":\\\"Exists\\\"},{\\\"key\\\":\\\"node-role.kubernetes.io/master\\\",\\\"operator\\\":\\\"Exists\\\"}],\\\"volumes\\\":[{\\\"configMap\\\":{\\\"name\\\":\\\"kops-controller\\\"},\\\"name\\\":\\\"kops-controller-config\\\"},{\\\"hostPath\\\":{\\\"path\\\":\\\"/etc/kubernetes/kops-controller/\\\",\\\"type\\\":\\\"Directory\\\"},\\\"name\\\":\\\"kops-controller-pki\\\"}]}},\\\"updateStrategy\\\":{\\\"type\\\":\\\"OnDelete\\\"}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"kops-controller\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-addon\": \"kops-controller.addons.k8s.io\",\n                            \"k8s-app\": \"kops-controller\",\n                            \"version\": \"v1.23.0-alpha.1\"\n                        },\n                        \"annotations\": {\n                            \"dns.alpha.kubernetes.io/internal\": \"kops-controller.internal.e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"kops-controller-config\",\n                                \"configMap\": {\n                                    \"name\": \"kops-controller\",\n                                    \"defaultMode\": 420\n                                }\n                            },\n                            {\n                                \"name\": \"kops-controller-pki\",\n                                \"hostPath\": {\n                                    \"path\": \"/etc/kubernetes/kops-controller/\",\n                                    \"type\": \"Directory\"\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"kops-controller\",\n                                \"image\": \"k8s.gcr.io/kops/kops-controller:1.23.0-alpha.1\",\n                                \"command\": [\n                                    \"/kops-controller\",\n                                    \"--v=2\",\n                                    \"--conf=/etc/kubernetes/kops-controller/config/config.yaml\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                        \"value\": \"127.0.0.1\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"50m\",\n                                        \"memory\": \"50Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"kops-controller-config\",\n                                        \"mountPath\": \"/etc/kubernetes/kops-controller/config/\"\n                                    },\n                                    {\n                                        \"name\": \"kops-controller-pki\",\n                                        \"mountPath\": \"/etc/kubernetes/kops-controller/pki/\"\n                                    }\n                                ],\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"runAsNonRoot\": true\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"kops.k8s.io/kops-controller-pki\": \"\",\n                            \"node-role.kubernetes.io/master\": \"\"\n                        },\n                        \"serviceAccountName\": \"kops-controller\",\n                        \"serviceAccount\": \"kops-controller\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"node.cloudprovider.kubernetes.io/uninitialized\",\n                                \"operator\": \"Exists\"\n                            },\n                            {\n                                \"key\": \"node.kubernetes.io/not-ready\",\n                                \"operator\": \"Exists\"\n                            },\n                            {\n                                \"key\": \"node-role.kubernetes.io/master\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                },\n                \"updateStrategy\": {\n                    \"type\": \"OnDelete\"\n                },\n                \"revisionHistoryLimit\": 10\n            },\n            \"status\": {\n                \"currentNumberScheduled\": 1,\n                \"numberMisscheduled\": 0,\n                \"desiredNumberScheduled\": 1,\n                \"numberReady\": 1,\n                \"observedGeneration\": 1,\n                \"updatedNumberScheduled\": 1,\n                \"numberAvailable\": 1\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"kube-flannel-ds\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6a459f19-b155-444f-a6f7-8ba33cf96297\",\n                \"resourceVersion\": \"791\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-10-13T00:48:06Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"networking.flannel\",\n                    \"app\": \"flannel\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-app\": \"flannel\",\n                    \"role.kubernetes.io/networking\": \"1\",\n                    \"tier\": \"node\"\n                },\n                \"annotations\": {\n                    \"deprecated.daemonset.template.generation\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"DaemonSet\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"networking.flannel\\\",\\\"app\\\":\\\"flannel\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-app\\\":\\\"flannel\\\",\\\"role.kubernetes.io/networking\\\":\\\"1\\\",\\\"tier\\\":\\\"node\\\"},\\\"name\\\":\\\"kube-flannel-ds\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"selector\\\":{\\\"matchLabels\\\":{\\\"app\\\":\\\"flannel\\\",\\\"tier\\\":\\\"node\\\"}},\\\"template\\\":{\\\"metadata\\\":{\\\"labels\\\":{\\\"app\\\":\\\"flannel\\\",\\\"tier\\\":\\\"node\\\"}},\\\"spec\\\":{\\\"affinity\\\":{\\\"nodeAffinity\\\":{\\\"requiredDuringSchedulingIgnoredDuringExecution\\\":{\\\"nodeSelectorTerms\\\":[{\\\"matchExpressions\\\":[{\\\"key\\\":\\\"kubernetes.io/os\\\",\\\"operator\\\":\\\"In\\\",\\\"values\\\":[\\\"linux\\\"]}]}]}}},\\\"containers\\\":[{\\\"args\\\":[\\\"--ip-masq\\\",\\\"--kube-subnet-mgr\\\",\\\"--iptables-resync=5\\\"],\\\"command\\\":[\\\"/opt/bin/flanneld\\\"],\\\"env\\\":[{\\\"name\\\":\\\"POD_NAME\\\",\\\"valueFrom\\\":{\\\"fieldRef\\\":{\\\"fieldPath\\\":\\\"metadata.name\\\"}}},{\\\"name\\\":\\\"POD_NAMESPACE\\\",\\\"valueFrom\\\":{\\\"fieldRef\\\":{\\\"fieldPath\\\":\\\"metadata.namespace\\\"}}}],\\\"image\\\":\\\"quay.io/coreos/flannel:v0.13.0\\\",\\\"name\\\":\\\"kube-flannel\\\",\\\"resources\\\":{\\\"limits\\\":{\\\"memory\\\":\\\"100Mi\\\"},\\\"requests\\\":{\\\"cpu\\\":\\\"100m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"securityContext\\\":{\\\"capabilities\\\":{\\\"add\\\":[\\\"NET_ADMIN\\\",\\\"NET_RAW\\\"]},\\\"privileged\\\":false},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/run/flannel\\\",\\\"name\\\":\\\"run\\\"},{\\\"mountPath\\\":\\\"/dev/net\\\",\\\"name\\\":\\\"dev-net\\\"},{\\\"mountPath\\\":\\\"/etc/kube-flannel/\\\",\\\"name\\\":\\\"flannel-cfg\\\"}]}],\\\"hostNetwork\\\":true,\\\"initContainers\\\":[{\\\"args\\\":[\\\"-f\\\",\\\"/etc/kube-flannel/cni-conf.json\\\",\\\"/etc/cni/net.d/10-flannel.conflist\\\"],\\\"command\\\":[\\\"cp\\\"],\\\"image\\\":\\\"quay.io/coreos/flannel:v0.13.0\\\",\\\"name\\\":\\\"install-cni\\\",\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"cni\\\"},{\\\"mountPath\\\":\\\"/etc/kube-flannel/\\\",\\\"name\\\":\\\"flannel-cfg\\\"}]}],\\\"priorityClassName\\\":\\\"system-node-critical\\\",\\\"serviceAccountName\\\":\\\"flannel\\\",\\\"tolerations\\\":[{\\\"operator\\\":\\\"Exists\\\"}],\\\"volumes\\\":[{\\\"hostPath\\\":{\\\"path\\\":\\\"/run/flannel\\\"},\\\"name\\\":\\\"run\\\"},{\\\"hostPath\\\":{\\\"path\\\":\\\"/dev/net\\\"},\\\"name\\\":\\\"dev-net\\\"},{\\\"hostPath\\\":{\\\"path\\\":\\\"/etc/cni/net.d\\\"},\\\"name\\\":\\\"cni\\\"},{\\\"configMap\\\":{\\\"name\\\":\\\"kube-flannel-cfg\\\"},\\\"name\\\":\\\"flannel-cfg\\\"}]}}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"app\": \"flannel\",\n                        \"tier\": \"node\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"app\": \"flannel\",\n                            \"tier\": \"node\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"run\",\n                                \"hostPath\": {\n                                    \"path\": \"/run/flannel\",\n                                    \"type\": \"\"\n                                }\n                            },\n                            {\n                                \"name\": \"dev-net\",\n                                \"hostPath\": {\n                                    \"path\": \"/dev/net\",\n                                    \"type\": \"\"\n                                }\n                            },\n                            {\n                                \"name\": \"cni\",\n                                \"hostPath\": {\n                                    \"path\": \"/etc/cni/net.d\",\n                                    \"type\": \"\"\n                                }\n                            },\n                            {\n                                \"name\": \"flannel-cfg\",\n                                \"configMap\": {\n                                    \"name\": \"kube-flannel-cfg\",\n                                    \"defaultMode\": 420\n                                }\n                            }\n                        ],\n                        \"initContainers\": [\n                            {\n                                \"name\": \"install-cni\",\n                                \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                                \"command\": [\n                                    \"cp\"\n                                ],\n                                \"args\": [\n                                    \"-f\",\n                                    \"/etc/kube-flannel/cni-conf.json\",\n                                    \"/etc/cni/net.d/10-flannel.conflist\"\n                                ],\n                                \"resources\": {},\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"cni\",\n                                        \"mountPath\": \"/etc/cni/net.d\"\n                                    },\n                                    {\n                                        \"name\": \"flannel-cfg\",\n                                        \"mountPath\": \"/etc/kube-flannel/\"\n                                    }\n                                ],\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\"\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"kube-flannel\",\n                                \"image\": \"quay.io/coreos/flannel:v0.13.0\",\n                                \"command\": [\n                                    \"/opt/bin/flanneld\"\n                                ],\n                                \"args\": [\n                                    \"--ip-masq\",\n                                    \"--kube-subnet-mgr\",\n                                    \"--iptables-resync=5\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"POD_NAME\",\n                                        \"valueFrom\": {\n                                            \"fieldRef\": {\n                                                \"apiVersion\": \"v1\",\n                                                \"fieldPath\": \"metadata.name\"\n                                            }\n                                        }\n                                    },\n                                    {\n                                        \"name\": \"POD_NAMESPACE\",\n                                        \"valueFrom\": {\n                                            \"fieldRef\": {\n                                                \"apiVersion\": \"v1\",\n                                                \"fieldPath\": \"metadata.namespace\"\n                                            }\n                                        }\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"limits\": {\n                                        \"memory\": \"100Mi\"\n                                    },\n                                    \"requests\": {\n                                        \"cpu\": \"100m\",\n                                        \"memory\": \"100Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"run\",\n                                        \"mountPath\": \"/run/flannel\"\n                                    },\n                                    {\n                                        \"name\": \"dev-net\",\n                                        \"mountPath\": \"/dev/net\"\n                                    },\n                                    {\n                                        \"name\": \"flannel-cfg\",\n                                        \"mountPath\": \"/etc/kube-flannel/\"\n                                    }\n                                ],\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"capabilities\": {\n                                        \"add\": [\n                                            \"NET_ADMIN\",\n                                            \"NET_RAW\"\n                                        ]\n                                    },\n                                    \"privileged\": false\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"ClusterFirst\",\n                        \"serviceAccountName\": \"flannel\",\n                        \"serviceAccount\": \"flannel\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"affinity\": {\n                            \"nodeAffinity\": {\n                                \"requiredDuringSchedulingIgnoredDuringExecution\": {\n                                    \"nodeSelectorTerms\": [\n                                        {\n                                            \"matchExpressions\": [\n                                                {\n                                                    \"key\": \"kubernetes.io/os\",\n                                                    \"operator\": \"In\",\n                                                    \"values\": [\n                                                        \"linux\"\n                                                    ]\n                                                }\n                                            ]\n                                        }\n                                    ]\n                                }\n                            }\n                        },\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-node-critical\"\n                    }\n                },\n                \"updateStrategy\": {\n                    \"type\": \"RollingUpdate\",\n                    \"rollingUpdate\": {\n                        \"maxUnavailable\": 1,\n                        \"maxSurge\": 0\n                    }\n                },\n                \"revisionHistoryLimit\": 10\n            },\n            \"status\": {\n                \"currentNumberScheduled\": 5,\n                \"numberMisscheduled\": 0,\n                \"desiredNumberScheduled\": 5,\n                \"numberReady\": 5,\n                \"observedGeneration\": 1,\n                \"updatedNumberScheduled\": 5,\n                \"numberAvailable\": 5\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"DeploymentList\",\n    \"apiVersion\": \"apps/v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"14157\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"coredns\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"dc75094e-453d-4cff-8b98-ed8a89d8fcc2\",\n                \"resourceVersion\": \"783\",\n                \"generation\": 2,\n                \"creationTimestamp\": \"2021-10-13T00:48:03Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"coredns.addons.k8s.io\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"coredns.addons.k8s.io\",\n                    \"k8s-app\": \"kube-dns\",\n                    \"kubernetes.io/cluster-service\": \"true\",\n                    \"kubernetes.io/name\": \"CoreDNS\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/revision\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"Deployment\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"coredns.addons.k8s.io\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"coredns.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"kube-dns\\\",\\\"kubernetes.io/cluster-service\\\":\\\"true\\\",\\\"kubernetes.io/name\\\":\\\"CoreDNS\\\"},\\\"name\\\":\\\"coredns\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"selector\\\":{\\\"matchLabels\\\":{\\\"k8s-app\\\":\\\"kube-dns\\\"}},\\\"strategy\\\":{\\\"rollingUpdate\\\":{\\\"maxSurge\\\":\\\"10%\\\",\\\"maxUnavailable\\\":1},\\\"type\\\":\\\"RollingUpdate\\\"},\\\"template\\\":{\\\"metadata\\\":{\\\"labels\\\":{\\\"k8s-app\\\":\\\"kube-dns\\\"}},\\\"spec\\\":{\\\"affinity\\\":{\\\"podAntiAffinity\\\":{\\\"preferredDuringSchedulingIgnoredDuringExecution\\\":[{\\\"podAffinityTerm\\\":{\\\"labelSelector\\\":{\\\"matchExpressions\\\":[{\\\"key\\\":\\\"k8s-app\\\",\\\"operator\\\":\\\"In\\\",\\\"values\\\":[\\\"kube-dns\\\"]}]},\\\"topologyKey\\\":\\\"kubernetes.io/hostname\\\"},\\\"weight\\\":100}]}},\\\"containers\\\":[{\\\"args\\\":[\\\"-conf\\\",\\\"/etc/coredns/Corefile\\\"],\\\"image\\\":\\\"k8s.gcr.io/coredns/coredns:v1.8.5\\\",\\\"imagePullPolicy\\\":\\\"IfNotPresent\\\",\\\"livenessProbe\\\":{\\\"failureThreshold\\\":5,\\\"httpGet\\\":{\\\"path\\\":\\\"/health\\\",\\\"port\\\":8080,\\\"scheme\\\":\\\"HTTP\\\"},\\\"initialDelaySeconds\\\":60,\\\"successThreshold\\\":1,\\\"timeoutSeconds\\\":5},\\\"name\\\":\\\"coredns\\\",\\\"ports\\\":[{\\\"containerPort\\\":53,\\\"name\\\":\\\"dns\\\",\\\"protocol\\\":\\\"UDP\\\"},{\\\"containerPort\\\":53,\\\"name\\\":\\\"dns-tcp\\\",\\\"protocol\\\":\\\"TCP\\\"},{\\\"containerPort\\\":9153,\\\"name\\\":\\\"metrics\\\",\\\"protocol\\\":\\\"TCP\\\"}],\\\"readinessProbe\\\":{\\\"httpGet\\\":{\\\"path\\\":\\\"/ready\\\",\\\"port\\\":8181,\\\"scheme\\\":\\\"HTTP\\\"}},\\\"resources\\\":{\\\"limits\\\":{\\\"memory\\\":\\\"170Mi\\\"},\\\"requests\\\":{\\\"cpu\\\":\\\"100m\\\",\\\"memory\\\":\\\"70Mi\\\"}},\\\"securityContext\\\":{\\\"allowPrivilegeEscalation\\\":false,\\\"capabilities\\\":{\\\"add\\\":[\\\"NET_BIND_SERVICE\\\"],\\\"drop\\\":[\\\"all\\\"]},\\\"readOnlyRootFilesystem\\\":true},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/coredns\\\",\\\"name\\\":\\\"config-volume\\\",\\\"readOnly\\\":true}]}],\\\"dnsPolicy\\\":\\\"Default\\\",\\\"nodeSelector\\\":{\\\"kubernetes.io/os\\\":\\\"linux\\\"},\\\"priorityClassName\\\":\\\"system-cluster-critical\\\",\\\"serviceAccountName\\\":\\\"coredns\\\",\\\"tolerations\\\":[{\\\"key\\\":\\\"CriticalAddonsOnly\\\",\\\"operator\\\":\\\"Exists\\\"}],\\\"volumes\\\":[{\\\"configMap\\\":{\\\"items\\\":[{\\\"key\\\":\\\"Corefile\\\",\\\"path\\\":\\\"Corefile\\\"}],\\\"name\\\":\\\"coredns\\\"},\\\"name\\\":\\\"config-volume\\\"}]}}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"replicas\": 2,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"kube-dns\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"kube-dns\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"configMap\": {\n                                    \"name\": \"coredns\",\n                                    \"items\": [\n                                        {\n                                            \"key\": \"Corefile\",\n                                            \"path\": \"Corefile\"\n                                        }\n                                    ],\n                                    \"defaultMode\": 420\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"coredns\",\n                                \"image\": \"k8s.gcr.io/coredns/coredns:v1.8.5\",\n                                \"args\": [\n                                    \"-conf\",\n                                    \"/etc/coredns/Corefile\"\n                                ],\n                                \"ports\": [\n                                    {\n                                        \"name\": \"dns\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"UDP\"\n                                    },\n                                    {\n                                        \"name\": \"dns-tcp\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"TCP\"\n                                    },\n                                    {\n                                        \"name\": \"metrics\",\n                                        \"containerPort\": 9153,\n                                        \"protocol\": \"TCP\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"limits\": {\n                                        \"memory\": \"170Mi\"\n                                    },\n                                    \"requests\": {\n                                        \"cpu\": \"100m\",\n                                        \"memory\": \"70Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"config-volume\",\n                                        \"readOnly\": true,\n                                        \"mountPath\": \"/etc/coredns\"\n                                    }\n                                ],\n                                \"livenessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/health\",\n                                        \"port\": 8080,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"initialDelaySeconds\": 60,\n                                    \"timeoutSeconds\": 5,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 5\n                                },\n                                \"readinessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/ready\",\n                                        \"port\": 8181,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"timeoutSeconds\": 1,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 3\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"capabilities\": {\n                                        \"add\": [\n                                            \"NET_BIND_SERVICE\"\n                                        ],\n                                        \"drop\": [\n                                            \"all\"\n                                        ]\n                                    },\n                                    \"readOnlyRootFilesystem\": true,\n                                    \"allowPrivilegeEscalation\": false\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"kubernetes.io/os\": \"linux\"\n                        },\n                        \"serviceAccountName\": \"coredns\",\n                        \"serviceAccount\": \"coredns\",\n                        \"securityContext\": {},\n                        \"affinity\": {\n                            \"podAntiAffinity\": {\n                                \"preferredDuringSchedulingIgnoredDuringExecution\": [\n                                    {\n                                        \"weight\": 100,\n                                        \"podAffinityTerm\": {\n                                            \"labelSelector\": {\n                                                \"matchExpressions\": [\n                                                    {\n                                                        \"key\": \"k8s-app\",\n                                                        \"operator\": \"In\",\n                                                        \"values\": [\n                                                            \"kube-dns\"\n                                                        ]\n                                                    }\n                                                ]\n                                            },\n                                            \"topologyKey\": \"kubernetes.io/hostname\"\n                                        }\n                                    }\n                                ]\n                            }\n                        },\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                },\n                \"strategy\": {\n                    \"type\": \"RollingUpdate\",\n                    \"rollingUpdate\": {\n                        \"maxUnavailable\": 1,\n                        \"maxSurge\": \"10%\"\n                    }\n                },\n                \"revisionHistoryLimit\": 10,\n                \"progressDeadlineSeconds\": 600\n            },\n            \"status\": {\n                \"observedGeneration\": 2,\n                \"replicas\": 2,\n                \"updatedReplicas\": 2,\n                \"readyReplicas\": 2,\n                \"availableReplicas\": 2,\n                \"conditions\": [\n                    {\n                        \"type\": \"Available\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-10-13T00:48:33Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:48:33Z\",\n                        \"reason\": \"MinimumReplicasAvailable\",\n                        \"message\": \"Deployment has minimum availability.\"\n                    },\n                    {\n                        \"type\": \"Progressing\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-10-13T00:49:45Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:48:33Z\",\n                        \"reason\": \"NewReplicaSetAvailable\",\n                        \"message\": \"ReplicaSet \\\"coredns-6c8944dbdc\\\" has successfully progressed.\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"efff0f19-3a62-4c61-a00d-49467e84f063\",\n                \"resourceVersion\": \"765\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-10-13T00:48:04Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"coredns.addons.k8s.io\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"coredns.addons.k8s.io\",\n                    \"k8s-app\": \"coredns-autoscaler\",\n                    \"kubernetes.io/cluster-service\": \"true\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/revision\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"Deployment\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"coredns.addons.k8s.io\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"coredns.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"coredns-autoscaler\\\",\\\"kubernetes.io/cluster-service\\\":\\\"true\\\"},\\\"name\\\":\\\"coredns-autoscaler\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"selector\\\":{\\\"matchLabels\\\":{\\\"k8s-app\\\":\\\"coredns-autoscaler\\\"}},\\\"template\\\":{\\\"metadata\\\":{\\\"annotations\\\":{\\\"scheduler.alpha.kubernetes.io/critical-pod\\\":\\\"\\\"},\\\"labels\\\":{\\\"k8s-app\\\":\\\"coredns-autoscaler\\\"}},\\\"spec\\\":{\\\"containers\\\":[{\\\"command\\\":[\\\"/cluster-proportional-autoscaler\\\",\\\"--namespace=kube-system\\\",\\\"--configmap=coredns-autoscaler\\\",\\\"--target=Deployment/coredns\\\",\\\"--default-params={\\\\\\\"linear\\\\\\\":{\\\\\\\"coresPerReplica\\\\\\\":256,\\\\\\\"nodesPerReplica\\\\\\\":16,\\\\\\\"preventSinglePointFailure\\\\\\\":true}}\\\",\\\"--logtostderr=true\\\",\\\"--v=2\\\"],\\\"image\\\":\\\"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\\\",\\\"name\\\":\\\"autoscaler\\\",\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"10Mi\\\"}}}],\\\"nodeSelector\\\":{\\\"kubernetes.io/os\\\":\\\"linux\\\"},\\\"priorityClassName\\\":\\\"system-cluster-critical\\\",\\\"serviceAccountName\\\":\\\"coredns-autoscaler\\\",\\\"tolerations\\\":[{\\\"key\\\":\\\"CriticalAddonsOnly\\\",\\\"operator\\\":\\\"Exists\\\"}]}}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"coredns-autoscaler\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"coredns-autoscaler\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"autoscaler\",\n                                \"image\": \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\",\n                                \"command\": [\n                                    \"/cluster-proportional-autoscaler\",\n                                    \"--namespace=kube-system\",\n                                    \"--configmap=coredns-autoscaler\",\n                                    \"--target=Deployment/coredns\",\n                                    \"--default-params={\\\"linear\\\":{\\\"coresPerReplica\\\":256,\\\"nodesPerReplica\\\":16,\\\"preventSinglePointFailure\\\":true}}\",\n                                    \"--logtostderr=true\",\n                                    \"--v=2\"\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"20m\",\n                                        \"memory\": \"10Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\"\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"ClusterFirst\",\n                        \"nodeSelector\": {\n                            \"kubernetes.io/os\": \"linux\"\n                        },\n                        \"serviceAccountName\": \"coredns-autoscaler\",\n                        \"serviceAccount\": \"coredns-autoscaler\",\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                },\n                \"strategy\": {\n                    \"type\": \"RollingUpdate\",\n                    \"rollingUpdate\": {\n                        \"maxUnavailable\": \"25%\",\n                        \"maxSurge\": \"25%\"\n                    }\n                },\n                \"revisionHistoryLimit\": 10,\n                \"progressDeadlineSeconds\": 600\n            },\n            \"status\": {\n                \"observedGeneration\": 1,\n                \"replicas\": 1,\n                \"updatedReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"conditions\": [\n                    {\n                        \"type\": \"Available\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-10-13T00:49:47Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:49:47Z\",\n                        \"reason\": \"MinimumReplicasAvailable\",\n                        \"message\": \"Deployment has minimum availability.\"\n                    },\n                    {\n                        \"type\": \"Progressing\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-10-13T00:49:47Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:48:33Z\",\n                        \"reason\": \"NewReplicaSetAvailable\",\n                        \"message\": \"ReplicaSet \\\"coredns-autoscaler-84d4cfd89c\\\" has successfully progressed.\"\n                    }\n                ]\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"4106ff70-89e8-445d-942b-cd12bfad97ae\",\n                \"resourceVersion\": \"477\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-10-13T00:48:05Z\",\n                \"labels\": {\n                    \"addon.kops.k8s.io/name\": \"dns-controller.addons.k8s.io\",\n                    \"app.kubernetes.io/managed-by\": \"kops\",\n                    \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                    \"k8s-app\": \"dns-controller\",\n                    \"version\": \"v1.23.0-alpha.1\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/revision\": \"1\",\n                    \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"apps/v1\\\",\\\"kind\\\":\\\"Deployment\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"creationTimestamp\\\":null,\\\"labels\\\":{\\\"addon.kops.k8s.io/name\\\":\\\"dns-controller.addons.k8s.io\\\",\\\"app.kubernetes.io/managed-by\\\":\\\"kops\\\",\\\"k8s-addon\\\":\\\"dns-controller.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"dns-controller\\\",\\\"version\\\":\\\"v1.23.0-alpha.1\\\"},\\\"name\\\":\\\"dns-controller\\\",\\\"namespace\\\":\\\"kube-system\\\"},\\\"spec\\\":{\\\"replicas\\\":1,\\\"selector\\\":{\\\"matchLabels\\\":{\\\"k8s-app\\\":\\\"dns-controller\\\"}},\\\"strategy\\\":{\\\"type\\\":\\\"Recreate\\\"},\\\"template\\\":{\\\"metadata\\\":{\\\"annotations\\\":{\\\"scheduler.alpha.kubernetes.io/critical-pod\\\":\\\"\\\"},\\\"labels\\\":{\\\"k8s-addon\\\":\\\"dns-controller.addons.k8s.io\\\",\\\"k8s-app\\\":\\\"dns-controller\\\",\\\"version\\\":\\\"v1.23.0-alpha.1\\\"}},\\\"spec\\\":{\\\"containers\\\":[{\\\"command\\\":[\\\"/dns-controller\\\",\\\"--watch-ingress=false\\\",\\\"--dns=aws-route53\\\",\\\"--zone=*/ZEMLNXIIWQ0RV\\\",\\\"--zone=*/*\\\",\\\"-v=2\\\"],\\\"env\\\":[{\\\"name\\\":\\\"KUBERNETES_SERVICE_HOST\\\",\\\"value\\\":\\\"127.0.0.1\\\"}],\\\"image\\\":\\\"k8s.gcr.io/kops/dns-controller:1.23.0-alpha.1\\\",\\\"name\\\":\\\"dns-controller\\\",\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"50m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"securityContext\\\":{\\\"runAsNonRoot\\\":true}}],\\\"dnsPolicy\\\":\\\"Default\\\",\\\"hostNetwork\\\":true,\\\"nodeSelector\\\":{\\\"node-role.kubernetes.io/master\\\":\\\"\\\"},\\\"priorityClassName\\\":\\\"system-cluster-critical\\\",\\\"serviceAccount\\\":\\\"dns-controller\\\",\\\"tolerations\\\":[{\\\"key\\\":\\\"node.cloudprovider.kubernetes.io/uninitialized\\\",\\\"operator\\\":\\\"Exists\\\"},{\\\"key\\\":\\\"node.kubernetes.io/not-ready\\\",\\\"operator\\\":\\\"Exists\\\"},{\\\"key\\\":\\\"node-role.kubernetes.io/master\\\",\\\"operator\\\":\\\"Exists\\\"}]}}}}\\n\"\n                }\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"dns-controller\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                            \"k8s-app\": \"dns-controller\",\n                            \"version\": \"v1.23.0-alpha.1\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"dns-controller\",\n                                \"image\": \"k8s.gcr.io/kops/dns-controller:1.23.0-alpha.1\",\n                                \"command\": [\n                                    \"/dns-controller\",\n                                    \"--watch-ingress=false\",\n                                    \"--dns=aws-route53\",\n                                    \"--zone=*/ZEMLNXIIWQ0RV\",\n                                    \"--zone=*/*\",\n                                    \"-v=2\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                        \"value\": \"127.0.0.1\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"50m\",\n                                        \"memory\": \"50Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"runAsNonRoot\": true\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"node-role.kubernetes.io/master\": \"\"\n                        },\n                        \"serviceAccountName\": \"dns-controller\",\n                        \"serviceAccount\": \"dns-controller\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"node.cloudprovider.kubernetes.io/uninitialized\",\n                                \"operator\": \"Exists\"\n                            },\n                            {\n                                \"key\": \"node.kubernetes.io/not-ready\",\n                                \"operator\": \"Exists\"\n                            },\n                            {\n                                \"key\": \"node-role.kubernetes.io/master\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                },\n                \"strategy\": {\n                    \"type\": \"Recreate\"\n                },\n                \"revisionHistoryLimit\": 10,\n                \"progressDeadlineSeconds\": 600\n            },\n            \"status\": {\n                \"observedGeneration\": 1,\n                \"replicas\": 1,\n                \"updatedReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"conditions\": [\n                    {\n                        \"type\": \"Available\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-10-13T00:48:35Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:48:35Z\",\n                        \"reason\": \"MinimumReplicasAvailable\",\n                        \"message\": \"Deployment has minimum availability.\"\n                    },\n                    {\n                        \"type\": \"Progressing\",\n                        \"status\": \"True\",\n                        \"lastUpdateTime\": \"2021-10-13T00:48:35Z\",\n                        \"lastTransitionTime\": \"2021-10-13T00:48:33Z\",\n                        \"reason\": \"NewReplicaSetAvailable\",\n                        \"message\": \"ReplicaSet \\\"dns-controller-5779cbc678\\\" has successfully progressed.\"\n                    }\n                ]\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"ReplicaSetList\",\n    \"apiVersion\": \"apps/v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"14169\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"coredns-6c8944dbdc\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f83bdf7e-851e-40b4-8fb4-146ac4839008\",\n                \"resourceVersion\": \"782\",\n                \"generation\": 2,\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-dns\",\n                    \"pod-template-hash\": \"6c8944dbdc\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/desired-replicas\": \"2\",\n                    \"deployment.kubernetes.io/max-replicas\": \"3\",\n                    \"deployment.kubernetes.io/revision\": \"1\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"Deployment\",\n                        \"name\": \"coredns\",\n                        \"uid\": \"dc75094e-453d-4cff-8b98-ed8a89d8fcc2\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"replicas\": 2,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"kube-dns\",\n                        \"pod-template-hash\": \"6c8944dbdc\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"kube-dns\",\n                            \"pod-template-hash\": \"6c8944dbdc\"\n                        }\n                    },\n                    \"spec\": {\n                        \"volumes\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"configMap\": {\n                                    \"name\": \"coredns\",\n                                    \"items\": [\n                                        {\n                                            \"key\": \"Corefile\",\n                                            \"path\": \"Corefile\"\n                                        }\n                                    ],\n                                    \"defaultMode\": 420\n                                }\n                            }\n                        ],\n                        \"containers\": [\n                            {\n                                \"name\": \"coredns\",\n                                \"image\": \"k8s.gcr.io/coredns/coredns:v1.8.5\",\n                                \"args\": [\n                                    \"-conf\",\n                                    \"/etc/coredns/Corefile\"\n                                ],\n                                \"ports\": [\n                                    {\n                                        \"name\": \"dns\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"UDP\"\n                                    },\n                                    {\n                                        \"name\": \"dns-tcp\",\n                                        \"containerPort\": 53,\n                                        \"protocol\": \"TCP\"\n                                    },\n                                    {\n                                        \"name\": \"metrics\",\n                                        \"containerPort\": 9153,\n                                        \"protocol\": \"TCP\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"limits\": {\n                                        \"memory\": \"170Mi\"\n                                    },\n                                    \"requests\": {\n                                        \"cpu\": \"100m\",\n                                        \"memory\": \"70Mi\"\n                                    }\n                                },\n                                \"volumeMounts\": [\n                                    {\n                                        \"name\": \"config-volume\",\n                                        \"readOnly\": true,\n                                        \"mountPath\": \"/etc/coredns\"\n                                    }\n                                ],\n                                \"livenessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/health\",\n                                        \"port\": 8080,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"initialDelaySeconds\": 60,\n                                    \"timeoutSeconds\": 5,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 5\n                                },\n                                \"readinessProbe\": {\n                                    \"httpGet\": {\n                                        \"path\": \"/ready\",\n                                        \"port\": 8181,\n                                        \"scheme\": \"HTTP\"\n                                    },\n                                    \"timeoutSeconds\": 1,\n                                    \"periodSeconds\": 10,\n                                    \"successThreshold\": 1,\n                                    \"failureThreshold\": 3\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"capabilities\": {\n                                        \"add\": [\n                                            \"NET_BIND_SERVICE\"\n                                        ],\n                                        \"drop\": [\n                                            \"all\"\n                                        ]\n                                    },\n                                    \"readOnlyRootFilesystem\": true,\n                                    \"allowPrivilegeEscalation\": false\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"kubernetes.io/os\": \"linux\"\n                        },\n                        \"serviceAccountName\": \"coredns\",\n                        \"serviceAccount\": \"coredns\",\n                        \"securityContext\": {},\n                        \"affinity\": {\n                            \"podAntiAffinity\": {\n                                \"preferredDuringSchedulingIgnoredDuringExecution\": [\n                                    {\n                                        \"weight\": 100,\n                                        \"podAffinityTerm\": {\n                                            \"labelSelector\": {\n                                                \"matchExpressions\": [\n                                                    {\n                                                        \"key\": \"k8s-app\",\n                                                        \"operator\": \"In\",\n                                                        \"values\": [\n                                                            \"kube-dns\"\n                                                        ]\n                                                    }\n                                                ]\n                                            },\n                                            \"topologyKey\": \"kubernetes.io/hostname\"\n                                        }\n                                    }\n                                ]\n                            }\n                        },\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                }\n            },\n            \"status\": {\n                \"replicas\": 2,\n                \"fullyLabeledReplicas\": 2,\n                \"readyReplicas\": 2,\n                \"availableReplicas\": 2,\n                \"observedGeneration\": 2\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"1b6f2bb6-b305-4e71-aa87-58c7994966e9\",\n                \"resourceVersion\": \"764\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\",\n                \"labels\": {\n                    \"k8s-app\": \"coredns-autoscaler\",\n                    \"pod-template-hash\": \"84d4cfd89c\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/desired-replicas\": \"1\",\n                    \"deployment.kubernetes.io/max-replicas\": \"2\",\n                    \"deployment.kubernetes.io/revision\": \"1\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"Deployment\",\n                        \"name\": \"coredns-autoscaler\",\n                        \"uid\": \"efff0f19-3a62-4c61-a00d-49467e84f063\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"coredns-autoscaler\",\n                        \"pod-template-hash\": \"84d4cfd89c\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-app\": \"coredns-autoscaler\",\n                            \"pod-template-hash\": \"84d4cfd89c\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"autoscaler\",\n                                \"image\": \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\",\n                                \"command\": [\n                                    \"/cluster-proportional-autoscaler\",\n                                    \"--namespace=kube-system\",\n                                    \"--configmap=coredns-autoscaler\",\n                                    \"--target=Deployment/coredns\",\n                                    \"--default-params={\\\"linear\\\":{\\\"coresPerReplica\\\":256,\\\"nodesPerReplica\\\":16,\\\"preventSinglePointFailure\\\":true}}\",\n                                    \"--logtostderr=true\",\n                                    \"--v=2\"\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"20m\",\n                                        \"memory\": \"10Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\"\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"ClusterFirst\",\n                        \"nodeSelector\": {\n                            \"kubernetes.io/os\": \"linux\"\n                        },\n                        \"serviceAccountName\": \"coredns-autoscaler\",\n                        \"serviceAccount\": \"coredns-autoscaler\",\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"CriticalAddonsOnly\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                }\n            },\n            \"status\": {\n                \"replicas\": 1,\n                \"fullyLabeledReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"observedGeneration\": 1\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-5779cbc678\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"ab84625a-375e-45fa-8436-f5395e2d6162\",\n                \"resourceVersion\": \"476\",\n                \"generation\": 1,\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\",\n                \"labels\": {\n                    \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                    \"k8s-app\": \"dns-controller\",\n                    \"pod-template-hash\": \"5779cbc678\",\n                    \"version\": \"v1.23.0-alpha.1\"\n                },\n                \"annotations\": {\n                    \"deployment.kubernetes.io/desired-replicas\": \"1\",\n                    \"deployment.kubernetes.io/max-replicas\": \"1\",\n                    \"deployment.kubernetes.io/revision\": \"1\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"Deployment\",\n                        \"name\": \"dns-controller\",\n                        \"uid\": \"4106ff70-89e8-445d-942b-cd12bfad97ae\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"replicas\": 1,\n                \"selector\": {\n                    \"matchLabels\": {\n                        \"k8s-app\": \"dns-controller\",\n                        \"pod-template-hash\": \"5779cbc678\"\n                    }\n                },\n                \"template\": {\n                    \"metadata\": {\n                        \"creationTimestamp\": null,\n                        \"labels\": {\n                            \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                            \"k8s-app\": \"dns-controller\",\n                            \"pod-template-hash\": \"5779cbc678\",\n                            \"version\": \"v1.23.0-alpha.1\"\n                        },\n                        \"annotations\": {\n                            \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                        }\n                    },\n                    \"spec\": {\n                        \"containers\": [\n                            {\n                                \"name\": \"dns-controller\",\n                                \"image\": \"k8s.gcr.io/kops/dns-controller:1.23.0-alpha.1\",\n                                \"command\": [\n                                    \"/dns-controller\",\n                                    \"--watch-ingress=false\",\n                                    \"--dns=aws-route53\",\n                                    \"--zone=*/ZEMLNXIIWQ0RV\",\n                                    \"--zone=*/*\",\n                                    \"-v=2\"\n                                ],\n                                \"env\": [\n                                    {\n                                        \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                        \"value\": \"127.0.0.1\"\n                                    }\n                                ],\n                                \"resources\": {\n                                    \"requests\": {\n                                        \"cpu\": \"50m\",\n                                        \"memory\": \"50Mi\"\n                                    }\n                                },\n                                \"terminationMessagePath\": \"/dev/termination-log\",\n                                \"terminationMessagePolicy\": \"File\",\n                                \"imagePullPolicy\": \"IfNotPresent\",\n                                \"securityContext\": {\n                                    \"runAsNonRoot\": true\n                                }\n                            }\n                        ],\n                        \"restartPolicy\": \"Always\",\n                        \"terminationGracePeriodSeconds\": 30,\n                        \"dnsPolicy\": \"Default\",\n                        \"nodeSelector\": {\n                            \"node-role.kubernetes.io/master\": \"\"\n                        },\n                        \"serviceAccountName\": \"dns-controller\",\n                        \"serviceAccount\": \"dns-controller\",\n                        \"hostNetwork\": true,\n                        \"securityContext\": {},\n                        \"schedulerName\": \"default-scheduler\",\n                        \"tolerations\": [\n                            {\n                                \"key\": \"node.cloudprovider.kubernetes.io/uninitialized\",\n                                \"operator\": \"Exists\"\n                            },\n                            {\n                                \"key\": \"node.kubernetes.io/not-ready\",\n                                \"operator\": \"Exists\"\n                            },\n                            {\n                                \"key\": \"node-role.kubernetes.io/master\",\n                                \"operator\": \"Exists\"\n                            }\n                        ],\n                        \"priorityClassName\": \"system-cluster-critical\"\n                    }\n                }\n            },\n            \"status\": {\n                \"replicas\": 1,\n                \"fullyLabeledReplicas\": 1,\n                \"readyReplicas\": 1,\n                \"availableReplicas\": 1,\n                \"observedGeneration\": 1\n            }\n        }\n    ]\n}\n{\n    \"kind\": \"PodList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"resourceVersion\": \"14176\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"coredns-6c8944dbdc-7bfp8\",\n                \"generateName\": \"coredns-6c8944dbdc-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"dde5ceca-80ee-4d42-a471-3bf57f7eb3ad\",\n                \"resourceVersion\": \"778\",\n                \"creationTimestamp\": \"2021-10-13T00:49:47Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-dns\",\n                    \"pod-template-hash\": \"6c8944dbdc\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"coredns-6c8944dbdc\",\n                        \"uid\": \"f83bdf7e-851e-40b4-8fb4-146ac4839008\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"config-volume\",\n                        \"configMap\": {\n                            \"name\": \"coredns\",\n                            \"items\": [\n                                {\n                                    \"key\": \"Corefile\",\n                                    \"path\": \"Corefile\"\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-6lktj\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"image\": \"k8s.gcr.io/coredns/coredns:v1.8.5\",\n                        \"args\": [\n                            \"-conf\",\n                            \"/etc/coredns/Corefile\"\n                        ],\n                        \"ports\": [\n                            {\n                                \"name\": \"dns\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"UDP\"\n                            },\n                            {\n                                \"name\": \"dns-tcp\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"TCP\"\n                            },\n                            {\n                                \"name\": \"metrics\",\n                                \"containerPort\": 9153,\n                                \"protocol\": \"TCP\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"170Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"70Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/coredns\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-6lktj\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/health\",\n                                \"port\": 8080,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 60,\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 5\n                        },\n                        \"readinessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/ready\",\n                                \"port\": 8181,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"timeoutSeconds\": 1,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_BIND_SERVICE\"\n                                ],\n                                \"drop\": [\n                                    \"all\"\n                                ]\n                            },\n                            \"readOnlyRootFilesystem\": true,\n                            \"allowPrivilegeEscalation\": false\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"kubernetes.io/os\": \"linux\"\n                },\n                \"serviceAccountName\": \"coredns\",\n                \"serviceAccount\": \"coredns\",\n                \"nodeName\": \"ip-172-20-37-188.ap-southeast-1.compute.internal\",\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"podAntiAffinity\": {\n                        \"preferredDuringSchedulingIgnoredDuringExecution\": [\n                            {\n                                \"weight\": 100,\n                                \"podAffinityTerm\": {\n                                    \"labelSelector\": {\n                                        \"matchExpressions\": [\n                                            {\n                                                \"key\": \"k8s-app\",\n                                                \"operator\": \"In\",\n                                                \"values\": [\n                                                    \"kube-dns\"\n                                                ]\n                                            }\n                                        ]\n                                    },\n                                    \"topologyKey\": \"kubernetes.io/hostname\"\n                                }\n                            }\n                        ]\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:49:47Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:49:50Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:49:50Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:49:47Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.37.188\",\n                \"podIP\": \"100.96.3.2\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"100.96.3.2\"\n                    }\n                ],\n                \"startTime\": \"2021-10-13T00:49:47Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-10-13T00:49:50Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/coredns/coredns:v1.8.5\",\n                        \"imageID\": \"docker-pullable://k8s.gcr.io/coredns/coredns@sha256:43a9f52f5dce39bf1816afe6141724cc2d08811e466dd46e6628c925e2419bdc\",\n                        \"containerID\": \"docker://3fc177af22cfdf6b0c06915931ecd601fcb81aa6351f0f6e206fae3b850ede8c\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-6c8944dbdc-ccddt\",\n                \"generateName\": \"coredns-6c8944dbdc-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"f5fb9642-8e13-4fd0-92c1-083631c86731\",\n                \"resourceVersion\": \"736\",\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\",\n                \"labels\": {\n                    \"k8s-app\": \"kube-dns\",\n                    \"pod-template-hash\": \"6c8944dbdc\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"coredns-6c8944dbdc\",\n                        \"uid\": \"f83bdf7e-851e-40b4-8fb4-146ac4839008\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"config-volume\",\n                        \"configMap\": {\n                            \"name\": \"coredns\",\n                            \"items\": [\n                                {\n                                    \"key\": \"Corefile\",\n                                    \"path\": \"Corefile\"\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    },\n                    {\n                        \"name\": \"kube-api-access-tst82\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"image\": \"k8s.gcr.io/coredns/coredns:v1.8.5\",\n                        \"args\": [\n                            \"-conf\",\n                            \"/etc/coredns/Corefile\"\n                        ],\n                        \"ports\": [\n                            {\n                                \"name\": \"dns\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"UDP\"\n                            },\n                            {\n                                \"name\": \"dns-tcp\",\n                                \"containerPort\": 53,\n                                \"protocol\": \"TCP\"\n                            },\n                            {\n                                \"name\": \"metrics\",\n                                \"containerPort\": 9153,\n                                \"protocol\": \"TCP\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"limits\": {\n                                \"memory\": \"170Mi\"\n                            },\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"70Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"config-volume\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/etc/coredns\"\n                            },\n                            {\n                                \"name\": \"kube-api-access-tst82\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"livenessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/health\",\n                                \"port\": 8080,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"initialDelaySeconds\": 60,\n                            \"timeoutSeconds\": 5,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 5\n                        },\n                        \"readinessProbe\": {\n                            \"httpGet\": {\n                                \"path\": \"/ready\",\n                                \"port\": 8181,\n                                \"scheme\": \"HTTP\"\n                            },\n                            \"timeoutSeconds\": 1,\n                            \"periodSeconds\": 10,\n                            \"successThreshold\": 1,\n                            \"failureThreshold\": 3\n                        },\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"capabilities\": {\n                                \"add\": [\n                                    \"NET_BIND_SERVICE\"\n                                ],\n                                \"drop\": [\n                                    \"all\"\n                                ]\n                            },\n                            \"readOnlyRootFilesystem\": true,\n                            \"allowPrivilegeEscalation\": false\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"kubernetes.io/os\": \"linux\"\n                },\n                \"serviceAccountName\": \"coredns\",\n                \"serviceAccount\": \"coredns\",\n                \"nodeName\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\",\n                \"securityContext\": {},\n                \"affinity\": {\n                    \"podAntiAffinity\": {\n                        \"preferredDuringSchedulingIgnoredDuringExecution\": [\n                            {\n                                \"weight\": 100,\n                                \"podAffinityTerm\": {\n                                    \"labelSelector\": {\n                                        \"matchExpressions\": [\n                                            {\n                                                \"key\": \"k8s-app\",\n                                                \"operator\": \"In\",\n                                                \"values\": [\n                                                    \"kube-dns\"\n                                                ]\n                                            }\n                                        ]\n                                    },\n                                    \"topologyKey\": \"kubernetes.io/hostname\"\n                                }\n                            }\n                        ]\n                    }\n                },\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:49:41Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:49:45Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:49:45Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:49:41Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.55.159\",\n                \"podIP\": \"100.96.1.2\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"100.96.1.2\"\n                    }\n                ],\n                \"startTime\": \"2021-10-13T00:49:41Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"coredns\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-10-13T00:49:44Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/coredns/coredns:v1.8.5\",\n                        \"imageID\": \"docker-pullable://k8s.gcr.io/coredns/coredns@sha256:43a9f52f5dce39bf1816afe6141724cc2d08811e466dd46e6628c925e2419bdc\",\n                        \"containerID\": \"docker://452d6bce15ab193d7320ead197ae466e88d63260a46f0846f73e542e023d1103\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"coredns-autoscaler-84d4cfd89c-dxjsp\",\n                \"generateName\": \"coredns-autoscaler-84d4cfd89c-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"535f2276-8f96-4caa-93fc-e6e525769bde\",\n                \"resourceVersion\": \"763\",\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\",\n                \"labels\": {\n                    \"k8s-app\": \"coredns-autoscaler\",\n                    \"pod-template-hash\": \"84d4cfd89c\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"coredns-autoscaler-84d4cfd89c\",\n                        \"uid\": \"1b6f2bb6-b305-4e71-aa87-58c7994966e9\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"kube-api-access-8wfbr\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"autoscaler\",\n                        \"image\": \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\",\n                        \"command\": [\n                            \"/cluster-proportional-autoscaler\",\n                            \"--namespace=kube-system\",\n                            \"--configmap=coredns-autoscaler\",\n                            \"--target=Deployment/coredns\",\n                            \"--default-params={\\\"linear\\\":{\\\"coresPerReplica\\\":256,\\\"nodesPerReplica\\\":16,\\\"preventSinglePointFailure\\\":true}}\",\n                            \"--logtostderr=true\",\n                            \"--v=2\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"20m\",\n                                \"memory\": \"10Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kube-api-access-8wfbr\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\"\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeSelector\": {\n                    \"kubernetes.io/os\": \"linux\"\n                },\n                \"serviceAccountName\": \"coredns-autoscaler\",\n                \"serviceAccount\": \"coredns-autoscaler\",\n                \"nodeName\": \"ip-172-20-55-159.ap-southeast-1.compute.internal\",\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:49:42Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:49:47Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:49:47Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:49:42Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.55.159\",\n                \"podIP\": \"100.96.1.3\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"100.96.1.3\"\n                    }\n                ],\n                \"startTime\": \"2021-10-13T00:49:42Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"autoscaler\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-10-13T00:49:47Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/cpa/cluster-proportional-autoscaler:1.8.4\",\n                        \"imageID\": \"docker-pullable://k8s.gcr.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def\",\n                        \"containerID\": \"docker://e4164535eb2916d74b885e7dde3089c8e9b8421cf376e2f015ad89f5bbddc58f\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"dns-controller-5779cbc678-c2kgq\",\n                \"generateName\": \"dns-controller-5779cbc678-\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"746dc697-c042-4bc7-b8e8-a293206f5893\",\n                \"resourceVersion\": \"475\",\n                \"creationTimestamp\": \"2021-10-13T00:48:33Z\",\n                \"labels\": {\n                    \"k8s-addon\": \"dns-controller.addons.k8s.io\",\n                    \"k8s-app\": \"dns-controller\",\n                    \"pod-template-hash\": \"5779cbc678\",\n                    \"version\": \"v1.23.0-alpha.1\"\n                },\n                \"annotations\": {\n                    \"scheduler.alpha.kubernetes.io/critical-pod\": \"\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"apps/v1\",\n                        \"kind\": \"ReplicaSet\",\n                        \"name\": \"dns-controller-5779cbc678\",\n                        \"uid\": \"ab84625a-375e-45fa-8436-f5395e2d6162\",\n                        \"controller\": true,\n                        \"blockOwnerDeletion\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"kube-api-access-cv8vv\",\n                        \"projected\": {\n                            \"sources\": [\n                                {\n                                    \"serviceAccountToken\": {\n                                        \"expirationSeconds\": 3607,\n                                        \"path\": \"token\"\n                                    }\n                                },\n                                {\n                                    \"configMap\": {\n                                        \"name\": \"kube-root-ca.crt\",\n                                        \"items\": [\n                                            {\n                                                \"key\": \"ca.crt\",\n                                                \"path\": \"ca.crt\"\n                                            }\n                                        ]\n                                    }\n                                },\n                                {\n                                    \"downwardAPI\": {\n                                        \"items\": [\n                                            {\n                                                \"path\": \"namespace\",\n                                                \"fieldRef\": {\n                                                    \"apiVersion\": \"v1\",\n                                                    \"fieldPath\": \"metadata.namespace\"\n                                                }\n                                            }\n                                        ]\n                                    }\n                                }\n                            ],\n                            \"defaultMode\": 420\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"dns-controller\",\n                        \"image\": \"k8s.gcr.io/kops/dns-controller:1.23.0-alpha.1\",\n                        \"command\": [\n                            \"/dns-controller\",\n                            \"--watch-ingress=false\",\n                            \"--dns=aws-route53\",\n                            \"--zone=*/ZEMLNXIIWQ0RV\",\n                            \"--zone=*/*\",\n                            \"-v=2\"\n                        ],\n                        \"env\": [\n                            {\n                                \"name\": \"KUBERNETES_SERVICE_HOST\",\n                                \"value\": \"127.0.0.1\"\n                            }\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"50m\",\n                                \"memory\": \"50Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"kube-api-access-cv8vv\",\n                                \"readOnly\": true,\n                                \"mountPath\": \"/var/run/secrets/kubernetes.io/serviceaccount\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"runAsNonRoot\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"Default\",\n                \"nodeSelector\": {\n                    \"node-role.kubernetes.io/master\": \"\"\n                },\n                \"serviceAccountName\": \"dns-controller\",\n                \"serviceAccount\": \"dns-controller\",\n                \"nodeName\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"node.cloudprovider.kubernetes.io/uninitialized\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/not-ready\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node-role.kubernetes.io/master\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unreachable\",\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\",\n                        \"tolerationSeconds\": 300\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:48:33Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:48:35Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:48:35Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:48:33Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.60.219\",\n                \"podIP\": \"172.20.60.219\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.60.219\"\n                    }\n                ],\n                \"startTime\": \"2021-10-13T00:48:33Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"dns-controller\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-10-13T00:48:34Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/kops/dns-controller:1.23.0-alpha.1\",\n                        \"imageID\": \"docker://sha256:527c2e04e028d6b7c29fc4e5706800568f31b55bd53900aa34c03d5f1077a187\",\n                        \"containerID\": \"docker://8b6c21792db1729c08096fc74d7e6bc0d435c50ce0caf09fd73025608cade0bb\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-events-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"d94f3c4f-1fd1-4376-bc6a-c2dc1effaa75\",\n                \"resourceVersion\": \"543\",\n                \"creationTimestamp\": \"2021-10-13T00:48:53Z\",\n                \"labels\": {\n                    \"k8s-app\": \"etcd-manager-events\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"a3538887f7503b0fab3e30a9abaff78c\",\n                    \"kubernetes.io/config.mirror\": \"a3538887f7503b0fab3e30a9abaff78c\",\n                    \"kubernetes.io/config.seen\": \"2021-10-13T00:47:06.893011998Z\",\n                    \"kubernetes.io/config.source\": \"file\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                        \"uid\": \"ce168b11-9bb9-4272-a5f6-c36a10d997e5\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"rootfs\",\n                        \"hostPath\": {\n                            \"path\": \"/\",\n                            \"type\": \"Directory\"\n                        }\n                    },\n                    {\n                        \"name\": \"run\",\n                        \"hostPath\": {\n                            \"path\": \"/run\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"pki\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/pki/etcd-manager-events\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"varlogetcd\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/etcd-events.log\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"image\": \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20211007\",\n                        \"command\": [\n                            \"/bin/sh\",\n                            \"-c\",\n                            \"mkfifo /tmp/pipe; (tee -a /var/log/etcd.log \\u003c /tmp/pipe \\u0026 ) ; exec /etcd-manager --backup-store=s3://k8s-kops-prow/e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io/backups/etcd/events --client-urls=https://__name__:4002 --cluster-name=etcd-events --containerized=true --dns-suffix=.internal.e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io --grpc-port=3997 --peer-urls=https://__name__:2381 --quarantine-client-urls=https://__name__:3995 --v=6 --volume-name-tag=k8s.io/etcd/events --volume-provider=aws --volume-tag=k8s.io/etcd/events --volume-tag=k8s.io/role/master=1 --volume-tag=kubernetes.io/cluster/e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io=owned \\u003e /tmp/pipe 2\\u003e\\u00261\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"100m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"rootfs\",\n                                \"mountPath\": \"/rootfs\"\n                            },\n                            {\n                                \"name\": \"run\",\n                                \"mountPath\": \"/run\"\n                            },\n                            {\n                                \"name\": \"pki\",\n                                \"mountPath\": \"/etc/kubernetes/pki/etcd-manager\"\n                            },\n                            {\n                                \"name\": \"varlogetcd\",\n                                \"mountPath\": \"/var/log/etcd.log\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"hostPID\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:47:08Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:47:34Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:47:34Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:47:08Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.60.219\",\n                \"podIP\": \"172.20.60.219\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.60.219\"\n                    }\n                ],\n                \"startTime\": \"2021-10-13T00:47:08Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-10-13T00:47:33Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20211007\",\n                        \"imageID\": \"docker-pullable://k8s.gcr.io/etcdadm/etcd-manager@sha256:36a55fd68b835aace1533cb4310f464a7f02d884fd7d4c3f528775e39f6bdb9f\",\n                        \"containerID\": \"docker://5ac4aed3025921cbbb76e411f6e2d3277e68b2846c54821ec763a3e306406b3a\",\n                        \"started\": true\n                    }\n                ],\n                \"qosClass\": \"Burstable\"\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"etcd-manager-main-ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"namespace\": \"kube-system\",\n                \"uid\": \"6d82fe46-a8c8-4a2e-99c3-90600b744a2e\",\n                \"resourceVersion\": \"511\",\n                \"creationTimestamp\": \"2021-10-13T00:48:46Z\",\n                \"labels\": {\n                    \"k8s-app\": \"etcd-manager-main\"\n                },\n                \"annotations\": {\n                    \"kubernetes.io/config.hash\": \"d2521ffb3d7f9e8ee9d3afb13576f381\",\n                    \"kubernetes.io/config.mirror\": \"d2521ffb3d7f9e8ee9d3afb13576f381\",\n                    \"kubernetes.io/config.seen\": \"2021-10-13T00:47:06.893013260Z\",\n                    \"kubernetes.io/config.source\": \"file\"\n                },\n                \"ownerReferences\": [\n                    {\n                        \"apiVersion\": \"v1\",\n                        \"kind\": \"Node\",\n                        \"name\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                        \"uid\": \"ce168b11-9bb9-4272-a5f6-c36a10d997e5\",\n                        \"controller\": true\n                    }\n                ]\n            },\n            \"spec\": {\n                \"volumes\": [\n                    {\n                        \"name\": \"rootfs\",\n                        \"hostPath\": {\n                            \"path\": \"/\",\n                            \"type\": \"Directory\"\n                        }\n                    },\n                    {\n                        \"name\": \"run\",\n                        \"hostPath\": {\n                            \"path\": \"/run\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"pki\",\n                        \"hostPath\": {\n                            \"path\": \"/etc/kubernetes/pki/etcd-manager-main\",\n                            \"type\": \"DirectoryOrCreate\"\n                        }\n                    },\n                    {\n                        \"name\": \"varlogetcd\",\n                        \"hostPath\": {\n                            \"path\": \"/var/log/etcd.log\",\n                            \"type\": \"FileOrCreate\"\n                        }\n                    }\n                ],\n                \"containers\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"image\": \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20211007\",\n                        \"command\": [\n                            \"/bin/sh\",\n                            \"-c\",\n                            \"mkfifo /tmp/pipe; (tee -a /var/log/etcd.log \\u003c /tmp/pipe \\u0026 ) ; exec /etcd-manager --backup-store=s3://k8s-kops-prow/e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io/backups/etcd/main --client-urls=https://__name__:4001 --cluster-name=etcd --containerized=true --dns-suffix=.internal.e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io --grpc-port=3996 --peer-urls=https://__name__:2380 --quarantine-client-urls=https://__name__:3994 --v=6 --volume-name-tag=k8s.io/etcd/main --volume-provider=aws --volume-tag=k8s.io/etcd/main --volume-tag=k8s.io/role/master=1 --volume-tag=kubernetes.io/cluster/e2e-2a6ea3ee48-82074.test-cncf-aws.k8s.io=owned \\u003e /tmp/pipe 2\\u003e\\u00261\"\n                        ],\n                        \"resources\": {\n                            \"requests\": {\n                                \"cpu\": \"200m\",\n                                \"memory\": \"100Mi\"\n                            }\n                        },\n                        \"volumeMounts\": [\n                            {\n                                \"name\": \"rootfs\",\n                                \"mountPath\": \"/rootfs\"\n                            },\n                            {\n                                \"name\": \"run\",\n                                \"mountPath\": \"/run\"\n                            },\n                            {\n                                \"name\": \"pki\",\n                                \"mountPath\": \"/etc/kubernetes/pki/etcd-manager\"\n                            },\n                            {\n                                \"name\": \"varlogetcd\",\n                                \"mountPath\": \"/var/log/etcd.log\"\n                            }\n                        ],\n                        \"terminationMessagePath\": \"/dev/termination-log\",\n                        \"terminationMessagePolicy\": \"File\",\n                        \"imagePullPolicy\": \"IfNotPresent\",\n                        \"securityContext\": {\n                            \"privileged\": true\n                        }\n                    }\n                ],\n                \"restartPolicy\": \"Always\",\n                \"terminationGracePeriodSeconds\": 30,\n                \"dnsPolicy\": \"ClusterFirst\",\n                \"nodeName\": \"ip-172-20-60-219.ap-southeast-1.compute.internal\",\n                \"hostNetwork\": true,\n                \"hostPID\": true,\n                \"securityContext\": {},\n                \"schedulerName\": \"default-scheduler\",\n                \"tolerations\": [\n                    {\n                        \"key\": \"CriticalAddonsOnly\",\n                        \"operator\": \"Exists\"\n                    },\n                    {\n                        \"operator\": \"Exists\",\n                        \"effect\": \"NoExecute\"\n                    }\n                ],\n                \"priorityClassName\": \"system-cluster-critical\",\n                \"priority\": 2000000000,\n                \"enableServiceLinks\": true,\n                \"preemptionPolicy\": \"PreemptLowerPriority\"\n            },\n            \"status\": {\n                \"phase\": \"Running\",\n                \"conditions\": [\n                    {\n                        \"type\": \"Initialized\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:47:08Z\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:47:34Z\"\n                    },\n                    {\n                        \"type\": \"ContainersReady\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:47:34Z\"\n                    },\n                    {\n                        \"type\": \"PodScheduled\",\n                        \"status\": \"True\",\n                        \"lastProbeTime\": null,\n                        \"lastTransitionTime\": \"2021-10-13T00:47:08Z\"\n                    }\n                ],\n                \"hostIP\": \"172.20.60.219\",\n                \"podIP\": \"172.20.60.219\",\n                \"podIPs\": [\n                    {\n                        \"ip\": \"172.20.60.219\"\n                    }\n                ],\n                \"startTime\": \"2021-10-13T00:47:08Z\",\n                \"containerStatuses\": [\n                    {\n                        \"name\": \"etcd-manager\",\n                        \"state\": {\n                            \"running\": {\n                                \"startedAt\": \"2021-10-13T00:47:33Z\"\n                            }\n                        },\n                        \"lastState\": {},\n                        \"ready\": true,\n                        \"restartCount\": 0,\n                        \"image\": \"k8s.gcr.io/etcdadm/etcd-manager:3.0.20211007\",\n                        \"imageID\": \"docker-pullable://k8s.gcr.io/etcdadm/etcd-manager@sha256:36a55fd68b835aace1533cb4310f464a7f02d884fd7d4c3f528775e39f6bdb9f\",\n                        \"containerID\": \"docker://0b42cb258da1bdb766eeb933