This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 5 succeeded
Started2021-10-11 07:10
Elapsed17m59s
Revision
job-versionv1.23.0-alpha.3.252+fb82a0d7eb252a
kubetest-version
revisionv1.23.0-alpha.3.252+fb82a0d7eb252a

Test Failures


kubetest Up 15m31s

kops validate cluster failed: error during /tmp/kops3643439122/kops validate cluster e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io --wait 15m: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 5 Passed Tests

Error lines from build-log.txt

Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
fatal: not a git repository (or any of the parent directories): .git
+ WRAPPED_COMMAND_PID=31
+ wait 31
+ /workspace/scenarios/kubernetes_e2e.py --cluster=e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io --deployment=kops --env=KOPS_ARCH=amd64 --env=KUBE_SSH_USER=ec2-user --env=KOPS_RUN_TOO_NEW_VERSION=1 --extract=ci/latest --ginkgo-parallel --kops-image=309956199498/RHEL-7.8_HVM_GA-20200225-x86_64-1-Hourly2-GP2 --kops-args=--master-image=137112412989/amzn2-ami-hvm-2.0.20200617.0-x86_64-gp2 --kops-overrides=spec.docker.selinuxEnabled=true --kops-priority-path=/workspace/kubernetes/platforms/linux/amd64 --kops-ssh-user=ec2-user --kops-version=https://storage.googleapis.com/kops-ci/bin/latest-ci-updown-green.txt --provider=aws '--test_args=--ginkgo.focus=\[sig-storage\].*\[Slow\] --ginkgo.skip=\[Serial\]|\[Disruptive\]|\[Flaky\]|\[Feature:.+\] --minStartupPods=8' --timeout=120m
starts with local mode
Environment:
ARTIFACTS=/logs/artifacts
... skipping 156 lines ...
md5sum(kubernetes-test-linux-amd64.tar.gz)=2081bcc77764d86990d0c1b4a6b41284
sha512sum(kubernetes-test-linux-amd64.tar.gz)=30ab4cf6d89332347ea93d9ed1ed6189ce8cd9f959ffe36f1a620770b702baf9abf698bf4c259b0b55d47e801532f983377d888ee8736bda03804e806a8ab711

Extracting /workspace/kubernetes/test/kubernetes-test-linux-amd64.tar.gz into /workspace/kubernetes/platforms/linux/amd64
2021/10/11 07:11:05 process.go:155: Step './get-kube.sh' finished in 29.22421861s
2021/10/11 07:11:05 process.go:153: Running: /tmp/kops3643439122/kops get clusters e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io
Error: cluster not found "e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io"
2021/10/11 07:11:06 process.go:155: Step '/tmp/kops3643439122/kops get clusters e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io' finished in 500.374003ms
2021/10/11 07:11:06 util.go:42: curl http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip
2021/10/11 07:11:06 kops.go:514: failed to get external ip from metadata service: http://metadata.google.internal/computeMetadata/v1/instance/network-interfaces/0/access-configs/0/external-ip returned 404
2021/10/11 07:11:06 util.go:68: curl https://ip.jsb.workers.dev
2021/10/11 07:11:06 kops.go:439: Using external IP for admin access: 35.184.31.205/32
2021/10/11 07:11:06 process.go:153: Running: /tmp/kops3643439122/kops create cluster --name e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io --ssh-public-key /workspace/.ssh/kube_aws_rsa.pub --node-count 4 --node-volume-size 48 --master-volume-size 48 --master-count 1 --zones eu-central-1b --master-size c5.large --kubernetes-version https://storage.googleapis.com/k8s-release-dev/ci/v1.23.0-alpha.3.252+fb82a0d7eb252a --admin-access 35.184.31.205/32 --image 309956199498/RHEL-7.8_HVM_GA-20200225-x86_64-1-Hourly2-GP2 --cloud aws --master-image=137112412989/amzn2-ami-hvm-2.0.20200617.0-x86_64-gp2 --override spec.docker.selinuxEnabled=true,cluster.spec.nodePortAccess=0.0.0.0/0 --yes
I1011 07:11:06.568817     988 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
I1011 07:11:06.591427     988 create_cluster.go:838] Using SSH public key: /workspace/.ssh/kube_aws_rsa.pub
I1011 07:11:07.173427     988 new_cluster.go:1077]  Cloud Provider ID = aws
... skipping 31 lines ...

2021/10/11 07:11:32 process.go:155: Step '/tmp/kops3643439122/kops create cluster --name e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io --ssh-public-key /workspace/.ssh/kube_aws_rsa.pub --node-count 4 --node-volume-size 48 --master-volume-size 48 --master-count 1 --zones eu-central-1b --master-size c5.large --kubernetes-version https://storage.googleapis.com/k8s-release-dev/ci/v1.23.0-alpha.3.252+fb82a0d7eb252a --admin-access 35.184.31.205/32 --image 309956199498/RHEL-7.8_HVM_GA-20200225-x86_64-1-Hourly2-GP2 --cloud aws --master-image=137112412989/amzn2-ami-hvm-2.0.20200617.0-x86_64-gp2 --override spec.docker.selinuxEnabled=true,cluster.spec.nodePortAccess=0.0.0.0/0 --yes' finished in 25.887712391s
2021/10/11 07:11:32 process.go:153: Running: /tmp/kops3643439122/kops validate cluster e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io --wait 15m
I1011 07:11:32.456558    1007 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
Validating cluster e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io

W1011 07:11:33.622880    1007 validate_cluster.go:184] (will retry): unexpected error during validation: unable to resolve Kubernetes cluster API URL dns: lookup api.e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io on 10.63.240.10:53: no such host
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:11:43.652838    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:11:53.683441    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:12:03.747480    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:12:13.779123    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:12:23.827474    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:12:33.861356    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:12:43.906045    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:12:53.938656    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:13:04.008304    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:13:14.060110    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:13:24.091572    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:13:34.147509    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:13:44.185627    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:13:54.239292    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:14:04.267402    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:14:14.332283    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:14:24.367396    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:14:34.401953    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:14:44.447832    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:14:54.487532    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

NODE STATUS
NAME	ROLE	READY

VALIDATION ERRORS
KIND	NAME		MESSAGE
dns	apiserver	Validation Failed

The dns-controller Kubernetes deployment has not updated the Kubernetes cluster's API DNS entry to the correct IP address.  The API DNS IP address is the placeholder address that kops creates: 203.0.113.123.  Please wait about 5-10 minutes for a master to start, dns-controller to launch, and DNS to propagate.  The protokube container and dns-controller deployment logs may contain more diagnostic information.  Etcd and the API DNS entries must be updated for a kops Kubernetes cluster to start.

Validation Failed
W1011 07:15:04.526725    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 9 lines ...
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Node	ip-172-20-51-8.eu-central-1.compute.internal	master "ip-172-20-51-8.eu-central-1.compute.internal" is missing kube-controller-manager pod
Node	ip-172-20-51-8.eu-central-1.compute.internal	master "ip-172-20-51-8.eu-central-1.compute.internal" is missing kube-scheduler pod
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:15:17.507979    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 8 lines ...
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Node	ip-172-20-51-8.eu-central-1.compute.internal	master "ip-172-20-51-8.eu-central-1.compute.internal" is missing kube-scheduler pod
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:15:29.472397    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 8 lines ...
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Node	ip-172-20-51-8.eu-central-1.compute.internal	master "ip-172-20-51-8.eu-central-1.compute.internal" is missing kube-scheduler pod
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:15:41.554931    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 8 lines ...
Machine	i-0500d659b3d869411							machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d							machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf					system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q				system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending
Pod	kube-system/kube-proxy-ip-172-20-51-8.eu-central-1.compute.internal	system-node-critical pod "kube-proxy-ip-172-20-51-8.eu-central-1.compute.internal" is pending

Validation Failed
W1011 07:15:53.500793    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:16:05.452596    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:16:17.387804    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:16:29.300973    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:16:41.273379    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:16:53.170060    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:17:05.278965    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:17:17.169374    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:17:29.088378    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:17:40.996948    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:17:52.931376    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:18:04.914861    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:18:16.928106    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:18:28.877600    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:18:40.782258    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:18:52.670003    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:19:04.566185    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:19:16.944985    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:19:28.954229    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:19:40.826982    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:19:52.730668    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:20:04.770281    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:20:16.754290    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:20:28.752082    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:20:40.664171    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:20:52.733265    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:21:04.646960    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:21:16.552712    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:21:28.557127    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:21:40.421454    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:21:52.250022    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:22:04.127589    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:22:16.077396    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:22:27.948573    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:22:39.809643    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:22:51.804942    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:23:03.721530    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:23:16.081176    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:23:28.178983    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:23:40.133358    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:23:52.042834    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:24:03.895728    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:24:15.807331    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:24:27.607013    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:24:39.521144    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:24:51.492110    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:25:03.606848    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:25:15.564427    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:25:27.493289    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:25:39.431441    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:25:51.396010    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:26:03.529227    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:26:15.558647    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
INSTANCE GROUPS
NAME			ROLE	MACHINETYPE	MIN	MAX	SUBNETS
master-eu-central-1b	Master	c5.large	1	1	eu-central-1b
nodes-eu-central-1b	Node	t3.medium	4	4	eu-central-1b

... skipping 7 lines ...
Machine	i-046e1c1a6db916fde				machine "i-046e1c1a6db916fde" has not yet joined cluster
Machine	i-0500d659b3d869411				machine "i-0500d659b3d869411" has not yet joined cluster
Machine	i-06bbd9e2d0871114d				machine "i-06bbd9e2d0871114d" has not yet joined cluster
Pod	kube-system/coredns-5dc785954d-j6wdf		system-cluster-critical pod "coredns-5dc785954d-j6wdf" is pending
Pod	kube-system/coredns-autoscaler-84d4cfd89c-lxr4q	system-cluster-critical pod "coredns-autoscaler-84d4cfd89c-lxr4q" is pending

Validation Failed
W1011 07:26:27.500144    1007 validate_cluster.go:232] (will retry): cluster not yet healthy
Error: Validation failed: wait time exceeded during validation
2021/10/11 07:26:37 process.go:155: Step '/tmp/kops3643439122/kops validate cluster e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io --wait 15m' finished in 15m5.071894697s
2021/10/11 07:26:37 process.go:153: Running: kubectl -n kube-system get pods -ojson
2021/10/11 07:26:37 process.go:153: Running: /tmp/kops3643439122/kops toolbox dump --name e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io -ojson
I1011 07:26:37.529473    1018 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
2021/10/11 07:26:38 process.go:155: Step 'kubectl -n kube-system get pods -ojson' finished in 1.165179432s
2021/10/11 07:26:38 process.go:153: Running: kubectl -n kube-system logs --all-containers coredns-5dc785954d-j6wdf
... skipping 40 lines ...
2021/10/11 07:26:52 dump.go:413: Running SSH command: sudo cat /var/log/etcd.log
2021/10/11 07:26:53 dump.go:413: Running SSH command: sudo cat /var/log/etcd-events.log
2021/10/11 07:26:53 dump.go:413: Running SSH command: sudo cat /var/log/kube-proxy.log
2021/10/11 07:26:53 dump.go:413: Running SSH command: sudo cat /var/log/cloud-init-output.log
2021/10/11 07:26:53 dump.go:129: dumping node not registered in kubernetes: 35.156.111.139
2021/10/11 07:26:53 dump.go:163: Dumping node 35.156.111.139
2021/10/11 07:26:54 dump.go:132: error dumping node 35.156.111.139: could not connect: unable to SSH to "35.156.111.139": ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
2021/10/11 07:26:54 dump.go:129: dumping node not registered in kubernetes: 18.194.232.29
2021/10/11 07:26:54 dump.go:163: Dumping node 18.194.232.29
2021/10/11 07:26:55 dump.go:132: error dumping node 18.194.232.29: could not connect: unable to SSH to "18.194.232.29": ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
2021/10/11 07:26:55 dump.go:129: dumping node not registered in kubernetes: 18.184.112.183
2021/10/11 07:26:55 dump.go:163: Dumping node 18.184.112.183
2021/10/11 07:26:56 dump.go:132: error dumping node 18.184.112.183: could not connect: unable to SSH to "18.184.112.183": ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
2021/10/11 07:26:56 dump.go:129: dumping node not registered in kubernetes: 3.67.139.83
2021/10/11 07:26:56 dump.go:163: Dumping node 3.67.139.83
2021/10/11 07:26:56 dump.go:132: error dumping node 3.67.139.83: could not connect: unable to SSH to "3.67.139.83": ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
2021/10/11 07:26:56 process.go:153: Running: /tmp/kops3643439122/kops get clusters e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io
I1011 07:26:56.936116    1163 featureflag.go:166] FeatureFlag "SpecOverrideFlag"=true
NAME							CLOUD	ZONES
e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io	aws	eu-central-1b
2021/10/11 07:26:57 process.go:155: Step '/tmp/kops3643439122/kops get clusters e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io' finished in 481.338415ms
2021/10/11 07:26:57 process.go:153: Running: /tmp/kops3643439122/kops delete cluster e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io --yes
... skipping 198 lines ...
dhcp-options:dopt-0ecb997f41fbaaed5	ok
Deleted kubectl config for e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io

Deleted cluster: "e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io"
2021/10/11 07:28:28 process.go:155: Step '/tmp/kops3643439122/kops delete cluster e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io --yes' finished in 1m31.057031301s
2021/10/11 07:28:28 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2021/10/11 07:28:28 main.go:331: Something went wrong: starting e2e cluster: kops validate cluster failed: error during /tmp/kops3643439122/kops validate cluster e2e-kops-aws-k8s-storage-selinux.test-cncf-aws.k8s.io --wait 15m: exit status 1
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 723, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 569, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 228, in start
... skipping 9 lines ...