go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[SynchronizedBeforeSuite\]$'
test/e2e/e2e.go:249 k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:249 +0x4de k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 +0x8f reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbcfrom junit_01.xml
[SynchronizedBeforeSuite] TOP-LEVEL test/e2e/e2e.go:77 Dec 1 19:26:39.350: INFO: cluster-control-plane-node-image: cos-97-16919-103-16 Dec 1 19:26:39.350: INFO: cluster-worker-node-image: cos-97-16919-103-16 Dec 1 19:26:39.351: INFO: >>> kubeConfig: /workspace/.kube/config Dec 1 19:26:39.356: INFO: Waiting up to 30m0s for all (but 0) nodes to be schedulable Dec 1 19:26:39.538: INFO: Waiting up to 10m0s for all pods (need at least 8) in namespace 'kube-system' to be running and ready Dec 1 19:26:39.747: INFO: The status of Pod l7-default-backend-8549d69d99-qmmwd is Pending (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:26:39.748: INFO: 15 / 16 pods in namespace 'kube-system' are running and ready (0 seconds elapsed) Dec 1 19:26:39.748: INFO: expected 4 pod replicas in namespace 'kube-system', 2 are Running and Ready. Dec 1 19:26:39.748: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:26:39.749: INFO: l7-default-backend-8549d69d99-qmmwd ca-minion-group-fkwz Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:20 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:20 +0000 UTC ContainersNotReady containers with unready status: [default-http-backend]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:20 +0000 UTC ContainersNotReady containers with unready status: [default-http-backend]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:20 +0000 UTC }] Dec 1 19:26:39.754: INFO: Dec 1 19:26:41.917: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (2 seconds elapsed) Dec 1 19:26:41.918: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:26:41.919: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:26:41.919: INFO: Dec 1 19:26:43.922: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (4 seconds elapsed) Dec 1 19:26:43.922: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:26:43.922: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:26:43.922: INFO: Dec 1 19:26:45.911: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (6 seconds elapsed) Dec 1 19:26:45.911: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:26:45.911: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:26:45.911: INFO: Dec 1 19:26:47.903: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (8 seconds elapsed) Dec 1 19:26:47.903: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:26:47.904: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:26:47.904: INFO: Dec 1 19:26:49.920: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (10 seconds elapsed) Dec 1 19:26:49.921: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:26:49.923: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:26:49.923: INFO: Dec 1 19:26:51.908: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (12 seconds elapsed) Dec 1 19:26:51.908: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:26:51.908: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:26:51.908: INFO: Dec 1 19:26:53.905: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (14 seconds elapsed) Dec 1 19:26:53.905: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:26:53.905: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:26:53.905: INFO: Dec 1 19:26:55.956: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (16 seconds elapsed) Dec 1 19:26:55.956: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:26:55.956: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:26:55.956: INFO: Dec 1 19:26:57.907: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (18 seconds elapsed) Dec 1 19:26:57.907: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:26:57.907: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:26:57.907: INFO: Dec 1 19:26:59.905: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (20 seconds elapsed) Dec 1 19:26:59.905: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:26:59.905: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:26:59.905: INFO: Dec 1 19:27:01.910: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (22 seconds elapsed) Dec 1 19:27:01.912: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:01.913: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:01.914: INFO: Dec 1 19:27:03.905: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (24 seconds elapsed) Dec 1 19:27:03.905: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:03.905: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:03.905: INFO: Dec 1 19:27:05.905: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (26 seconds elapsed) Dec 1 19:27:05.905: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:05.905: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:05.905: INFO: Dec 1 19:27:07.903: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (28 seconds elapsed) Dec 1 19:27:07.903: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:07.903: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:07.903: INFO: Dec 1 19:27:09.910: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (30 seconds elapsed) Dec 1 19:27:09.910: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:09.910: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:09.910: INFO: Dec 1 19:27:11.907: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (32 seconds elapsed) Dec 1 19:27:11.907: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:11.907: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:11.907: INFO: Dec 1 19:27:13.903: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (34 seconds elapsed) Dec 1 19:27:13.905: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:13.905: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:13.905: INFO: Dec 1 19:27:15.904: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (36 seconds elapsed) Dec 1 19:27:15.905: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:15.905: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:15.905: INFO: Dec 1 19:27:17.924: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (38 seconds elapsed) Dec 1 19:27:17.924: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:17.924: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:17.924: INFO: Dec 1 19:27:19.909: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (40 seconds elapsed) Dec 1 19:27:19.909: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:19.909: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:19.909: INFO: Dec 1 19:27:21.905: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (42 seconds elapsed) Dec 1 19:27:21.905: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:21.906: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:21.906: INFO: Dec 1 19:27:23.902: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (44 seconds elapsed) Dec 1 19:27:23.902: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:23.902: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:23.902: INFO: Dec 1 19:27:25.900: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (46 seconds elapsed) Dec 1 19:27:25.900: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:25.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:25.900: INFO: Dec 1 19:27:27.902: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (48 seconds elapsed) Dec 1 19:27:27.902: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:27.902: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:27.902: INFO: Dec 1 19:27:29.904: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (50 seconds elapsed) Dec 1 19:27:29.905: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:29.905: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:29.905: INFO: Dec 1 19:27:31.900: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (52 seconds elapsed) Dec 1 19:27:31.900: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:31.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:31.900: INFO: Dec 1 19:27:33.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (54 seconds elapsed) Dec 1 19:27:33.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:33.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:33.899: INFO: Dec 1 19:27:35.907: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (56 seconds elapsed) Dec 1 19:27:35.908: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:35.908: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:35.909: INFO: Dec 1 19:27:37.901: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (58 seconds elapsed) Dec 1 19:27:37.901: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:37.901: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:37.901: INFO: Dec 1 19:27:39.902: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (60 seconds elapsed) Dec 1 19:27:39.902: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:39.902: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:39.902: INFO: Dec 1 19:27:41.900: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (62 seconds elapsed) Dec 1 19:27:41.900: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:41.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:41.900: INFO: Dec 1 19:27:43.901: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (64 seconds elapsed) Dec 1 19:27:43.901: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:43.901: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:43.901: INFO: Dec 1 19:27:45.902: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (66 seconds elapsed) Dec 1 19:27:45.902: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:45.902: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:45.902: INFO: Dec 1 19:27:47.905: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (68 seconds elapsed) Dec 1 19:27:47.905: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:47.905: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:47.905: INFO: Dec 1 19:27:49.907: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (70 seconds elapsed) Dec 1 19:27:49.907: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:49.907: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:49.907: INFO: Dec 1 19:27:51.904: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (72 seconds elapsed) Dec 1 19:27:51.904: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:51.904: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:51.904: INFO: Dec 1 19:27:53.909: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (74 seconds elapsed) Dec 1 19:27:53.909: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:53.909: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:53.909: INFO: Dec 1 19:27:55.918: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (76 seconds elapsed) Dec 1 19:27:55.919: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:55.919: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:55.919: INFO: Dec 1 19:27:57.902: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (78 seconds elapsed) Dec 1 19:27:57.902: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:57.902: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:57.902: INFO: Dec 1 19:27:59.907: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (80 seconds elapsed) Dec 1 19:27:59.907: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:27:59.907: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:27:59.907: INFO: Dec 1 19:28:01.958: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (82 seconds elapsed) Dec 1 19:28:01.958: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:01.958: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:01.958: INFO: Dec 1 19:28:03.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (84 seconds elapsed) Dec 1 19:28:03.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:03.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:03.899: INFO: Dec 1 19:28:05.903: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (86 seconds elapsed) Dec 1 19:28:05.903: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:05.904: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:05.904: INFO: Dec 1 19:28:07.916: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (88 seconds elapsed) Dec 1 19:28:07.918: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:07.920: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:07.920: INFO: Dec 1 19:28:09.911: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (90 seconds elapsed) Dec 1 19:28:09.913: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:09.913: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:09.913: INFO: Dec 1 19:28:11.900: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (92 seconds elapsed) Dec 1 19:28:11.900: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:11.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:11.900: INFO: Dec 1 19:28:13.910: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (94 seconds elapsed) Dec 1 19:28:13.911: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:13.912: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:13.913: INFO: Dec 1 19:28:15.900: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (96 seconds elapsed) Dec 1 19:28:15.900: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:15.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:15.900: INFO: Dec 1 19:28:17.903: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (98 seconds elapsed) Dec 1 19:28:17.903: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:17.903: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:17.903: INFO: Dec 1 19:28:19.907: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (100 seconds elapsed) Dec 1 19:28:19.908: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:19.908: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:19.908: INFO: Dec 1 19:28:21.901: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (102 seconds elapsed) Dec 1 19:28:21.902: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:21.902: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:21.902: INFO: Dec 1 19:28:23.903: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (104 seconds elapsed) Dec 1 19:28:23.904: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:23.905: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:23.905: INFO: Dec 1 19:28:25.904: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (106 seconds elapsed) Dec 1 19:28:25.904: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:25.905: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:25.905: INFO: Dec 1 19:28:27.905: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (108 seconds elapsed) Dec 1 19:28:27.906: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:27.906: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:27.906: INFO: Dec 1 19:28:29.911: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (110 seconds elapsed) Dec 1 19:28:29.912: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:29.912: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:29.912: INFO: Dec 1 19:28:31.902: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (112 seconds elapsed) Dec 1 19:28:31.902: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:31.902: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:31.902: INFO: Dec 1 19:28:33.900: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (114 seconds elapsed) Dec 1 19:28:33.900: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:33.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:33.900: INFO: Dec 1 19:28:35.904: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (116 seconds elapsed) Dec 1 19:28:35.905: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:35.905: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:35.905: INFO: Dec 1 19:28:37.901: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (118 seconds elapsed) Dec 1 19:28:37.901: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:37.901: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:37.901: INFO: Dec 1 19:28:39.906: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (120 seconds elapsed) Dec 1 19:28:39.906: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:39.906: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:39.906: INFO: Dec 1 19:28:41.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (122 seconds elapsed) Dec 1 19:28:41.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:41.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:41.899: INFO: Dec 1 19:28:43.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (124 seconds elapsed) Dec 1 19:28:43.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:43.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:43.900: INFO: Dec 1 19:28:45.901: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (126 seconds elapsed) Dec 1 19:28:45.901: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:45.901: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:45.901: INFO: Dec 1 19:28:47.905: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (128 seconds elapsed) Dec 1 19:28:47.905: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:47.906: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:47.906: INFO: Dec 1 19:28:49.912: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (130 seconds elapsed) Dec 1 19:28:49.912: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:49.912: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:49.912: INFO: Dec 1 19:28:51.904: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (132 seconds elapsed) Dec 1 19:28:51.904: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:51.904: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:51.904: INFO: Dec 1 19:28:53.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (134 seconds elapsed) Dec 1 19:28:53.901: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:53.901: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:53.901: INFO: Dec 1 19:28:55.901: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (136 seconds elapsed) Dec 1 19:28:55.901: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:55.901: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:55.901: INFO: Dec 1 19:28:57.894: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (138 seconds elapsed) Dec 1 19:28:57.894: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:57.894: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:57.895: INFO: Dec 1 19:28:59.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (140 seconds elapsed) Dec 1 19:28:59.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:28:59.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:28:59.898: INFO: Dec 1 19:29:01.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (142 seconds elapsed) Dec 1 19:29:01.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:01.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:01.896: INFO: Dec 1 19:29:03.893: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (144 seconds elapsed) Dec 1 19:29:03.893: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:03.893: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:03.893: INFO: Dec 1 19:29:05.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (146 seconds elapsed) Dec 1 19:29:05.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:05.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:05.899: INFO: Dec 1 19:29:07.926: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (148 seconds elapsed) Dec 1 19:29:07.926: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:07.926: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:07.926: INFO: Dec 1 19:29:09.901: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (150 seconds elapsed) Dec 1 19:29:09.901: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:09.901: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:09.901: INFO: Dec 1 19:29:11.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (152 seconds elapsed) Dec 1 19:29:11.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:11.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:11.896: INFO: Dec 1 19:29:13.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (154 seconds elapsed) Dec 1 19:29:13.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:13.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:13.899: INFO: Dec 1 19:29:15.901: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (156 seconds elapsed) Dec 1 19:29:15.901: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:15.901: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:15.901: INFO: Dec 1 19:29:17.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (158 seconds elapsed) Dec 1 19:29:17.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:17.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:17.896: INFO: Dec 1 19:29:19.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (160 seconds elapsed) Dec 1 19:29:19.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:19.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:19.899: INFO: Dec 1 19:29:21.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (162 seconds elapsed) Dec 1 19:29:21.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:21.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:21.896: INFO: Dec 1 19:29:23.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (164 seconds elapsed) Dec 1 19:29:23.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:23.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:23.895: INFO: Dec 1 19:29:25.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (166 seconds elapsed) Dec 1 19:29:25.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:25.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:25.897: INFO: Dec 1 19:29:27.894: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (168 seconds elapsed) Dec 1 19:29:27.894: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:27.894: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:27.894: INFO: Dec 1 19:29:29.902: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (170 seconds elapsed) Dec 1 19:29:29.902: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:29.902: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:29.902: INFO: Dec 1 19:29:31.903: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (172 seconds elapsed) Dec 1 19:29:31.903: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:31.903: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:31.903: INFO: Dec 1 19:29:33.903: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (174 seconds elapsed) Dec 1 19:29:33.903: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:33.903: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:33.903: INFO: Dec 1 19:29:35.904: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (176 seconds elapsed) Dec 1 19:29:35.905: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:35.905: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:35.906: INFO: Dec 1 19:29:37.900: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (178 seconds elapsed) Dec 1 19:29:37.900: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:37.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:37.900: INFO: Dec 1 19:29:39.903: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (180 seconds elapsed) Dec 1 19:29:39.903: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:39.903: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:39.903: INFO: Dec 1 19:29:41.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (182 seconds elapsed) Dec 1 19:29:41.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:41.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:41.898: INFO: Dec 1 19:29:43.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (184 seconds elapsed) Dec 1 19:29:43.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:43.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:43.896: INFO: Dec 1 19:29:45.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (186 seconds elapsed) Dec 1 19:29:45.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:45.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:45.895: INFO: Dec 1 19:29:47.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (188 seconds elapsed) Dec 1 19:29:47.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:47.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:47.897: INFO: Dec 1 19:29:49.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (190 seconds elapsed) Dec 1 19:29:49.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:49.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:49.899: INFO: Dec 1 19:29:51.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (192 seconds elapsed) Dec 1 19:29:51.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:51.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:51.895: INFO: Dec 1 19:29:53.907: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (194 seconds elapsed) Dec 1 19:29:53.907: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:53.908: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:53.908: INFO: Dec 1 19:29:55.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (196 seconds elapsed) Dec 1 19:29:55.900: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:55.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:55.900: INFO: Dec 1 19:29:57.894: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (198 seconds elapsed) Dec 1 19:29:57.894: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:57.894: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:57.894: INFO: Dec 1 19:29:59.930: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (200 seconds elapsed) Dec 1 19:29:59.930: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:29:59.930: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:29:59.930: INFO: Dec 1 19:30:01.900: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (202 seconds elapsed) Dec 1 19:30:01.900: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:01.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:01.900: INFO: Dec 1 19:30:03.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (204 seconds elapsed) Dec 1 19:30:03.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:03.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:03.897: INFO: Dec 1 19:30:05.902: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (206 seconds elapsed) Dec 1 19:30:05.902: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:05.902: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:05.902: INFO: Dec 1 19:30:07.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (208 seconds elapsed) Dec 1 19:30:07.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:07.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:07.898: INFO: Dec 1 19:30:09.908: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (210 seconds elapsed) Dec 1 19:30:09.908: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:09.908: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:09.908: INFO: Dec 1 19:30:11.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (212 seconds elapsed) Dec 1 19:30:11.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:11.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:11.897: INFO: Dec 1 19:30:13.959: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (214 seconds elapsed) Dec 1 19:30:13.959: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:13.959: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:13.959: INFO: Dec 1 19:30:15.915: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (216 seconds elapsed) Dec 1 19:30:15.915: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:15.915: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:15.915: INFO: Dec 1 19:30:17.910: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (218 seconds elapsed) Dec 1 19:30:17.910: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:17.910: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:17.910: INFO: Dec 1 19:30:19.913: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (220 seconds elapsed) Dec 1 19:30:19.913: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:19.913: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:19.913: INFO: Dec 1 19:30:21.902: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (222 seconds elapsed) Dec 1 19:30:21.902: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:21.902: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:21.902: INFO: Dec 1 19:30:23.906: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (224 seconds elapsed) Dec 1 19:30:23.906: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:23.906: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:23.906: INFO: Dec 1 19:30:25.917: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (226 seconds elapsed) Dec 1 19:30:25.917: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:25.917: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:25.917: INFO: Dec 1 19:30:27.905: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (228 seconds elapsed) Dec 1 19:30:27.905: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:27.905: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:27.905: INFO: Dec 1 19:30:29.911: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (230 seconds elapsed) Dec 1 19:30:29.912: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:29.912: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:29.912: INFO: Dec 1 19:30:31.900: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (232 seconds elapsed) Dec 1 19:30:31.900: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:31.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:31.900: INFO: Dec 1 19:30:33.904: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (234 seconds elapsed) Dec 1 19:30:33.904: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:33.904: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:33.904: INFO: Dec 1 19:30:35.909: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (236 seconds elapsed) Dec 1 19:30:35.909: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:35.909: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:35.909: INFO: Dec 1 19:30:37.901: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (238 seconds elapsed) Dec 1 19:30:37.901: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:37.901: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:37.901: INFO: Dec 1 19:30:39.905: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (240 seconds elapsed) Dec 1 19:30:39.905: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:39.905: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:39.905: INFO: Dec 1 19:30:41.904: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (242 seconds elapsed) Dec 1 19:30:41.904: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:41.904: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:41.904: INFO: Dec 1 19:30:43.900: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (244 seconds elapsed) Dec 1 19:30:43.900: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:43.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:43.900: INFO: Dec 1 19:30:45.907: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (246 seconds elapsed) Dec 1 19:30:45.907: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:45.907: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:45.907: INFO: Dec 1 19:30:47.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (248 seconds elapsed) Dec 1 19:30:47.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:47.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:47.897: INFO: Dec 1 19:30:49.905: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (250 seconds elapsed) Dec 1 19:30:49.905: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:49.905: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:49.905: INFO: Dec 1 19:30:51.909: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (252 seconds elapsed) Dec 1 19:30:51.909: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:51.909: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:51.909: INFO: Dec 1 19:30:53.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (254 seconds elapsed) Dec 1 19:30:53.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:53.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:53.898: INFO: Dec 1 19:30:55.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (256 seconds elapsed) Dec 1 19:30:55.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:55.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:55.895: INFO: Dec 1 19:30:57.894: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (258 seconds elapsed) Dec 1 19:30:57.894: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:57.894: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:57.894: INFO: Dec 1 19:30:59.911: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (260 seconds elapsed) Dec 1 19:30:59.911: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:30:59.911: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:30:59.912: INFO: Dec 1 19:31:01.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (262 seconds elapsed) Dec 1 19:31:01.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:01.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:01.899: INFO: Dec 1 19:31:03.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (264 seconds elapsed) Dec 1 19:31:03.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:03.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:03.896: INFO: Dec 1 19:31:05.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (266 seconds elapsed) Dec 1 19:31:05.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:05.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:05.895: INFO: Dec 1 19:31:07.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (268 seconds elapsed) Dec 1 19:31:07.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:07.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:07.895: INFO: Dec 1 19:31:09.905: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (270 seconds elapsed) Dec 1 19:31:09.905: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:09.905: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:09.905: INFO: Dec 1 19:31:11.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (272 seconds elapsed) Dec 1 19:31:11.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:11.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:11.896: INFO: Dec 1 19:31:13.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (274 seconds elapsed) Dec 1 19:31:13.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:13.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:13.899: INFO: Dec 1 19:31:15.901: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (276 seconds elapsed) Dec 1 19:31:15.902: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:15.902: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:15.902: INFO: Dec 1 19:31:17.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (278 seconds elapsed) Dec 1 19:31:17.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:17.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:17.895: INFO: ------------------------------ Automatically polling progress: In [SynchronizedBeforeSuite] (Node Runtime: 5m0.001s) test/e2e/e2e.go:77 Spec Goroutine goroutine 137 [select] k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc00013c000}, 0xc0006d5cb0, 0x2fdb16a?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc00013c000}, 0xc0?, 0x2fd9d05?, 0x88?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc00013c000}, 0x75b521a?, 0xc00337d310?, 0x262a967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x75b6f82?, 0x4?, 0x778e9c2?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 > k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodsRunningReady({0x801de88?, 0xc000e949c0}, {0x75ce977, 0xb}, 0x8, 0x0, 0x73677261636e7566?, 0xc003a23a40) test/e2e/framework/pod/wait.go:198 > k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:246 > k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractSynchronizedBeforeSuiteProc1Body.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:472 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runSuiteNode.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/suite.go:555 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 1 [chan receive, 5 minutes] testing.(*T).Run(0xc0009fc4e0, {0x75bea0a?, 0x2755a25?}, 0x78952c8) /usr/local/go/src/testing/testing.go:1494 testing.runTests.func1(0xc0009fc4e0?) /usr/local/go/src/testing/testing.go:1846 testing.tRunner(0xc0009fc4e0, 0xc00121f7f0) /usr/local/go/src/testing/testing.go:1446 testing.runTests(0xc000bbcaa0?, {0xac3b7e0, 0x1, 0x1}, {0x0?, 0xf45d27d13bdefcb0?, 0x0?}) /usr/local/go/src/testing/testing.go:1844 testing.(*M).Run(0xc000bbcaa0) /usr/local/go/src/testing/testing.go:1726 > k8s.io/kubernetes/test/e2e.TestMain(0xffffffffffffffff?) test/e2e/e2e_test.go:142 main.main() /tmp.k8s/go-build4026029738/b001/_testmain.go:49 ------------------------------ Dec 1 19:31:19.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (280 seconds elapsed) Dec 1 19:31:19.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:19.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:19.897: INFO: Dec 1 19:31:21.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (282 seconds elapsed) Dec 1 19:31:21.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:21.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:21.898: INFO: Dec 1 19:31:23.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (284 seconds elapsed) Dec 1 19:31:23.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:23.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:23.895: INFO: Dec 1 19:31:25.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (286 seconds elapsed) Dec 1 19:31:25.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:25.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:25.898: INFO: Dec 1 19:31:27.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (288 seconds elapsed) Dec 1 19:31:27.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:27.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:27.899: INFO: Dec 1 19:31:29.900: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (290 seconds elapsed) Dec 1 19:31:29.900: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:29.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:29.900: INFO: Dec 1 19:31:31.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (292 seconds elapsed) Dec 1 19:31:31.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:31.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:31.897: INFO: Dec 1 19:31:33.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (294 seconds elapsed) Dec 1 19:31:33.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:33.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:33.896: INFO: Dec 1 19:31:35.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (296 seconds elapsed) Dec 1 19:31:35.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:35.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:35.896: INFO: Dec 1 19:31:37.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (298 seconds elapsed) Dec 1 19:31:37.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:37.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:37.895: INFO: ------------------------------ Automatically polling progress: In [SynchronizedBeforeSuite] (Node Runtime: 5m20.002s) test/e2e/e2e.go:77 Spec Goroutine goroutine 137 [select] k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc00013c000}, 0xc0006d5cb0, 0x2fdb16a?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc00013c000}, 0xc0?, 0x2fd9d05?, 0x88?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc00013c000}, 0x75b521a?, 0xc00337d310?, 0x262a967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x75b6f82?, 0x4?, 0x778e9c2?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 > k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodsRunningReady({0x801de88?, 0xc000e949c0}, {0x75ce977, 0xb}, 0x8, 0x0, 0x73677261636e7566?, 0xc003a23a40) test/e2e/framework/pod/wait.go:198 > k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:246 > k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractSynchronizedBeforeSuiteProc1Body.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:472 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runSuiteNode.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/suite.go:555 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 1 [chan receive, 5 minutes] testing.(*T).Run(0xc0009fc4e0, {0x75bea0a?, 0x2755a25?}, 0x78952c8) /usr/local/go/src/testing/testing.go:1494 testing.runTests.func1(0xc0009fc4e0?) /usr/local/go/src/testing/testing.go:1846 testing.tRunner(0xc0009fc4e0, 0xc00121f7f0) /usr/local/go/src/testing/testing.go:1446 testing.runTests(0xc000bbcaa0?, {0xac3b7e0, 0x1, 0x1}, {0x0?, 0xf45d27d13bdefcb0?, 0x0?}) /usr/local/go/src/testing/testing.go:1844 testing.(*M).Run(0xc000bbcaa0) /usr/local/go/src/testing/testing.go:1726 > k8s.io/kubernetes/test/e2e.TestMain(0xffffffffffffffff?) test/e2e/e2e_test.go:142 main.main() /tmp.k8s/go-build4026029738/b001/_testmain.go:49 ------------------------------ Dec 1 19:31:39.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (300 seconds elapsed) Dec 1 19:31:39.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:39.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:39.899: INFO: Dec 1 19:31:41.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (302 seconds elapsed) Dec 1 19:31:41.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:41.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:41.898: INFO: Dec 1 19:31:43.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (304 seconds elapsed) Dec 1 19:31:43.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:43.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:43.897: INFO: Dec 1 19:31:45.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (306 seconds elapsed) Dec 1 19:31:45.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:45.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:45.896: INFO: Dec 1 19:31:47.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (308 seconds elapsed) Dec 1 19:31:47.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:47.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:47.898: INFO: Dec 1 19:31:49.907: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (310 seconds elapsed) Dec 1 19:31:49.907: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:49.907: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:49.907: INFO: Dec 1 19:31:51.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (312 seconds elapsed) Dec 1 19:31:51.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:51.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:51.897: INFO: Dec 1 19:31:53.907: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (314 seconds elapsed) Dec 1 19:31:53.908: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:53.908: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:53.908: INFO: Dec 1 19:31:55.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (316 seconds elapsed) Dec 1 19:31:55.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:55.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:55.898: INFO: Dec 1 19:31:57.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (318 seconds elapsed) Dec 1 19:31:57.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:57.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:57.896: INFO: ------------------------------ Automatically polling progress: In [SynchronizedBeforeSuite] (Node Runtime: 5m40.004s) test/e2e/e2e.go:77 Spec Goroutine goroutine 137 [select] k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc00013c000}, 0xc0006d5cb0, 0x2fdb16a?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc00013c000}, 0xc0?, 0x2fd9d05?, 0x88?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc00013c000}, 0x75b521a?, 0xc00337d310?, 0x262a967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x75b6f82?, 0x4?, 0x778e9c2?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 > k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodsRunningReady({0x801de88?, 0xc000e949c0}, {0x75ce977, 0xb}, 0x8, 0x0, 0x73677261636e7566?, 0xc003a23a40) test/e2e/framework/pod/wait.go:198 > k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:246 > k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractSynchronizedBeforeSuiteProc1Body.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:472 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runSuiteNode.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/suite.go:555 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 1 [chan receive, 5 minutes] testing.(*T).Run(0xc0009fc4e0, {0x75bea0a?, 0x2755a25?}, 0x78952c8) /usr/local/go/src/testing/testing.go:1494 testing.runTests.func1(0xc0009fc4e0?) /usr/local/go/src/testing/testing.go:1846 testing.tRunner(0xc0009fc4e0, 0xc00121f7f0) /usr/local/go/src/testing/testing.go:1446 testing.runTests(0xc000bbcaa0?, {0xac3b7e0, 0x1, 0x1}, {0x0?, 0xf45d27d13bdefcb0?, 0x0?}) /usr/local/go/src/testing/testing.go:1844 testing.(*M).Run(0xc000bbcaa0) /usr/local/go/src/testing/testing.go:1726 > k8s.io/kubernetes/test/e2e.TestMain(0xffffffffffffffff?) test/e2e/e2e_test.go:142 main.main() /tmp.k8s/go-build4026029738/b001/_testmain.go:49 ------------------------------ Dec 1 19:31:59.903: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (320 seconds elapsed) Dec 1 19:31:59.903: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:31:59.903: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:31:59.903: INFO: Dec 1 19:32:01.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (322 seconds elapsed) Dec 1 19:32:01.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:01.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:01.897: INFO: Dec 1 19:32:03.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (324 seconds elapsed) Dec 1 19:32:03.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:03.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:03.895: INFO: Dec 1 19:32:05.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (326 seconds elapsed) Dec 1 19:32:05.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:05.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:05.897: INFO: Dec 1 19:32:07.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (328 seconds elapsed) Dec 1 19:32:07.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:07.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:07.895: INFO: Dec 1 19:32:09.904: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (330 seconds elapsed) Dec 1 19:32:09.904: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:09.904: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:09.904: INFO: Dec 1 19:32:11.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (332 seconds elapsed) Dec 1 19:32:11.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:11.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:11.896: INFO: Dec 1 19:32:13.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (334 seconds elapsed) Dec 1 19:32:13.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:13.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:13.897: INFO: Dec 1 19:32:15.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (336 seconds elapsed) Dec 1 19:32:15.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:15.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:15.895: INFO: Dec 1 19:32:17.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (338 seconds elapsed) Dec 1 19:32:17.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:17.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:17.898: INFO: ------------------------------ Automatically polling progress: In [SynchronizedBeforeSuite] (Node Runtime: 6m0.005s) test/e2e/e2e.go:77 Spec Goroutine goroutine 137 [select] k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc00013c000}, 0xc0006d5cb0, 0x2fdb16a?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc00013c000}, 0xc0?, 0x2fd9d05?, 0x88?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc00013c000}, 0x75b521a?, 0xc00337d310?, 0x262a967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x75b6f82?, 0x4?, 0x778e9c2?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 > k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodsRunningReady({0x801de88?, 0xc000e949c0}, {0x75ce977, 0xb}, 0x8, 0x0, 0x73677261636e7566?, 0xc003a23a40) test/e2e/framework/pod/wait.go:198 > k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:246 > k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractSynchronizedBeforeSuiteProc1Body.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:472 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runSuiteNode.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/suite.go:555 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 1 [chan receive, 6 minutes] testing.(*T).Run(0xc0009fc4e0, {0x75bea0a?, 0x2755a25?}, 0x78952c8) /usr/local/go/src/testing/testing.go:1494 testing.runTests.func1(0xc0009fc4e0?) /usr/local/go/src/testing/testing.go:1846 testing.tRunner(0xc0009fc4e0, 0xc00121f7f0) /usr/local/go/src/testing/testing.go:1446 testing.runTests(0xc000bbcaa0?, {0xac3b7e0, 0x1, 0x1}, {0x0?, 0xf45d27d13bdefcb0?, 0x0?}) /usr/local/go/src/testing/testing.go:1844 testing.(*M).Run(0xc000bbcaa0) /usr/local/go/src/testing/testing.go:1726 > k8s.io/kubernetes/test/e2e.TestMain(0xffffffffffffffff?) test/e2e/e2e_test.go:142 main.main() /tmp.k8s/go-build4026029738/b001/_testmain.go:49 ------------------------------ Dec 1 19:32:19.903: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (340 seconds elapsed) Dec 1 19:32:19.903: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:19.903: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:19.903: INFO: Dec 1 19:32:21.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (342 seconds elapsed) Dec 1 19:32:21.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:21.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:21.898: INFO: Dec 1 19:32:23.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (344 seconds elapsed) Dec 1 19:32:23.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:23.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:23.899: INFO: Dec 1 19:32:25.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (346 seconds elapsed) Dec 1 19:32:25.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:25.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:25.896: INFO: Dec 1 19:32:27.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (348 seconds elapsed) Dec 1 19:32:27.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:27.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:27.896: INFO: Dec 1 19:32:29.903: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (350 seconds elapsed) Dec 1 19:32:29.903: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:29.903: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:29.903: INFO: Dec 1 19:32:31.913: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (352 seconds elapsed) Dec 1 19:32:31.913: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:31.913: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:31.913: INFO: Dec 1 19:32:33.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (354 seconds elapsed) Dec 1 19:32:33.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:33.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:33.899: INFO: Dec 1 19:32:35.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (356 seconds elapsed) Dec 1 19:32:35.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:35.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:35.895: INFO: Dec 1 19:32:37.901: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (358 seconds elapsed) Dec 1 19:32:37.901: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:37.901: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:37.901: INFO: ------------------------------ Automatically polling progress: In [SynchronizedBeforeSuite] (Node Runtime: 6m20.006s) test/e2e/e2e.go:77 Spec Goroutine goroutine 137 [select] k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc00013c000}, 0xc0006d5cb0, 0x2fdb16a?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc00013c000}, 0xc0?, 0x2fd9d05?, 0x88?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc00013c000}, 0x75b521a?, 0xc00337d310?, 0x262a967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x75b6f82?, 0x4?, 0x778e9c2?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 > k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodsRunningReady({0x801de88?, 0xc000e949c0}, {0x75ce977, 0xb}, 0x8, 0x0, 0x73677261636e7566?, 0xc003a23a40) test/e2e/framework/pod/wait.go:198 > k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:246 > k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractSynchronizedBeforeSuiteProc1Body.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:472 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runSuiteNode.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/suite.go:555 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 1 [chan receive, 6 minutes] testing.(*T).Run(0xc0009fc4e0, {0x75bea0a?, 0x2755a25?}, 0x78952c8) /usr/local/go/src/testing/testing.go:1494 testing.runTests.func1(0xc0009fc4e0?) /usr/local/go/src/testing/testing.go:1846 testing.tRunner(0xc0009fc4e0, 0xc00121f7f0) /usr/local/go/src/testing/testing.go:1446 testing.runTests(0xc000bbcaa0?, {0xac3b7e0, 0x1, 0x1}, {0x0?, 0xf45d27d13bdefcb0?, 0x0?}) /usr/local/go/src/testing/testing.go:1844 testing.(*M).Run(0xc000bbcaa0) /usr/local/go/src/testing/testing.go:1726 > k8s.io/kubernetes/test/e2e.TestMain(0xffffffffffffffff?) test/e2e/e2e_test.go:142 main.main() /tmp.k8s/go-build4026029738/b001/_testmain.go:49 ------------------------------ Dec 1 19:32:39.902: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (360 seconds elapsed) Dec 1 19:32:39.902: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:39.902: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:39.902: INFO: Dec 1 19:32:41.916: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (362 seconds elapsed) Dec 1 19:32:41.916: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:41.916: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:41.916: INFO: Dec 1 19:32:43.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (364 seconds elapsed) Dec 1 19:32:43.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:43.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:43.896: INFO: Dec 1 19:32:45.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (366 seconds elapsed) Dec 1 19:32:45.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:45.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:45.898: INFO: Dec 1 19:32:47.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (368 seconds elapsed) Dec 1 19:32:47.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:47.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:47.898: INFO: Dec 1 19:32:49.901: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (370 seconds elapsed) Dec 1 19:32:49.901: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:49.901: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:49.901: INFO: Dec 1 19:32:51.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (372 seconds elapsed) Dec 1 19:32:51.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:51.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:51.898: INFO: Dec 1 19:32:53.923: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (374 seconds elapsed) Dec 1 19:32:53.923: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:53.923: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:53.923: INFO: Dec 1 19:32:55.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (376 seconds elapsed) Dec 1 19:32:55.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:55.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:55.895: INFO: Dec 1 19:32:57.894: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (378 seconds elapsed) Dec 1 19:32:57.894: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:57.894: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:57.894: INFO: ------------------------------ Automatically polling progress: In [SynchronizedBeforeSuite] (Node Runtime: 6m40.007s) test/e2e/e2e.go:77 Spec Goroutine goroutine 137 [select] k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc00013c000}, 0xc0006d5cb0, 0x2fdb16a?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc00013c000}, 0xc0?, 0x2fd9d05?, 0x88?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc00013c000}, 0x75b521a?, 0xc00337d310?, 0x262a967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x75b6f82?, 0x4?, 0x778e9c2?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 > k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodsRunningReady({0x801de88?, 0xc000e949c0}, {0x75ce977, 0xb}, 0x8, 0x0, 0x73677261636e7566?, 0xc003a23a40) test/e2e/framework/pod/wait.go:198 > k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:246 > k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractSynchronizedBeforeSuiteProc1Body.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:472 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runSuiteNode.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/suite.go:555 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 1 [chan receive, 6 minutes] testing.(*T).Run(0xc0009fc4e0, {0x75bea0a?, 0x2755a25?}, 0x78952c8) /usr/local/go/src/testing/testing.go:1494 testing.runTests.func1(0xc0009fc4e0?) /usr/local/go/src/testing/testing.go:1846 testing.tRunner(0xc0009fc4e0, 0xc00121f7f0) /usr/local/go/src/testing/testing.go:1446 testing.runTests(0xc000bbcaa0?, {0xac3b7e0, 0x1, 0x1}, {0x0?, 0xf45d27d13bdefcb0?, 0x0?}) /usr/local/go/src/testing/testing.go:1844 testing.(*M).Run(0xc000bbcaa0) /usr/local/go/src/testing/testing.go:1726 > k8s.io/kubernetes/test/e2e.TestMain(0xffffffffffffffff?) test/e2e/e2e_test.go:142 main.main() /tmp.k8s/go-build4026029738/b001/_testmain.go:49 ------------------------------ Dec 1 19:32:59.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (380 seconds elapsed) Dec 1 19:32:59.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:32:59.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:32:59.899: INFO: Dec 1 19:33:01.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (382 seconds elapsed) Dec 1 19:33:01.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:01.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:01.897: INFO: Dec 1 19:33:03.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (384 seconds elapsed) Dec 1 19:33:03.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:03.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:03.898: INFO: Dec 1 19:33:05.900: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (386 seconds elapsed) Dec 1 19:33:05.901: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:05.901: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:05.901: INFO: Dec 1 19:33:07.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (388 seconds elapsed) Dec 1 19:33:07.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:07.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:07.899: INFO: Dec 1 19:33:09.903: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (390 seconds elapsed) Dec 1 19:33:09.903: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:09.903: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:09.903: INFO: Dec 1 19:33:11.904: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (392 seconds elapsed) Dec 1 19:33:11.905: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:11.905: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:11.905: INFO: Dec 1 19:33:13.902: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (394 seconds elapsed) Dec 1 19:33:13.902: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:13.902: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:13.902: INFO: Dec 1 19:33:15.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (396 seconds elapsed) Dec 1 19:33:15.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:15.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:15.898: INFO: Dec 1 19:33:17.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (398 seconds elapsed) Dec 1 19:33:17.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:17.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:17.895: INFO: ------------------------------ Automatically polling progress: In [SynchronizedBeforeSuite] (Node Runtime: 7m0.008s) test/e2e/e2e.go:77 Spec Goroutine goroutine 137 [select] k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc00013c000}, 0xc0006d5cb0, 0x2fdb16a?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc00013c000}, 0xc0?, 0x2fd9d05?, 0x88?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc00013c000}, 0x75b521a?, 0xc00337d310?, 0x262a967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x75b6f82?, 0x4?, 0x778e9c2?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 > k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodsRunningReady({0x801de88?, 0xc000e949c0}, {0x75ce977, 0xb}, 0x8, 0x0, 0x73677261636e7566?, 0xc003a23a40) test/e2e/framework/pod/wait.go:198 > k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:246 > k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractSynchronizedBeforeSuiteProc1Body.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:472 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runSuiteNode.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/suite.go:555 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 1 [chan receive, 7 minutes] testing.(*T).Run(0xc0009fc4e0, {0x75bea0a?, 0x2755a25?}, 0x78952c8) /usr/local/go/src/testing/testing.go:1494 testing.runTests.func1(0xc0009fc4e0?) /usr/local/go/src/testing/testing.go:1846 testing.tRunner(0xc0009fc4e0, 0xc00121f7f0) /usr/local/go/src/testing/testing.go:1446 testing.runTests(0xc000bbcaa0?, {0xac3b7e0, 0x1, 0x1}, {0x0?, 0xf45d27d13bdefcb0?, 0x0?}) /usr/local/go/src/testing/testing.go:1844 testing.(*M).Run(0xc000bbcaa0) /usr/local/go/src/testing/testing.go:1726 > k8s.io/kubernetes/test/e2e.TestMain(0xffffffffffffffff?) test/e2e/e2e_test.go:142 main.main() /tmp.k8s/go-build4026029738/b001/_testmain.go:49 ------------------------------ Dec 1 19:33:19.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (400 seconds elapsed) Dec 1 19:33:19.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:19.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:19.899: INFO: Dec 1 19:33:21.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (402 seconds elapsed) Dec 1 19:33:21.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:21.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:21.896: INFO: Dec 1 19:33:23.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (404 seconds elapsed) Dec 1 19:33:23.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:23.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:23.895: INFO: Dec 1 19:33:25.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (406 seconds elapsed) Dec 1 19:33:25.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:25.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:25.896: INFO: Dec 1 19:33:27.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (408 seconds elapsed) Dec 1 19:33:27.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:27.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:27.899: INFO: Dec 1 19:33:29.903: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (410 seconds elapsed) Dec 1 19:33:29.903: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:29.903: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:29.903: INFO: Dec 1 19:33:31.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (412 seconds elapsed) Dec 1 19:33:31.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:31.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:31.899: INFO: Dec 1 19:33:33.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (414 seconds elapsed) Dec 1 19:33:33.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:33.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:33.896: INFO: Dec 1 19:33:35.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (416 seconds elapsed) Dec 1 19:33:35.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:35.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:35.896: INFO: Dec 1 19:33:37.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (418 seconds elapsed) Dec 1 19:33:37.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:37.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:37.895: INFO: ------------------------------ Automatically polling progress: In [SynchronizedBeforeSuite] (Node Runtime: 7m20.01s) test/e2e/e2e.go:77 Spec Goroutine goroutine 137 [select] k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc00013c000}, 0xc0006d5cb0, 0x2fdb16a?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc00013c000}, 0xc0?, 0x2fd9d05?, 0x88?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc00013c000}, 0x75b521a?, 0xc00337d310?, 0x262a967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x75b6f82?, 0x4?, 0x778e9c2?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 > k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodsRunningReady({0x801de88?, 0xc000e949c0}, {0x75ce977, 0xb}, 0x8, 0x0, 0x73677261636e7566?, 0xc003a23a40) test/e2e/framework/pod/wait.go:198 > k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:246 > k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractSynchronizedBeforeSuiteProc1Body.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:472 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runSuiteNode.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/suite.go:555 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 1 [chan receive, 7 minutes] testing.(*T).Run(0xc0009fc4e0, {0x75bea0a?, 0x2755a25?}, 0x78952c8) /usr/local/go/src/testing/testing.go:1494 testing.runTests.func1(0xc0009fc4e0?) /usr/local/go/src/testing/testing.go:1846 testing.tRunner(0xc0009fc4e0, 0xc00121f7f0) /usr/local/go/src/testing/testing.go:1446 testing.runTests(0xc000bbcaa0?, {0xac3b7e0, 0x1, 0x1}, {0x0?, 0xf45d27d13bdefcb0?, 0x0?}) /usr/local/go/src/testing/testing.go:1844 testing.(*M).Run(0xc000bbcaa0) /usr/local/go/src/testing/testing.go:1726 > k8s.io/kubernetes/test/e2e.TestMain(0xffffffffffffffff?) test/e2e/e2e_test.go:142 main.main() /tmp.k8s/go-build4026029738/b001/_testmain.go:49 ------------------------------ Dec 1 19:33:39.900: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (420 seconds elapsed) Dec 1 19:33:39.900: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:39.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:39.900: INFO: Dec 1 19:33:41.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (422 seconds elapsed) Dec 1 19:33:41.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:41.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:41.898: INFO: Dec 1 19:33:43.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (424 seconds elapsed) Dec 1 19:33:43.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:43.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:43.899: INFO: Dec 1 19:33:45.907: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (426 seconds elapsed) Dec 1 19:33:45.907: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:45.907: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:45.907: INFO: Dec 1 19:33:47.894: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (428 seconds elapsed) Dec 1 19:33:47.894: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:47.894: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:47.894: INFO: Dec 1 19:33:49.901: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (430 seconds elapsed) Dec 1 19:33:49.901: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:49.901: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:49.901: INFO: Dec 1 19:33:51.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (432 seconds elapsed) Dec 1 19:33:51.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:51.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:51.898: INFO: Dec 1 19:33:53.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (434 seconds elapsed) Dec 1 19:33:53.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:53.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:53.898: INFO: Dec 1 19:33:55.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (436 seconds elapsed) Dec 1 19:33:55.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:55.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:55.895: INFO: Dec 1 19:33:57.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (438 seconds elapsed) Dec 1 19:33:57.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:57.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:57.895: INFO: ------------------------------ Automatically polling progress: In [SynchronizedBeforeSuite] (Node Runtime: 7m40.011s) test/e2e/e2e.go:77 Spec Goroutine goroutine 137 [select] k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc00013c000}, 0xc0006d5cb0, 0x2fdb16a?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc00013c000}, 0xc0?, 0x2fd9d05?, 0x88?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc00013c000}, 0x75b521a?, 0xc00337d310?, 0x262a967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x75b6f82?, 0x4?, 0x778e9c2?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 > k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodsRunningReady({0x801de88?, 0xc000e949c0}, {0x75ce977, 0xb}, 0x8, 0x0, 0x73677261636e7566?, 0xc003a23a40) test/e2e/framework/pod/wait.go:198 > k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:246 > k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractSynchronizedBeforeSuiteProc1Body.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:472 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runSuiteNode.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/suite.go:555 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 1 [chan receive, 7 minutes] testing.(*T).Run(0xc0009fc4e0, {0x75bea0a?, 0x2755a25?}, 0x78952c8) /usr/local/go/src/testing/testing.go:1494 testing.runTests.func1(0xc0009fc4e0?) /usr/local/go/src/testing/testing.go:1846 testing.tRunner(0xc0009fc4e0, 0xc00121f7f0) /usr/local/go/src/testing/testing.go:1446 testing.runTests(0xc000bbcaa0?, {0xac3b7e0, 0x1, 0x1}, {0x0?, 0xf45d27d13bdefcb0?, 0x0?}) /usr/local/go/src/testing/testing.go:1844 testing.(*M).Run(0xc000bbcaa0) /usr/local/go/src/testing/testing.go:1726 > k8s.io/kubernetes/test/e2e.TestMain(0xffffffffffffffff?) test/e2e/e2e_test.go:142 main.main() /tmp.k8s/go-build4026029738/b001/_testmain.go:49 ------------------------------ Dec 1 19:33:59.902: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (440 seconds elapsed) Dec 1 19:33:59.902: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:33:59.902: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:33:59.902: INFO: Dec 1 19:34:01.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (442 seconds elapsed) Dec 1 19:34:01.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:01.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:01.897: INFO: Dec 1 19:34:03.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (444 seconds elapsed) Dec 1 19:34:03.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:03.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:03.896: INFO: Dec 1 19:34:05.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (446 seconds elapsed) Dec 1 19:34:05.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:05.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:05.896: INFO: Dec 1 19:34:07.894: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (448 seconds elapsed) Dec 1 19:34:07.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:07.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:07.895: INFO: Dec 1 19:34:09.904: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (450 seconds elapsed) Dec 1 19:34:09.904: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:09.904: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:09.904: INFO: Dec 1 19:34:11.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (452 seconds elapsed) Dec 1 19:34:11.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:11.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:11.899: INFO: Dec 1 19:34:13.905: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (454 seconds elapsed) Dec 1 19:34:13.905: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:13.906: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:13.906: INFO: Dec 1 19:34:15.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (456 seconds elapsed) Dec 1 19:34:15.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:15.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:15.897: INFO: Dec 1 19:34:17.894: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (458 seconds elapsed) Dec 1 19:34:17.894: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:17.894: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:17.894: INFO: ------------------------------ Automatically polling progress: In [SynchronizedBeforeSuite] (Node Runtime: 8m0.013s) test/e2e/e2e.go:77 Spec Goroutine goroutine 137 [select] k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc00013c000}, 0xc0006d5cb0, 0x2fdb16a?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc00013c000}, 0xc0?, 0x2fd9d05?, 0x88?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc00013c000}, 0x75b521a?, 0xc00337d310?, 0x262a967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x75b6f82?, 0x4?, 0x778e9c2?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 > k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodsRunningReady({0x801de88?, 0xc000e949c0}, {0x75ce977, 0xb}, 0x8, 0x0, 0x73677261636e7566?, 0xc003a23a40) test/e2e/framework/pod/wait.go:198 > k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:246 > k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractSynchronizedBeforeSuiteProc1Body.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:472 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runSuiteNode.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/suite.go:555 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 1 [chan receive, 8 minutes] testing.(*T).Run(0xc0009fc4e0, {0x75bea0a?, 0x2755a25?}, 0x78952c8) /usr/local/go/src/testing/testing.go:1494 testing.runTests.func1(0xc0009fc4e0?) /usr/local/go/src/testing/testing.go:1846 testing.tRunner(0xc0009fc4e0, 0xc00121f7f0) /usr/local/go/src/testing/testing.go:1446 testing.runTests(0xc000bbcaa0?, {0xac3b7e0, 0x1, 0x1}, {0x0?, 0xf45d27d13bdefcb0?, 0x0?}) /usr/local/go/src/testing/testing.go:1844 testing.(*M).Run(0xc000bbcaa0) /usr/local/go/src/testing/testing.go:1726 > k8s.io/kubernetes/test/e2e.TestMain(0xffffffffffffffff?) test/e2e/e2e_test.go:142 main.main() /tmp.k8s/go-build4026029738/b001/_testmain.go:49 ------------------------------ Dec 1 19:34:19.900: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (460 seconds elapsed) Dec 1 19:34:19.900: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:19.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:19.900: INFO: Dec 1 19:34:21.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (462 seconds elapsed) Dec 1 19:34:21.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:21.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:21.898: INFO: Dec 1 19:34:23.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (464 seconds elapsed) Dec 1 19:34:23.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:23.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:23.897: INFO: Dec 1 19:34:25.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (466 seconds elapsed) Dec 1 19:34:25.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:25.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:25.898: INFO: Dec 1 19:34:27.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (468 seconds elapsed) Dec 1 19:34:27.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:27.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:27.899: INFO: Dec 1 19:34:29.905: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (470 seconds elapsed) Dec 1 19:34:29.906: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:29.906: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:29.906: INFO: Dec 1 19:34:31.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (472 seconds elapsed) Dec 1 19:34:31.900: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:31.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:31.900: INFO: Dec 1 19:34:33.900: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (474 seconds elapsed) Dec 1 19:34:33.901: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:33.901: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:33.901: INFO: Dec 1 19:34:35.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (476 seconds elapsed) Dec 1 19:34:35.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:35.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:35.897: INFO: Dec 1 19:34:37.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (478 seconds elapsed) Dec 1 19:34:37.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:37.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:37.896: INFO: ------------------------------ Automatically polling progress: In [SynchronizedBeforeSuite] (Node Runtime: 8m20.014s) test/e2e/e2e.go:77 Spec Goroutine goroutine 137 [select] k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc00013c000}, 0xc0006d5cb0, 0x2fdb16a?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc00013c000}, 0xc0?, 0x2fd9d05?, 0x88?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc00013c000}, 0x75b521a?, 0xc00337d310?, 0x262a967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x75b6f82?, 0x4?, 0x778e9c2?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 > k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodsRunningReady({0x801de88?, 0xc000e949c0}, {0x75ce977, 0xb}, 0x8, 0x0, 0x73677261636e7566?, 0xc003a23a40) test/e2e/framework/pod/wait.go:198 > k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:246 > k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractSynchronizedBeforeSuiteProc1Body.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:472 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runSuiteNode.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/suite.go:555 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 1 [chan receive, 8 minutes] testing.(*T).Run(0xc0009fc4e0, {0x75bea0a?, 0x2755a25?}, 0x78952c8) /usr/local/go/src/testing/testing.go:1494 testing.runTests.func1(0xc0009fc4e0?) /usr/local/go/src/testing/testing.go:1846 testing.tRunner(0xc0009fc4e0, 0xc00121f7f0) /usr/local/go/src/testing/testing.go:1446 testing.runTests(0xc000bbcaa0?, {0xac3b7e0, 0x1, 0x1}, {0x0?, 0xf45d27d13bdefcb0?, 0x0?}) /usr/local/go/src/testing/testing.go:1844 testing.(*M).Run(0xc000bbcaa0) /usr/local/go/src/testing/testing.go:1726 > k8s.io/kubernetes/test/e2e.TestMain(0xffffffffffffffff?) test/e2e/e2e_test.go:142 main.main() /tmp.k8s/go-build4026029738/b001/_testmain.go:49 ------------------------------ Dec 1 19:34:39.902: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (480 seconds elapsed) Dec 1 19:34:39.902: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:39.902: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:39.902: INFO: Dec 1 19:34:41.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (482 seconds elapsed) Dec 1 19:34:41.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:41.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:41.898: INFO: Dec 1 19:34:43.894: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (484 seconds elapsed) Dec 1 19:34:43.894: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:43.894: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:43.894: INFO: Dec 1 19:34:45.900: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (486 seconds elapsed) Dec 1 19:34:45.900: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:45.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:45.900: INFO: Dec 1 19:34:47.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (488 seconds elapsed) Dec 1 19:34:47.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:47.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:47.896: INFO: Dec 1 19:34:49.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (490 seconds elapsed) Dec 1 19:34:49.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:49.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:49.899: INFO: Dec 1 19:34:51.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (492 seconds elapsed) Dec 1 19:34:51.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:51.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:51.897: INFO: Dec 1 19:34:53.938: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (494 seconds elapsed) Dec 1 19:34:53.938: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:53.938: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:53.938: INFO: Dec 1 19:34:55.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (496 seconds elapsed) Dec 1 19:34:55.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:55.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:55.896: INFO: Dec 1 19:34:57.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (498 seconds elapsed) Dec 1 19:34:57.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:57.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:57.898: INFO: ------------------------------ Automatically polling progress: In [SynchronizedBeforeSuite] (Node Runtime: 8m40.016s) test/e2e/e2e.go:77 Spec Goroutine goroutine 137 [select] k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc00013c000}, 0xc0006d5cb0, 0x2fdb16a?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc00013c000}, 0xc0?, 0x2fd9d05?, 0x88?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc00013c000}, 0x75b521a?, 0xc00337d310?, 0x262a967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x75b6f82?, 0x4?, 0x778e9c2?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 > k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodsRunningReady({0x801de88?, 0xc000e949c0}, {0x75ce977, 0xb}, 0x8, 0x0, 0x73677261636e7566?, 0xc003a23a40) test/e2e/framework/pod/wait.go:198 > k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:246 > k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractSynchronizedBeforeSuiteProc1Body.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:472 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runSuiteNode.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/suite.go:555 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 1 [chan receive, 8 minutes] testing.(*T).Run(0xc0009fc4e0, {0x75bea0a?, 0x2755a25?}, 0x78952c8) /usr/local/go/src/testing/testing.go:1494 testing.runTests.func1(0xc0009fc4e0?) /usr/local/go/src/testing/testing.go:1846 testing.tRunner(0xc0009fc4e0, 0xc00121f7f0) /usr/local/go/src/testing/testing.go:1446 testing.runTests(0xc000bbcaa0?, {0xac3b7e0, 0x1, 0x1}, {0x0?, 0xf45d27d13bdefcb0?, 0x0?}) /usr/local/go/src/testing/testing.go:1844 testing.(*M).Run(0xc000bbcaa0) /usr/local/go/src/testing/testing.go:1726 > k8s.io/kubernetes/test/e2e.TestMain(0xffffffffffffffff?) test/e2e/e2e_test.go:142 main.main() /tmp.k8s/go-build4026029738/b001/_testmain.go:49 ------------------------------ Dec 1 19:34:59.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (500 seconds elapsed) Dec 1 19:34:59.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:34:59.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:34:59.897: INFO: Dec 1 19:35:01.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (502 seconds elapsed) Dec 1 19:35:01.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:01.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:01.899: INFO: Dec 1 19:35:03.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (504 seconds elapsed) Dec 1 19:35:03.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:03.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:03.895: INFO: Dec 1 19:35:05.937: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (506 seconds elapsed) Dec 1 19:35:05.937: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:05.938: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:05.938: INFO: Dec 1 19:35:07.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (508 seconds elapsed) Dec 1 19:35:07.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:07.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:07.897: INFO: Dec 1 19:35:09.901: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (510 seconds elapsed) Dec 1 19:35:09.901: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:09.901: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:09.901: INFO: Dec 1 19:35:11.900: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (512 seconds elapsed) Dec 1 19:35:11.900: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:11.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:11.900: INFO: Dec 1 19:35:13.900: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (514 seconds elapsed) Dec 1 19:35:13.900: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:13.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:13.900: INFO: Dec 1 19:35:15.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (516 seconds elapsed) Dec 1 19:35:15.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:15.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:15.896: INFO: Dec 1 19:35:17.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (518 seconds elapsed) Dec 1 19:35:17.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:17.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:17.897: INFO: ------------------------------ Automatically polling progress: In [SynchronizedBeforeSuite] (Node Runtime: 9m0.017s) test/e2e/e2e.go:77 Spec Goroutine goroutine 137 [select] k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc00013c000}, 0xc0006d5cb0, 0x2fdb16a?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc00013c000}, 0xc0?, 0x2fd9d05?, 0x88?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc00013c000}, 0x75b521a?, 0xc00337d310?, 0x262a967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x75b6f82?, 0x4?, 0x778e9c2?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 > k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodsRunningReady({0x801de88?, 0xc000e949c0}, {0x75ce977, 0xb}, 0x8, 0x0, 0x73677261636e7566?, 0xc003a23a40) test/e2e/framework/pod/wait.go:198 > k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:246 > k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractSynchronizedBeforeSuiteProc1Body.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:472 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runSuiteNode.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/suite.go:555 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 1 [chan receive, 9 minutes] testing.(*T).Run(0xc0009fc4e0, {0x75bea0a?, 0x2755a25?}, 0x78952c8) /usr/local/go/src/testing/testing.go:1494 testing.runTests.func1(0xc0009fc4e0?) /usr/local/go/src/testing/testing.go:1846 testing.tRunner(0xc0009fc4e0, 0xc00121f7f0) /usr/local/go/src/testing/testing.go:1446 testing.runTests(0xc000bbcaa0?, {0xac3b7e0, 0x1, 0x1}, {0x0?, 0xf45d27d13bdefcb0?, 0x0?}) /usr/local/go/src/testing/testing.go:1844 testing.(*M).Run(0xc000bbcaa0) /usr/local/go/src/testing/testing.go:1726 > k8s.io/kubernetes/test/e2e.TestMain(0xffffffffffffffff?) test/e2e/e2e_test.go:142 main.main() /tmp.k8s/go-build4026029738/b001/_testmain.go:49 ------------------------------ Dec 1 19:35:19.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (520 seconds elapsed) Dec 1 19:35:19.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:19.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:19.898: INFO: Dec 1 19:35:21.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (522 seconds elapsed) Dec 1 19:35:21.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:21.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:21.897: INFO: Dec 1 19:35:23.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (524 seconds elapsed) Dec 1 19:35:23.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:23.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:23.896: INFO: Dec 1 19:35:25.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (526 seconds elapsed) Dec 1 19:35:25.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:25.900: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:25.900: INFO: Dec 1 19:35:27.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (528 seconds elapsed) Dec 1 19:35:27.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:27.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:27.897: INFO: Dec 1 19:35:29.902: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (530 seconds elapsed) Dec 1 19:35:29.902: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:29.902: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:29.902: INFO: Dec 1 19:35:31.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (532 seconds elapsed) Dec 1 19:35:31.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:31.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:31.896: INFO: Dec 1 19:35:33.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (534 seconds elapsed) Dec 1 19:35:33.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:33.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:33.896: INFO: Dec 1 19:35:35.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (536 seconds elapsed) Dec 1 19:35:35.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:35.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:35.895: INFO: Dec 1 19:35:37.894: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (538 seconds elapsed) Dec 1 19:35:37.894: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:37.894: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:37.894: INFO: ------------------------------ Automatically polling progress: In [SynchronizedBeforeSuite] (Node Runtime: 9m20.019s) test/e2e/e2e.go:77 Spec Goroutine goroutine 137 [select] k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc00013c000}, 0xc0006d5cb0, 0x2fdb16a?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc00013c000}, 0xc0?, 0x2fd9d05?, 0x88?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc00013c000}, 0x75b521a?, 0xc00337d310?, 0x262a967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x75b6f82?, 0x4?, 0x778e9c2?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 > k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodsRunningReady({0x801de88?, 0xc000e949c0}, {0x75ce977, 0xb}, 0x8, 0x0, 0x73677261636e7566?, 0xc003a23a40) test/e2e/framework/pod/wait.go:198 > k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:246 > k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractSynchronizedBeforeSuiteProc1Body.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:472 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runSuiteNode.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/suite.go:555 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 1 [chan receive, 9 minutes] testing.(*T).Run(0xc0009fc4e0, {0x75bea0a?, 0x2755a25?}, 0x78952c8) /usr/local/go/src/testing/testing.go:1494 testing.runTests.func1(0xc0009fc4e0?) /usr/local/go/src/testing/testing.go:1846 testing.tRunner(0xc0009fc4e0, 0xc00121f7f0) /usr/local/go/src/testing/testing.go:1446 testing.runTests(0xc000bbcaa0?, {0xac3b7e0, 0x1, 0x1}, {0x0?, 0xf45d27d13bdefcb0?, 0x0?}) /usr/local/go/src/testing/testing.go:1844 testing.(*M).Run(0xc000bbcaa0) /usr/local/go/src/testing/testing.go:1726 > k8s.io/kubernetes/test/e2e.TestMain(0xffffffffffffffff?) test/e2e/e2e_test.go:142 main.main() /tmp.k8s/go-build4026029738/b001/_testmain.go:49 ------------------------------ Dec 1 19:35:39.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (540 seconds elapsed) Dec 1 19:35:39.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:39.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:39.899: INFO: Dec 1 19:35:41.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (542 seconds elapsed) Dec 1 19:35:41.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:41.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:41.898: INFO: Dec 1 19:35:43.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (544 seconds elapsed) Dec 1 19:35:43.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:43.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:43.897: INFO: Dec 1 19:35:45.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (546 seconds elapsed) Dec 1 19:35:45.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:45.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:45.899: INFO: Dec 1 19:35:47.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (548 seconds elapsed) Dec 1 19:35:47.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:47.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:47.897: INFO: Dec 1 19:35:49.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (550 seconds elapsed) Dec 1 19:35:49.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:49.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:49.897: INFO: Dec 1 19:35:51.899: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (552 seconds elapsed) Dec 1 19:35:51.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:51.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:51.899: INFO: Dec 1 19:35:53.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (554 seconds elapsed) Dec 1 19:35:53.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:53.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:53.898: INFO: Dec 1 19:35:55.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (556 seconds elapsed) Dec 1 19:35:55.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:55.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:55.899: INFO: Dec 1 19:35:57.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (558 seconds elapsed) Dec 1 19:35:57.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:57.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:57.899: INFO: ------------------------------ Automatically polling progress: In [SynchronizedBeforeSuite] (Node Runtime: 9m40.021s) test/e2e/e2e.go:77 Spec Goroutine goroutine 137 [select] k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc00013c000}, 0xc0006d5cb0, 0x2fdb16a?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc00013c000}, 0xc0?, 0x2fd9d05?, 0x88?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc00013c000}, 0x75b521a?, 0xc00337d310?, 0x262a967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x75b6f82?, 0x4?, 0x778e9c2?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 > k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodsRunningReady({0x801de88?, 0xc000e949c0}, {0x75ce977, 0xb}, 0x8, 0x0, 0x73677261636e7566?, 0xc003a23a40) test/e2e/framework/pod/wait.go:198 > k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:246 > k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractSynchronizedBeforeSuiteProc1Body.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:472 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runSuiteNode.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/suite.go:555 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 1 [chan receive, 9 minutes] testing.(*T).Run(0xc0009fc4e0, {0x75bea0a?, 0x2755a25?}, 0x78952c8) /usr/local/go/src/testing/testing.go:1494 testing.runTests.func1(0xc0009fc4e0?) /usr/local/go/src/testing/testing.go:1846 testing.tRunner(0xc0009fc4e0, 0xc00121f7f0) /usr/local/go/src/testing/testing.go:1446 testing.runTests(0xc000bbcaa0?, {0xac3b7e0, 0x1, 0x1}, {0x0?, 0xf45d27d13bdefcb0?, 0x0?}) /usr/local/go/src/testing/testing.go:1844 testing.(*M).Run(0xc000bbcaa0) /usr/local/go/src/testing/testing.go:1726 > k8s.io/kubernetes/test/e2e.TestMain(0xffffffffffffffff?) test/e2e/e2e_test.go:142 main.main() /tmp.k8s/go-build4026029738/b001/_testmain.go:49 ------------------------------ Dec 1 19:35:59.902: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (560 seconds elapsed) Dec 1 19:35:59.902: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:35:59.902: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:35:59.902: INFO: Dec 1 19:36:01.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (562 seconds elapsed) Dec 1 19:36:01.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:01.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:01.898: INFO: Dec 1 19:36:03.896: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (564 seconds elapsed) Dec 1 19:36:03.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:03.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:03.896: INFO: Dec 1 19:36:05.905: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (566 seconds elapsed) Dec 1 19:36:05.905: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:05.905: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:05.905: INFO: Dec 1 19:36:07.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (568 seconds elapsed) Dec 1 19:36:07.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:07.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:07.898: INFO: Dec 1 19:36:09.901: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (570 seconds elapsed) Dec 1 19:36:09.901: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:09.901: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:09.901: INFO: Dec 1 19:36:11.898: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (572 seconds elapsed) Dec 1 19:36:11.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:11.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:11.898: INFO: Dec 1 19:36:13.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (574 seconds elapsed) Dec 1 19:36:13.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:13.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:13.895: INFO: Dec 1 19:36:15.901: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (576 seconds elapsed) Dec 1 19:36:15.901: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:15.901: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:15.901: INFO: Dec 1 19:36:17.895: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (578 seconds elapsed) Dec 1 19:36:17.895: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:17.895: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:17.895: INFO: ------------------------------ Automatically polling progress: In [SynchronizedBeforeSuite] (Node Runtime: 10m0.023s) test/e2e/e2e.go:77 Spec Goroutine goroutine 137 [select] k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc00013c000}, 0xc0006d5cb0, 0x2fdb16a?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc00013c000}, 0xc0?, 0x2fd9d05?, 0x88?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc00013c000}, 0x75b521a?, 0xc00337d310?, 0x262a967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x75b6f82?, 0x4?, 0x778e9c2?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 > k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodsRunningReady({0x801de88?, 0xc000e949c0}, {0x75ce977, 0xb}, 0x8, 0x0, 0x73677261636e7566?, 0xc003a23a40) test/e2e/framework/pod/wait.go:198 > k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:246 > k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractSynchronizedBeforeSuiteProc1Body.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:472 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runSuiteNode.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/suite.go:555 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 1 [chan receive, 10 minutes] testing.(*T).Run(0xc0009fc4e0, {0x75bea0a?, 0x2755a25?}, 0x78952c8) /usr/local/go/src/testing/testing.go:1494 testing.runTests.func1(0xc0009fc4e0?) /usr/local/go/src/testing/testing.go:1846 testing.tRunner(0xc0009fc4e0, 0xc00121f7f0) /usr/local/go/src/testing/testing.go:1446 testing.runTests(0xc000bbcaa0?, {0xac3b7e0, 0x1, 0x1}, {0x0?, 0xf45d27d13bdefcb0?, 0x0?}) /usr/local/go/src/testing/testing.go:1844 testing.(*M).Run(0xc000bbcaa0) /usr/local/go/src/testing/testing.go:1726 > k8s.io/kubernetes/test/e2e.TestMain(0xffffffffffffffff?) test/e2e/e2e_test.go:142 main.main() /tmp.k8s/go-build4026029738/b001/_testmain.go:49 ------------------------------ Dec 1 19:36:19.937: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (580 seconds elapsed) Dec 1 19:36:19.937: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:19.937: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:19.937: INFO: Dec 1 19:36:21.897: INFO: 16 / 16 pods in namespace 'kube-system' are running and ready (582 seconds elapsed) Dec 1 19:36:21.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:21.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:21.897: INFO: Dec 1 19:36:23.896: INFO: The status of Pod konnectivity-agent-kc44t is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:23.896: INFO: The status of Pod kube-proxy-ca-minion-group-36k6 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:23.896: INFO: The status of Pod metadata-proxy-v0.1-b7xw8 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:23.896: INFO: 13 / 16 pods in namespace 'kube-system' are running and ready (584 seconds elapsed) Dec 1 19:36:23.896: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:23.896: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:23.896: INFO: konnectivity-agent-kc44t ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:32 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC }] Dec 1 19:36:23.896: INFO: kube-proxy-ca-minion-group-36k6 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:17 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:23.896: INFO: metadata-proxy-v0.1-b7xw8 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:21 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:23.896: INFO: Dec 1 19:36:25.897: INFO: The status of Pod konnectivity-agent-kc44t is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:25.897: INFO: The status of Pod kube-proxy-ca-minion-group-36k6 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:25.897: INFO: The status of Pod metadata-proxy-v0.1-b7xw8 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:25.897: INFO: 13 / 16 pods in namespace 'kube-system' are running and ready (586 seconds elapsed) Dec 1 19:36:25.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:25.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:25.897: INFO: konnectivity-agent-kc44t ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:32 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC }] Dec 1 19:36:25.897: INFO: kube-proxy-ca-minion-group-36k6 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:17 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:25.897: INFO: metadata-proxy-v0.1-b7xw8 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:21 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:25.897: INFO: Dec 1 19:36:27.903: INFO: The status of Pod konnectivity-agent-kc44t is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:27.903: INFO: The status of Pod kube-proxy-ca-minion-group-36k6 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:27.903: INFO: The status of Pod metadata-proxy-v0.1-b7xw8 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:27.903: INFO: 13 / 16 pods in namespace 'kube-system' are running and ready (588 seconds elapsed) Dec 1 19:36:27.903: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:27.903: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:27.903: INFO: konnectivity-agent-kc44t ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:32 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC }] Dec 1 19:36:27.903: INFO: kube-proxy-ca-minion-group-36k6 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:17 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:27.903: INFO: metadata-proxy-v0.1-b7xw8 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:21 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:27.903: INFO: Dec 1 19:36:29.898: INFO: The status of Pod konnectivity-agent-kc44t is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:29.898: INFO: The status of Pod kube-proxy-ca-minion-group-36k6 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:29.898: INFO: The status of Pod metadata-proxy-v0.1-b7xw8 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:29.898: INFO: 13 / 16 pods in namespace 'kube-system' are running and ready (590 seconds elapsed) Dec 1 19:36:29.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:29.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:29.898: INFO: konnectivity-agent-kc44t ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:32 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC }] Dec 1 19:36:29.898: INFO: kube-proxy-ca-minion-group-36k6 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:17 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:29.898: INFO: metadata-proxy-v0.1-b7xw8 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:21 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:29.898: INFO: Dec 1 19:36:31.898: INFO: The status of Pod konnectivity-agent-kc44t is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:31.898: INFO: The status of Pod kube-proxy-ca-minion-group-36k6 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:31.898: INFO: The status of Pod metadata-proxy-v0.1-b7xw8 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:31.898: INFO: 13 / 16 pods in namespace 'kube-system' are running and ready (592 seconds elapsed) Dec 1 19:36:31.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:31.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:31.898: INFO: konnectivity-agent-kc44t ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:32 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC }] Dec 1 19:36:31.898: INFO: kube-proxy-ca-minion-group-36k6 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:17 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:31.898: INFO: metadata-proxy-v0.1-b7xw8 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:21 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:31.898: INFO: Dec 1 19:36:33.898: INFO: The status of Pod konnectivity-agent-kc44t is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:33.898: INFO: The status of Pod kube-proxy-ca-minion-group-36k6 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:33.898: INFO: The status of Pod metadata-proxy-v0.1-b7xw8 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:33.898: INFO: 13 / 16 pods in namespace 'kube-system' are running and ready (594 seconds elapsed) Dec 1 19:36:33.898: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:33.898: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:33.898: INFO: konnectivity-agent-kc44t ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:32 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC }] Dec 1 19:36:33.898: INFO: kube-proxy-ca-minion-group-36k6 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:17 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:33.898: INFO: metadata-proxy-v0.1-b7xw8 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:21 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:33.898: INFO: Dec 1 19:36:35.898: INFO: The status of Pod konnectivity-agent-kc44t is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:35.898: INFO: The status of Pod kube-proxy-ca-minion-group-36k6 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:35.899: INFO: The status of Pod metadata-proxy-v0.1-b7xw8 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:35.899: INFO: 13 / 16 pods in namespace 'kube-system' are running and ready (596 seconds elapsed) Dec 1 19:36:35.899: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:35.899: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:35.899: INFO: konnectivity-agent-kc44t ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:32 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC }] Dec 1 19:36:35.899: INFO: kube-proxy-ca-minion-group-36k6 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:17 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:35.899: INFO: metadata-proxy-v0.1-b7xw8 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:21 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:35.899: INFO: Dec 1 19:36:37.897: INFO: The status of Pod konnectivity-agent-kc44t is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:37.897: INFO: The status of Pod kube-proxy-ca-minion-group-36k6 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:37.897: INFO: The status of Pod metadata-proxy-v0.1-b7xw8 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:37.897: INFO: 13 / 16 pods in namespace 'kube-system' are running and ready (598 seconds elapsed) Dec 1 19:36:37.897: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:37.897: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:37.897: INFO: konnectivity-agent-kc44t ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:32 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC }] Dec 1 19:36:37.897: INFO: kube-proxy-ca-minion-group-36k6 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:17 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:37.897: INFO: metadata-proxy-v0.1-b7xw8 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:21 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:37.897: INFO: ------------------------------ Automatically polling progress: In [SynchronizedBeforeSuite] (Node Runtime: 10m20.025s) test/e2e/e2e.go:77 Spec Goroutine goroutine 137 [select] k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc00013c000}, 0xc0006d5cb0, 0x2fdb16a?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc00013c000}, 0xc0?, 0x2fd9d05?, 0x88?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc00013c000}, 0x75b521a?, 0xc00337d310?, 0x262a967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x75b6f82?, 0x4?, 0x778e9c2?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 > k8s.io/kubernetes/test/e2e/framework/pod.WaitForPodsRunningReady({0x801de88?, 0xc000e949c0}, {0x75ce977, 0xb}, 0x8, 0x0, 0x73677261636e7566?, 0xc003a23a40) test/e2e/framework/pod/wait.go:198 > k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:246 > k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractSynchronizedBeforeSuiteProc1Body.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:472 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runSuiteNode.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/suite.go:555 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 1 [chan receive, 10 minutes] testing.(*T).Run(0xc0009fc4e0, {0x75bea0a?, 0x2755a25?}, 0x78952c8) /usr/local/go/src/testing/testing.go:1494 testing.runTests.func1(0xc0009fc4e0?) /usr/local/go/src/testing/testing.go:1846 testing.tRunner(0xc0009fc4e0, 0xc00121f7f0) /usr/local/go/src/testing/testing.go:1446 testing.runTests(0xc000bbcaa0?, {0xac3b7e0, 0x1, 0x1}, {0x0?, 0xf45d27d13bdefcb0?, 0x0?}) /usr/local/go/src/testing/testing.go:1844 testing.(*M).Run(0xc000bbcaa0) /usr/local/go/src/testing/testing.go:1726 > k8s.io/kubernetes/test/e2e.TestMain(0xffffffffffffffff?) test/e2e/e2e_test.go:142 main.main() /tmp.k8s/go-build4026029738/b001/_testmain.go:49 ------------------------------ Dec 1 19:36:39.904: INFO: The status of Pod konnectivity-agent-kc44t is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:39.904: INFO: The status of Pod kube-proxy-ca-minion-group-36k6 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:39.904: INFO: The status of Pod metadata-proxy-v0.1-b7xw8 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:39.904: INFO: 13 / 16 pods in namespace 'kube-system' are running and ready (600 seconds elapsed) Dec 1 19:36:39.904: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:39.904: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:39.904: INFO: konnectivity-agent-kc44t ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:32 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC }] Dec 1 19:36:39.904: INFO: kube-proxy-ca-minion-group-36k6 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:17 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:39.904: INFO: metadata-proxy-v0.1-b7xw8 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:21 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:39.904: INFO: Dec 1 19:36:40.071: INFO: The status of Pod konnectivity-agent-kc44t is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:40.071: INFO: The status of Pod kube-proxy-ca-minion-group-36k6 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:40.071: INFO: The status of Pod metadata-proxy-v0.1-b7xw8 is Running (Ready = false), waiting for it to be either Running (with Ready = true) or Failed Dec 1 19:36:40.071: INFO: 13 / 16 pods in namespace 'kube-system' are running and ready (600 seconds elapsed) Dec 1 19:36:40.071: INFO: expected 4 pod replicas in namespace 'kube-system', 3 are Running and Ready. Dec 1 19:36:40.071: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:40.071: INFO: konnectivity-agent-kc44t ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:32 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC }] Dec 1 19:36:40.071: INFO: kube-proxy-ca-minion-group-36k6 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:17 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:40.071: INFO: metadata-proxy-v0.1-b7xw8 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:21 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:40.071: INFO: STEP: Collecting events from namespace "kube-system". 12/01/22 19:36:40.071 STEP: Found 156 events. 12/01/22 19:36:40.128 Dec 1 19:36:40.130: INFO: At 2022-12-01 19:24:48 +0000 UTC - event for kube-scheduler: {default-scheduler } LeaderElection: ca-master_3c7b2793-af71-4c47-9bac-a65aa11032a2 became leader Dec 1 19:36:40.130: INFO: At 2022-12-01 19:24:49 +0000 UTC - event for kube-controller-manager: {kube-controller-manager } LeaderElection: ca-master_beecc237-3967-42a1-a77f-2628a8cf65a8 became leader Dec 1 19:36:40.130: INFO: At 2022-12-01 19:24:54 +0000 UTC - event for l7-lb-controller-ca-master: {kubelet ca-master} Created: Created container l7-lb-controller Dec 1 19:36:40.130: INFO: At 2022-12-01 19:24:55 +0000 UTC - event for l7-lb-controller-ca-master: {kubelet ca-master} Started: Started container l7-lb-controller Dec 1 19:36:40.130: INFO: At 2022-12-01 19:24:57 +0000 UTC - event for l7-lb-controller-ca-master: {kubelet ca-master} Pulled: Container image "gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1" already present on machine Dec 1 19:36:40.130: INFO: At 2022-12-01 19:24:58 +0000 UTC - event for cluster-autoscaler-ca-master: {kubelet ca-master} Created: Created container cluster-autoscaler Dec 1 19:36:40.130: INFO: At 2022-12-01 19:24:59 +0000 UTC - event for cluster-autoscaler-ca-master: {kubelet ca-master} Started: Started container cluster-autoscaler Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:00 +0000 UTC - event for cluster-autoscaler-ca-master: {kubelet ca-master} Pulled: Container image "registry.k8s.io/autoscaling/cluster-autoscaler:v1.22.0" already present on machine Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:01 +0000 UTC - event for cluster-autoscaler-ca-master: {kubelet ca-master} BackOff: Back-off restarting failed container cluster-autoscaler in pod cluster-autoscaler-ca-master_kube-system(17b18673ea3aca8e9cd5af81692c895b) Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:05 +0000 UTC - event for coredns: {deployment-controller } ScalingReplicaSet: Scaled up replica set coredns-6d97d5ddb to 1 Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:05 +0000 UTC - event for coredns-6d97d5ddb: {replicaset-controller } FailedCreate: Error creating: insufficient quota to match these scopes: [{PriorityClass In [system-node-critical system-cluster-critical]}] Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:05 +0000 UTC - event for kube-dns-autoscaler: {deployment-controller } ScalingReplicaSet: Scaled up replica set kube-dns-autoscaler-5f6455f985 to 1 Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:05 +0000 UTC - event for kube-dns-autoscaler-5f6455f985: {replicaset-controller } FailedCreate: Error creating: pods "kube-dns-autoscaler-5f6455f985-" is forbidden: error looking up service account kube-system/kube-dns-autoscaler: serviceaccount "kube-dns-autoscaler" not found Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:05 +0000 UTC - event for l7-default-backend: {deployment-controller } ScalingReplicaSet: Scaled up replica set l7-default-backend-8549d69d99 to 1 Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:05 +0000 UTC - event for l7-default-backend-8549d69d99: {replicaset-controller } SuccessfulCreate: Created pod: l7-default-backend-8549d69d99-qmmwd Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:05 +0000 UTC - event for l7-default-backend-8549d69d99-qmmwd: {default-scheduler } FailedScheduling: no nodes available to schedule pods Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:08 +0000 UTC - event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-rq9p5 Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:08 +0000 UTC - event for metadata-proxy-v0.1-rq9p5: {default-scheduler } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-rq9p5 to ca-master Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:08 +0000 UTC - event for metrics-server-v0.5.2: {deployment-controller } ScalingReplicaSet: Scaled up replica set metrics-server-v0.5.2-6764bf875c to 1 Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:08 +0000 UTC - event for metrics-server-v0.5.2-6764bf875c: {replicaset-controller } SuccessfulCreate: Created pod: metrics-server-v0.5.2-6764bf875c-2z6tg Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:08 +0000 UTC - event for metrics-server-v0.5.2-6764bf875c-2z6tg: {default-scheduler } FailedScheduling: no nodes available to schedule pods Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:08 +0000 UTC - event for volume-snapshot-controller: {statefulset-controller } SuccessfulCreate: create Pod volume-snapshot-controller-0 in StatefulSet volume-snapshot-controller successful Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:08 +0000 UTC - event for volume-snapshot-controller-0: {default-scheduler } FailedScheduling: 0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/master: }, 1 node(s) were unschedulable. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.. Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:09 +0000 UTC - event for l7-default-backend-8549d69d99-qmmwd: {default-scheduler } FailedScheduling: 0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/master: }, 1 node(s) were unschedulable. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.. Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:09 +0000 UTC - event for metrics-server-v0.5.2-6764bf875c-2z6tg: {default-scheduler } FailedScheduling: 0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/master: }, 1 node(s) were unschedulable. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.. Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:10 +0000 UTC - event for coredns-6d97d5ddb: {replicaset-controller } SuccessfulCreate: Created pod: coredns-6d97d5ddb-vl7wz Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:10 +0000 UTC - event for coredns-6d97d5ddb-vl7wz: {default-scheduler } FailedScheduling: 0/1 nodes are available: 1 node(s) had untolerated taint {node-role.kubernetes.io/master: }, 1 node(s) were unschedulable. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.. Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:10 +0000 UTC - event for kube-dns-autoscaler-5f6455f985: {replicaset-controller } FailedCreate: Error creating: pods "kube-dns-autoscaler-5f6455f985-tblnn" is forbidden: pod.Spec.SecurityContext.SupplementalGroups is forbidden Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:10 +0000 UTC - event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-k6m42 Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:10 +0000 UTC - event for metadata-proxy-v0.1-k6m42: {default-scheduler } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-k6m42 to ca-minion-group-fkwz Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:11 +0000 UTC - event for kube-proxy-ca-minion-group-fkwz: {kubelet ca-minion-group-fkwz} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.56_3e26e104bdf9d0" already present on machine Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:11 +0000 UTC - event for kube-proxy-ca-minion-group-fkwz: {kubelet ca-minion-group-fkwz} Started: Started container kube-proxy Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:11 +0000 UTC - event for kube-proxy-ca-minion-group-fkwz: {kubelet ca-minion-group-fkwz} Created: Created container kube-proxy Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:11 +0000 UTC - event for metadata-proxy-v0.1-rq9p5: {kubelet ca-master} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:12 +0000 UTC - event for metadata-proxy-v0.1-k6m42: {kubelet ca-minion-group-fkwz} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:12 +0000 UTC - event for metadata-proxy-v0.1-rq9p5: {kubelet ca-master} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 854.225041ms (854.232008ms including waiting) Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:12 +0000 UTC - event for metadata-proxy-v0.1-rq9p5: {kubelet ca-master} Failed: Error: services have not yet been read at least once, cannot construct envvars Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:12 +0000 UTC - event for metadata-proxy-v0.1-rq9p5: {kubelet ca-master} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:13 +0000 UTC - event for metadata-proxy-v0.1-k6m42: {kubelet ca-minion-group-fkwz} Started: Started container metadata-proxy Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:13 +0000 UTC - event for metadata-proxy-v0.1-k6m42: {kubelet ca-minion-group-fkwz} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:13 +0000 UTC - event for metadata-proxy-v0.1-k6m42: {kubelet ca-minion-group-fkwz} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 695.434582ms (695.457657ms including waiting) Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:13 +0000 UTC - event for metadata-proxy-v0.1-k6m42: {kubelet ca-minion-group-fkwz} Created: Created container metadata-proxy Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:14 +0000 UTC - event for metadata-proxy-v0.1-rq9p5: {kubelet ca-master} Failed: Error: services have not yet been read at least once, cannot construct envvars Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:14 +0000 UTC - event for metadata-proxy-v0.1-rq9p5: {kubelet ca-master} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 2.093951035s (2.093958812s including waiting) Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:15 +0000 UTC - event for kube-dns-autoscaler-5f6455f985: {replicaset-controller } FailedCreate: Error creating: pods "kube-dns-autoscaler-5f6455f985-zcxjf" is forbidden: pod.Spec.SecurityContext.SupplementalGroups is forbidden Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:15 +0000 UTC - event for kube-proxy-ca-minion-group-1-p98h: {kubelet ca-minion-group-1-p98h} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.56_3e26e104bdf9d0" already present on machine Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:15 +0000 UTC - event for kube-proxy-ca-minion-group-1-p98h: {kubelet ca-minion-group-1-p98h} Created: Created container kube-proxy Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:15 +0000 UTC - event for kube-proxy-ca-minion-group-1-p98h: {kubelet ca-minion-group-1-p98h} Started: Started container kube-proxy Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:15 +0000 UTC - event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-b7xw8 Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:15 +0000 UTC - event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-nrpg4 Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:15 +0000 UTC - event for metadata-proxy-v0.1-b7xw8: {default-scheduler } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-b7xw8 to ca-minion-group-36k6 Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:15 +0000 UTC - event for metadata-proxy-v0.1-k6m42: {kubelet ca-minion-group-fkwz} Created: Created container prometheus-to-sd-exporter Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:15 +0000 UTC - event for metadata-proxy-v0.1-k6m42: {kubelet ca-minion-group-fkwz} Started: Started container prometheus-to-sd-exporter Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:15 +0000 UTC - event for metadata-proxy-v0.1-k6m42: {kubelet ca-minion-group-fkwz} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 1.705290774s (1.705299228s including waiting) Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:15 +0000 UTC - event for metadata-proxy-v0.1-nrpg4: {default-scheduler } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-nrpg4 to ca-minion-group-1-p98h Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:15 +0000 UTC - event for metadata-proxy-v0.1-rq9p5: {kubelet ca-master} Pulled: Container image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" already present on machine Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:15 +0000 UTC - event for metadata-proxy-v0.1-rq9p5: {kubelet ca-master} Pulled: Container image "registry.k8s.io/metadata-proxy:v0.1.12" already present on machine Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:16 +0000 UTC - event for kube-proxy-ca-minion-group-36k6: {kubelet ca-minion-group-36k6} Started: Started container kube-proxy Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:16 +0000 UTC - event for kube-proxy-ca-minion-group-36k6: {kubelet ca-minion-group-36k6} Created: Created container kube-proxy Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:16 +0000 UTC - event for kube-proxy-ca-minion-group-36k6: {kubelet ca-minion-group-36k6} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.56_3e26e104bdf9d0" already present on machine Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:16 +0000 UTC - event for metadata-proxy-v0.1-nrpg4: {kubelet ca-minion-group-1-p98h} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 721.444397ms (721.455665ms including waiting) Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:16 +0000 UTC - event for metadata-proxy-v0.1-nrpg4: {kubelet ca-minion-group-1-p98h} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:17 +0000 UTC - event for metadata-proxy-v0.1-b7xw8: {kubelet ca-minion-group-36k6} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:17 +0000 UTC - event for metadata-proxy-v0.1-nrpg4: {kubelet ca-minion-group-1-p98h} Started: Started container metadata-proxy Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:17 +0000 UTC - event for metadata-proxy-v0.1-nrpg4: {kubelet ca-minion-group-1-p98h} Created: Created container metadata-proxy Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:17 +0000 UTC - event for metadata-proxy-v0.1-nrpg4: {kubelet ca-minion-group-1-p98h} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:18 +0000 UTC - event for metadata-proxy-v0.1-b7xw8: {kubelet ca-minion-group-36k6} Created: Created container metadata-proxy Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:18 +0000 UTC - event for metadata-proxy-v0.1-b7xw8: {kubelet ca-minion-group-36k6} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 766.849511ms (767.133822ms including waiting) Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:18 +0000 UTC - event for metadata-proxy-v0.1-b7xw8: {kubelet ca-minion-group-36k6} Started: Started container metadata-proxy Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:18 +0000 UTC - event for metadata-proxy-v0.1-b7xw8: {kubelet ca-minion-group-36k6} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:19 +0000 UTC - event for metadata-proxy-v0.1-nrpg4: {kubelet ca-minion-group-1-p98h} Started: Started container prometheus-to-sd-exporter Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:19 +0000 UTC - event for metadata-proxy-v0.1-nrpg4: {kubelet ca-minion-group-1-p98h} Created: Created container prometheus-to-sd-exporter Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:19 +0000 UTC - event for metadata-proxy-v0.1-nrpg4: {kubelet ca-minion-group-1-p98h} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 2.001813905s (2.001822158s including waiting) Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:20 +0000 UTC - event for coredns-6d97d5ddb-vl7wz: {default-scheduler } Scheduled: Successfully assigned kube-system/coredns-6d97d5ddb-vl7wz to ca-minion-group-fkwz Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:20 +0000 UTC - event for konnectivity-agent: {daemonset-controller } SuccessfulCreate: Created pod: konnectivity-agent-rd4g6 Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:20 +0000 UTC - event for konnectivity-agent-rd4g6: {default-scheduler } Scheduled: Successfully assigned kube-system/konnectivity-agent-rd4g6 to ca-minion-group-fkwz Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:20 +0000 UTC - event for l7-default-backend-8549d69d99-qmmwd: {default-scheduler } Scheduled: Successfully assigned kube-system/l7-default-backend-8549d69d99-qmmwd to ca-minion-group-fkwz Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:20 +0000 UTC - event for metadata-proxy-v0.1-b7xw8: {kubelet ca-minion-group-36k6} Created: Created container prometheus-to-sd-exporter Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:20 +0000 UTC - event for metadata-proxy-v0.1-b7xw8: {kubelet ca-minion-group-36k6} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 1.835171294s (1.83520262s including waiting) Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:20 +0000 UTC - event for metrics-server-v0.5.2-6764bf875c-2z6tg: {default-scheduler } Scheduled: Successfully assigned kube-system/metrics-server-v0.5.2-6764bf875c-2z6tg to ca-minion-group-fkwz Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:20 +0000 UTC - event for volume-snapshot-controller-0: {default-scheduler } Scheduled: Successfully assigned kube-system/volume-snapshot-controller-0 to ca-minion-group-fkwz Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:21 +0000 UTC - event for ingress-gce-lock: {loadbalancer-controller } LeaderElection: ca-master_11427 became leader Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:21 +0000 UTC - event for metadata-proxy-v0.1-b7xw8: {kubelet ca-minion-group-36k6} Started: Started container prometheus-to-sd-exporter Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:21 +0000 UTC - event for volume-snapshot-controller-0: {kubelet ca-minion-group-fkwz} Pulling: Pulling image "registry.k8s.io/sig-storage/snapshot-controller:v6.1.0" Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:22 +0000 UTC - event for cluster-autoscaler: {cluster-autoscaler } LeaderElection: ca-master became leader Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:22 +0000 UTC - event for coredns-6d97d5ddb-vl7wz: {kubelet ca-minion-group-fkwz} Pulling: Pulling image "registry.k8s.io/coredns/coredns:v1.9.3" Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:22 +0000 UTC - event for konnectivity-agent-rd4g6: {kubelet ca-minion-group-fkwz} Pulling: Pulling image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33" Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:23 +0000 UTC - event for metrics-server-v0.5.2-6764bf875c-2z6tg: {kubelet ca-minion-group-fkwz} Pulling: Pulling image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:24 +0000 UTC - event for coredns-6d97d5ddb-vl7wz: {kubelet ca-minion-group-fkwz} Pulled: Successfully pulled image "registry.k8s.io/coredns/coredns:v1.9.3" in 2.136226377s (2.136238981s including waiting) Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:24 +0000 UTC - event for coredns-6d97d5ddb-vl7wz: {kubelet ca-minion-group-fkwz} Created: Created container coredns Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:24 +0000 UTC - event for konnectivity-agent-rd4g6: {kubelet ca-minion-group-fkwz} Started: Started container konnectivity-agent Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:24 +0000 UTC - event for konnectivity-agent-rd4g6: {kubelet ca-minion-group-fkwz} Pulled: Successfully pulled image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33" in 1.400467264s (1.400496559s including waiting) Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:24 +0000 UTC - event for konnectivity-agent-rd4g6: {kubelet ca-minion-group-fkwz} Created: Created container konnectivity-agent Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:24 +0000 UTC - event for volume-snapshot-controller-0: {kubelet ca-minion-group-fkwz} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/snapshot-controller:v6.1.0" in 2.506022275s (2.506030166s including waiting) Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:24 +0000 UTC - event for volume-snapshot-controller-0: {kubelet ca-minion-group-fkwz} Created: Created container volume-snapshot-controller Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:24 +0000 UTC - event for volume-snapshot-controller-0: {kubelet ca-minion-group-fkwz} Started: Started container volume-snapshot-controller Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:25 +0000 UTC - event for coredns-6d97d5ddb-vl7wz: {kubelet ca-minion-group-fkwz} Started: Started container coredns Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:25 +0000 UTC - event for kube-dns-autoscaler-5f6455f985: {replicaset-controller } FailedCreate: Error creating: pods "kube-dns-autoscaler-5f6455f985-88s2t" is forbidden: pod.Spec.SecurityContext.SupplementalGroups is forbidden Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:25 +0000 UTC - event for metrics-server-v0.5.2-6764bf875c-2z6tg: {kubelet ca-minion-group-fkwz} Pulled: Successfully pulled image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" in 2.485794826s (2.485807344s including waiting) Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:25 +0000 UTC - event for metrics-server-v0.5.2-6764bf875c-2z6tg: {kubelet ca-minion-group-fkwz} Pulling: Pulling image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:25 +0000 UTC - event for metrics-server-v0.5.2-6764bf875c-2z6tg: {kubelet ca-minion-group-fkwz} Started: Started container metrics-server Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:25 +0000 UTC - event for metrics-server-v0.5.2-6764bf875c-2z6tg: {kubelet ca-minion-group-fkwz} Created: Created container metrics-server Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:27 +0000 UTC - event for metrics-server-v0.5.2-6764bf875c-2z6tg: {kubelet ca-minion-group-fkwz} Created: Created container metrics-server-nanny Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:27 +0000 UTC - event for metrics-server-v0.5.2-6764bf875c-2z6tg: {kubelet ca-minion-group-fkwz} Pulled: Successfully pulled image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" in 1.398410939s (1.39851437s including waiting) Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:30 +0000 UTC - event for konnectivity-agent: {daemonset-controller } SuccessfulCreate: Created pod: konnectivity-agent-gbhx6 Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:30 +0000 UTC - event for konnectivity-agent: {daemonset-controller } SuccessfulCreate: Created pod: konnectivity-agent-kc44t Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:30 +0000 UTC - event for konnectivity-agent-gbhx6: {default-scheduler } Scheduled: Successfully assigned kube-system/konnectivity-agent-gbhx6 to ca-minion-group-1-p98h Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:30 +0000 UTC - event for konnectivity-agent-kc44t: {default-scheduler } Scheduled: Successfully assigned kube-system/konnectivity-agent-kc44t to ca-minion-group-36k6 Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:30 +0000 UTC - event for metrics-server-v0.5.2-6764bf875c-2z6tg: {kubelet ca-minion-group-fkwz} Unhealthy: Readiness probe failed: HTTP probe failed with statuscode: 500 Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:30 +0000 UTC - event for metrics-server-v0.5.2-6764bf875c-2z6tg: {kubelet ca-minion-group-fkwz} Started: Started container metrics-server-nanny Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:31 +0000 UTC - event for konnectivity-agent-gbhx6: {kubelet ca-minion-group-1-p98h} Pulled: Successfully pulled image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33" in 614.840251ms (614.849841ms including waiting) Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:31 +0000 UTC - event for konnectivity-agent-gbhx6: {kubelet ca-minion-group-1-p98h} Started: Started container konnectivity-agent Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:31 +0000 UTC - event for konnectivity-agent-gbhx6: {kubelet ca-minion-group-1-p98h} Created: Created container konnectivity-agent Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:31 +0000 UTC - event for konnectivity-agent-gbhx6: {kubelet ca-minion-group-1-p98h} Pulling: Pulling image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33" Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:31 +0000 UTC - event for konnectivity-agent-kc44t: {kubelet ca-minion-group-36k6} Pulling: Pulling image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33" Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:31 +0000 UTC - event for konnectivity-agent-kc44t: {kubelet ca-minion-group-36k6} Pulled: Successfully pulled image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33" in 592.922265ms (592.940045ms including waiting) Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:31 +0000 UTC - event for konnectivity-agent-kc44t: {kubelet ca-minion-group-36k6} Created: Created container konnectivity-agent Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:31 +0000 UTC - event for konnectivity-agent-kc44t: {kubelet ca-minion-group-36k6} Started: Started container konnectivity-agent Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:33 +0000 UTC - event for metrics-server-v0.5.2: {deployment-controller } ScalingReplicaSet: Scaled up replica set metrics-server-v0.5.2-867b8754b9 to 1 Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:33 +0000 UTC - event for metrics-server-v0.5.2-867b8754b9: {replicaset-controller } SuccessfulCreate: Created pod: metrics-server-v0.5.2-867b8754b9-7cv8q Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:33 +0000 UTC - event for metrics-server-v0.5.2-867b8754b9-7cv8q: {default-scheduler } Scheduled: Successfully assigned kube-system/metrics-server-v0.5.2-867b8754b9-7cv8q to ca-minion-group-1-p98h Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:36 +0000 UTC - event for metrics-server-v0.5.2-867b8754b9-7cv8q: {kubelet ca-minion-group-1-p98h} Pulling: Pulling image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" Dec 1 19:36:40.130: INFO: At 2022-12-01 19:25:37 +0000 UTC - event for metrics-server-v0.5.2-867b8754b9-7cv8q: {kubelet ca-minion-group-1-p98h} Created: Created container metrics-server Dec 1 19:36:40.131: INFO: At 2022-12-01 19:25:37 +0000 UTC - event for metrics-server-v0.5.2-867b8754b9-7cv8q: {kubelet ca-minion-group-1-p98h} Pulled: Successfully pulled image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" in 1.334122451s (1.334143186s including waiting) Dec 1 19:36:40.131: INFO: At 2022-12-01 19:25:42 +0000 UTC - event for metadata-proxy-v0.1-rq9p5: {kubelet ca-master} Created: Created container metadata-proxy Dec 1 19:36:40.131: INFO: At 2022-12-01 19:25:43 +0000 UTC - event for metadata-proxy-v0.1-rq9p5: {kubelet ca-master} Started: Started container prometheus-to-sd-exporter Dec 1 19:36:40.131: INFO: At 2022-12-01 19:25:43 +0000 UTC - event for metadata-proxy-v0.1-rq9p5: {kubelet ca-master} Created: Created container prometheus-to-sd-exporter Dec 1 19:36:40.131: INFO: At 2022-12-01 19:25:43 +0000 UTC - event for metadata-proxy-v0.1-rq9p5: {kubelet ca-master} Started: Started container metadata-proxy Dec 1 19:36:40.131: INFO: At 2022-12-01 19:25:44 +0000 UTC - event for metrics-server-v0.5.2-867b8754b9-7cv8q: {kubelet ca-minion-group-1-p98h} Pulling: Pulling image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" Dec 1 19:36:40.131: INFO: At 2022-12-01 19:25:44 +0000 UTC - event for metrics-server-v0.5.2-867b8754b9-7cv8q: {kubelet ca-minion-group-1-p98h} Started: Started container metrics-server Dec 1 19:36:40.131: INFO: At 2022-12-01 19:25:45 +0000 UTC - event for metrics-server-v0.5.2-867b8754b9-7cv8q: {kubelet ca-minion-group-1-p98h} Pulled: Successfully pulled image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" in 1.025458835s (1.025468965s including waiting) Dec 1 19:36:40.131: INFO: At 2022-12-01 19:25:45 +0000 UTC - event for metrics-server-v0.5.2-867b8754b9-7cv8q: {kubelet ca-minion-group-1-p98h} Created: Created container metrics-server-nanny Dec 1 19:36:40.131: INFO: At 2022-12-01 19:25:46 +0000 UTC - event for kube-dns-autoscaler-5f6455f985: {replicaset-controller } FailedCreate: Error creating: pods "kube-dns-autoscaler-5f6455f985-z2n9n" is forbidden: pod.Spec.SecurityContext.SupplementalGroups is forbidden Dec 1 19:36:40.131: INFO: At 2022-12-01 19:25:49 +0000 UTC - event for metrics-server-v0.5.2-867b8754b9-7cv8q: {kubelet ca-minion-group-1-p98h} Unhealthy: Readiness probe failed: Get "https://10.64.2.3:10250/readyz": dial tcp 10.64.2.3:10250: connect: connection refused Dec 1 19:36:40.131: INFO: At 2022-12-01 19:25:49 +0000 UTC - event for metrics-server-v0.5.2-867b8754b9-7cv8q: {kubelet ca-minion-group-1-p98h} Started: Started container metrics-server-nanny Dec 1 19:36:40.131: INFO: At 2022-12-01 19:25:53 +0000 UTC - event for metrics-server-v0.5.2-867b8754b9-7cv8q: {kubelet ca-minion-group-1-p98h} Unhealthy: Liveness probe failed: Get "https://10.64.2.3:10250/livez": dial tcp 10.64.2.3:10250: connect: connection refused Dec 1 19:36:40.131: INFO: At 2022-12-01 19:26:00 +0000 UTC - event for l7-default-backend-8549d69d99-qmmwd: {kubelet ca-minion-group-fkwz} Created: Created container default-http-backend Dec 1 19:36:40.131: INFO: At 2022-12-01 19:26:00 +0000 UTC - event for l7-default-backend-8549d69d99-qmmwd: {kubelet ca-minion-group-fkwz} Pulled: Successfully pulled image "registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11" in 539.191557ms (539.21014ms including waiting) Dec 1 19:36:40.131: INFO: At 2022-12-01 19:26:00 +0000 UTC - event for l7-default-backend-8549d69d99-qmmwd: {kubelet ca-minion-group-fkwz} Pulling: Pulling image "registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11" Dec 1 19:36:40.131: INFO: At 2022-12-01 19:26:04 +0000 UTC - event for metrics-server-v0.5.2-867b8754b9-7cv8q: {kubelet ca-minion-group-1-p98h} Unhealthy: Liveness probe failed: Get "https://10.64.2.3:10250/livez": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Dec 1 19:36:40.131: INFO: At 2022-12-01 19:26:04 +0000 UTC - event for metrics-server-v0.5.2-867b8754b9-7cv8q: {kubelet ca-minion-group-1-p98h} Unhealthy: Readiness probe failed: Get "https://10.64.2.3:10250/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Dec 1 19:36:40.131: INFO: At 2022-12-01 19:26:13 +0000 UTC - event for metrics-server-v0.5.2-867b8754b9-7cv8q: {kubelet ca-minion-group-1-p98h} Unhealthy: Readiness probe failed: HTTP probe failed with statuscode: 500 Dec 1 19:36:40.131: INFO: At 2022-12-01 19:26:27 +0000 UTC - event for kube-dns-autoscaler-5f6455f985: {replicaset-controller } FailedCreate: Error creating: pods "kube-dns-autoscaler-5f6455f985-gtnr9" is forbidden: pod.Spec.SecurityContext.SupplementalGroups is forbidden Dec 1 19:36:40.131: INFO: At 2022-12-01 19:26:34 +0000 UTC - event for metrics-server-v0.5.2: {deployment-controller } ScalingReplicaSet: Scaled down replica set metrics-server-v0.5.2-6764bf875c to 0 from 1 Dec 1 19:36:40.131: INFO: At 2022-12-01 19:26:34 +0000 UTC - event for metrics-server-v0.5.2-6764bf875c: {replicaset-controller } SuccessfulDelete: Deleted pod: metrics-server-v0.5.2-6764bf875c-2z6tg Dec 1 19:36:40.131: INFO: At 2022-12-01 19:26:34 +0000 UTC - event for metrics-server-v0.5.2-6764bf875c-2z6tg: {kubelet ca-minion-group-fkwz} Killing: Stopping container metrics-server Dec 1 19:36:40.131: INFO: At 2022-12-01 19:26:34 +0000 UTC - event for metrics-server-v0.5.2-6764bf875c-2z6tg: {kubelet ca-minion-group-fkwz} Killing: Stopping container metrics-server-nanny Dec 1 19:36:40.131: INFO: At 2022-12-01 19:26:39 +0000 UTC - event for l7-default-backend-8549d69d99-qmmwd: {kubelet ca-minion-group-fkwz} Started: Started container default-http-backend Dec 1 19:36:40.131: INFO: At 2022-12-01 19:27:49 +0000 UTC - event for kube-dns-autoscaler-5f6455f985: {replicaset-controller } FailedCreate: Error creating: pods "kube-dns-autoscaler-5f6455f985-hjgmj" is forbidden: pod.Spec.SecurityContext.SupplementalGroups is forbidden Dec 1 19:36:40.131: INFO: At 2022-12-01 19:30:33 +0000 UTC - event for kube-dns-autoscaler-5f6455f985: {replicaset-controller } FailedCreate: Error creating: pods "kube-dns-autoscaler-5f6455f985-55slx" is forbidden: pod.Spec.SecurityContext.SupplementalGroups is forbidden Dec 1 19:36:40.131: INFO: At 2022-12-01 19:31:50 +0000 UTC - event for kube-dns-autoscaler-5f6455f985: {replicaset-controller } FailedCreate: Error creating: pods "kube-dns-autoscaler-5f6455f985-lqjgp" is forbidden: pod.Spec.SecurityContext.SupplementalGroups is forbidden Dec 1 19:36:40.131: INFO: At 2022-12-01 19:35:38 +0000 UTC - event for cluster-autoscaler-status: {cluster-autoscaler } ScaleDownEmpty: Scale-down: removing empty node ca-minion-group-36k6 Dec 1 19:36:40.131: INFO: At 2022-12-01 19:36:00 +0000 UTC - event for kube-dns-autoscaler-5f6455f985: {replicaset-controller } FailedCreate: (combined from similar events): Error creating: pods "kube-dns-autoscaler-5f6455f985-mqfnt" is forbidden: pod.Spec.SecurityContext.SupplementalGroups is forbidden Dec 1 19:36:40.131: INFO: At 2022-12-01 19:36:22 +0000 UTC - event for konnectivity-agent-kc44t: {node-controller } NodeNotReady: Node is not ready Dec 1 19:36:40.131: INFO: At 2022-12-01 19:36:22 +0000 UTC - event for kube-proxy-ca-minion-group-36k6: {node-controller } NodeNotReady: Node is not ready Dec 1 19:36:40.131: INFO: At 2022-12-01 19:36:22 +0000 UTC - event for metadata-proxy-v0.1-b7xw8: {node-controller } NodeNotReady: Node is not ready Dec 1 19:36:40.184: INFO: POD NODE PHASE GRACE CONDITIONS Dec 1 19:36:40.184: INFO: cluster-autoscaler-ca-master ca-master Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:24:44 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:22 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:24:44 +0000 UTC }] Dec 1 19:36:40.184: INFO: coredns-6d97d5ddb-vl7wz ca-minion-group-fkwz Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:20 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:26 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:26 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:20 +0000 UTC }] Dec 1 19:36:40.184: INFO: konnectivity-agent-gbhx6 ca-minion-group-1-p98h Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:32 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:32 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC }] Dec 1 19:36:40.184: INFO: konnectivity-agent-kc44t ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:32 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:30 +0000 UTC }] Dec 1 19:36:40.184: INFO: konnectivity-agent-rd4g6 ca-minion-group-fkwz Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:20 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:25 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:25 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:20 +0000 UTC }] Dec 1 19:36:40.184: INFO: kube-proxy-ca-minion-group-1-p98h ca-minion-group-1-p98h Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:14 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:16 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:16 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:14 +0000 UTC }] Dec 1 19:36:40.184: INFO: kube-proxy-ca-minion-group-36k6 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:17 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:40.184: INFO: kube-proxy-ca-minion-group-fkwz ca-minion-group-fkwz Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:10 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:12 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:12 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:10 +0000 UTC }] Dec 1 19:36:40.184: INFO: l7-default-backend-8549d69d99-qmmwd ca-minion-group-fkwz Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:20 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:26:40 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:26:40 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:20 +0000 UTC }] Dec 1 19:36:40.184: INFO: l7-lb-controller-ca-master ca-master Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:24:44 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:17 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:17 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:24:44 +0000 UTC }] Dec 1 19:36:40.184: INFO: metadata-proxy-v0.1-b7xw8 ca-minion-group-36k6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:36:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:21 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:40.184: INFO: metadata-proxy-v0.1-k6m42 ca-minion-group-fkwz Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:11 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:16 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:16 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:10 +0000 UTC }] Dec 1 19:36:40.184: INFO: metadata-proxy-v0.1-nrpg4 ca-minion-group-1-p98h Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:20 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:20 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:15 +0000 UTC }] Dec 1 19:36:40.184: INFO: metadata-proxy-v0.1-rq9p5 ca-master Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:10 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:44 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:44 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:08 +0000 UTC }] Dec 1 19:36:40.184: INFO: metrics-server-v0.5.2-867b8754b9-7cv8q ca-minion-group-1-p98h Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:33 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:26:33 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:26:33 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:33 +0000 UTC }] Dec 1 19:36:40.184: INFO: volume-snapshot-controller-0 ca-minion-group-fkwz Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:20 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:25 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:25 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-01 19:25:20 +0000 UTC }] Dec 1 19:36:40.184: INFO: Dec 1 19:36:45.410: INFO: Unable to fetch kube-system/konnectivity-agent-kc44t/konnectivity-agent logs: an error on the server ("unknown") has prevented the request from succeeding (get pods konnectivity-agent-kc44t) Dec 1 19:36:45.502: INFO: Logging node info for node ca-master Dec 1 19:36:45.545: INFO: Node Info: &Node{ObjectMeta:{ca-master 5ac10ec3-ab44-47a4-8121-c68cdb9420f8 2285 0 2022-12-01 19:25:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:ca-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-01 19:25:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-12-01 19:25:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kube-controller-manager Update v1 2022-12-01 19:25:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-12-01 19:35:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-autoscaling-migs/us-west1-b/ca-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-01 19:25:20 +0000 UTC,LastTransitionTime:2022-12-01 19:25:20 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-01 19:35:40 +0000 UTC,LastTransitionTime:2022-12-01 19:25:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-01 19:35:40 +0000 UTC,LastTransitionTime:2022-12-01 19:25:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-01 19:35:40 +0000 UTC,LastTransitionTime:2022-12-01 19:25:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-01 19:35:40 +0000 UTC,LastTransitionTime:2022-12-01 19:25:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.82.83.63,},NodeAddress{Type:InternalDNS,Address:ca-master.c.k8s-jkns-gci-autoscaling-migs.internal,},NodeAddress{Type:Hostname,Address:ca-master.c.k8s-jkns-gci-autoscaling-migs.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:bac070a384fefb9133ee7878e15673cf,SystemUUID:bac070a3-84fe-fb91-33ee-7878e15673cf,BootID:445ccd95-fe85-462f-b263-263c82f783e5,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.6.6,KubeletVersion:v1.27.0-alpha.0.56+3e26e104bdf9d0,KubeProxyVersion:v1.27.0-alpha.0.56+3e26e104bdf9d0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.56_3e26e104bdf9d0],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.56_3e26e104bdf9d0],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.56_3e26e104bdf9d0],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/autoscaling/cluster-autoscaler@sha256:07ab8c89cd0ad296ddb6347febe196d8fe0e1c757656a98f71199860d87cf1a5 registry.k8s.io/autoscaling/cluster-autoscaler:v1.22.0],SizeBytes:24220268,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 1 19:36:45.546: INFO: Logging kubelet events for node ca-master Dec 1 19:36:45.589: INFO: Logging pods the kubelet thinks is on node ca-master Dec 1 19:36:45.641: INFO: etcd-server-events-ca-master started at 2022-12-01 19:24:24 +0000 UTC (0+1 container statuses recorded) Dec 1 19:36:45.641: INFO: Container etcd-container ready: true, restart count 0 Dec 1 19:36:45.641: INFO: etcd-server-ca-master started at 2022-12-01 19:24:24 +0000 UTC (0+1 container statuses recorded) Dec 1 19:36:45.641: INFO: Container etcd-container ready: true, restart count 0 Dec 1 19:36:45.641: INFO: konnectivity-server-ca-master started at 2022-12-01 19:24:24 +0000 UTC (0+1 container statuses recorded) Dec 1 19:36:45.641: INFO: Container konnectivity-server-container ready: true, restart count 0 Dec 1 19:36:45.641: INFO: kube-apiserver-ca-master started at 2022-12-01 19:24:25 +0000 UTC (0+1 container statuses recorded) Dec 1 19:36:45.641: INFO: Container kube-apiserver ready: true, restart count 0 Dec 1 19:36:45.641: INFO: kube-controller-manager-ca-master started at 2022-12-01 19:24:25 +0000 UTC (0+1 container statuses recorded) Dec 1 19:36:45.641: INFO: Container kube-controller-manager ready: true, restart count 1 Dec 1 19:36:45.641: INFO: cluster-autoscaler-ca-master started at 2022-12-01 19:24:44 +0000 UTC (0+1 container statuses recorded) Dec 1 19:36:45.641: INFO: Container cluster-autoscaler ready: true, restart count 2 Dec 1 19:36:45.641: INFO: metadata-proxy-v0.1-rq9p5 started at 2022-12-01 19:25:10 +0000 UTC (0+2 container statuses recorded) Dec 1 19:36:45.641: INFO: Container metadata-proxy ready: true, restart count 0 Dec 1 19:36:45.641: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 1 19:36:45.641: INFO: kube-scheduler-ca-master started at 2022-12-01 19:24:25 +0000 UTC (0+1 container statuses recorded) Dec 1 19:36:45.641: INFO: Container kube-scheduler ready: true, restart count 0 Dec 1 19:36:45.641: INFO: kube-addon-manager-ca-master started at 2022-12-01 19:24:44 +0000 UTC (0+1 container statuses recorded) Dec 1 19:36:45.641: INFO: Container kube-addon-manager ready: true, restart count 0 Dec 1 19:36:45.641: INFO: l7-lb-controller-ca-master started at 2022-12-01 19:24:44 +0000 UTC (0+1 container statuses recorded) Dec 1 19:36:45.641: INFO: Container l7-lb-controller ready: true, restart count 2 Dec 1 19:36:45.839: INFO: Latency metrics for node ca-master Dec 1 19:36:45.839: INFO: Logging node info for node ca-minion-group-1-p98h Dec 1 19:36:45.882: INFO: Node Info: &Node{ObjectMeta:{ca-minion-group-1-p98h a63e3f10-0d69-41f7-9c21-a2cd8569b1ce 2417 0 2022-12-01 19:25:14 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:ca-minion-group-1-p98h kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-01 19:25:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-12-01 19:25:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-12-01 19:25:30 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-12-01 19:35:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-01 19:36:27 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-autoscaling-migs/us-west1-b/ca-minion-group-1-p98h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-12-01 19:35:20 +0000 UTC,LastTransitionTime:2022-12-01 19:25:18 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-12-01 19:35:20 +0000 UTC,LastTransitionTime:2022-12-01 19:25:18 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-12-01 19:35:20 +0000 UTC,LastTransitionTime:2022-12-01 19:25:18 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-12-01 19:35:20 +0000 UTC,LastTransitionTime:2022-12-01 19:25:18 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-12-01 19:35:20 +0000 UTC,LastTransitionTime:2022-12-01 19:25:18 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-12-01 19:35:20 +0000 UTC,LastTransitionTime:2022-12-01 19:25:18 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-12-01 19:35:20 +0000 UTC,LastTransitionTime:2022-12-01 19:25:18 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-01 19:25:30 +0000 UTC,LastTransitionTime:2022-12-01 19:25:30 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-01 19:36:27 +0000 UTC,LastTransitionTime:2022-12-01 19:25:14 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-01 19:36:27 +0000 UTC,LastTransitionTime:2022-12-01 19:25:14 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-01 19:36:27 +0000 UTC,LastTransitionTime:2022-12-01 19:25:14 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-01 19:36:27 +0000 UTC,LastTransitionTime:2022-12-01 19:25:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:35.227.188.214,},NodeAddress{Type:InternalDNS,Address:ca-minion-group-1-p98h.c.k8s-jkns-gci-autoscaling-migs.internal,},NodeAddress{Type:Hostname,Address:ca-minion-group-1-p98h.c.k8s-jkns-gci-autoscaling-migs.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:b9aaf2bf4cb34132f83c831463b8901a,SystemUUID:b9aaf2bf-4cb3-4132-f83c-831463b8901a,BootID:8881897a-9026-4be8-b147-4f206cc8f5b2,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.6.6,KubeletVersion:v1.27.0-alpha.0.56+3e26e104bdf9d0,KubeProxyVersion:v1.27.0-alpha.0.56+3e26e104bdf9d0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.56_3e26e104bdf9d0],SizeBytes:67201736,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 1 19:36:45.883: INFO: Logging kubelet events for node ca-minion-group-1-p98h Dec 1 19:36:45.926: INFO: Logging pods the kubelet thinks is on node ca-minion-group-1-p98h Dec 1 19:36:45.973: INFO: metrics-server-v0.5.2-867b8754b9-7cv8q started at 2022-12-01 19:25:33 +0000 UTC (0+2 container statuses recorded) Dec 1 19:36:45.973: INFO: Container metrics-server ready: true, restart count 0 Dec 1 19:36:45.973: INFO: Container metrics-server-nanny ready: true, restart count 0 Dec 1 19:36:45.973: INFO: kube-proxy-ca-minion-group-1-p98h started at 2022-12-01 19:25:14 +0000 UTC (0+1 container statuses recorded) Dec 1 19:36:45.973: INFO: Container kube-proxy ready: true, restart count 0 Dec 1 19:36:45.973: INFO: metadata-proxy-v0.1-nrpg4 started at 2022-12-01 19:25:15 +0000 UTC (0+2 container statuses recorded) Dec 1 19:36:45.973: INFO: Container metadata-proxy ready: true, restart count 0 Dec 1 19:36:45.973: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 1 19:36:45.973: INFO: konnectivity-agent-gbhx6 started at 2022-12-01 19:25:30 +0000 UTC (0+1 container statuses recorded) Dec 1 19:36:45.973: INFO: Container konnectivity-agent ready: true, restart count 0 Dec 1 19:36:46.288: INFO: Latency metrics for node ca-minion-group-1-p98h Dec 1 19:36:46.288: INFO: Logging node info for node ca-minion-group-36k6 Dec 1 19:36:46.454: INFO: Node Info: &Node{ObjectMeta:{ca-minion-group-36k6 c8193b36-ac5c-4386-89f4-fd0b6ea45235 2416 0 2022-12-01 19:25:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:ca-minion-group-36k6 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-01 19:25:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-01 19:30:52 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-12-01 19:35:19 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-01 19:36:22 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}},"k:{\"type\":\"Ready\"}":{"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-12-01 19:36:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}},"f:taints":{}}} }]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-autoscaling-migs/us-west1-b/ca-minion-group-36k6,Unschedulable:false,Taints:[]Taint{Taint{Key:DeletionCandidateOfClusterAutoscaler,Value:1669922733,Effect:PreferNoSchedule,TimeAdded:<nil>,},Taint{Key:ToBeDeletedByClusterAutoscaler,Value:1669923338,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoSchedule,TimeAdded:2022-12-01 19:36:22 +0000 UTC,},Taint{Key:node.kubernetes.io/unreachable,Value:,Effect:NoExecute,TimeAdded:2022-12-01 19:36:27 +0000 UTC,},},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-12-01 19:35:19 +0000 UTC,LastTransitionTime:2022-12-01 19:25:18 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-12-01 19:35:19 +0000 UTC,LastTransitionTime:2022-12-01 19:25:18 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-12-01 19:35:19 +0000 UTC,LastTransitionTime:2022-12-01 19:25:18 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-12-01 19:35:19 +0000 UTC,LastTransitionTime:2022-12-01 19:25:18 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-12-01 19:35:19 +0000 UTC,LastTransitionTime:2022-12-01 19:25:18 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-12-01 19:35:19 +0000 UTC,LastTransitionTime:2022-12-01 19:25:18 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-12-01 19:35:19 +0000 UTC,LastTransitionTime:2022-12-01 19:25:18 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-01 19:25:30 +0000 UTC,LastTransitionTime:2022-12-01 19:25:30 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:Unknown,LastHeartbeatTime:2022-12-01 19:30:52 +0000 UTC,LastTransitionTime:2022-12-01 19:36:22 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:DiskPressure,Status:Unknown,LastHeartbeatTime:2022-12-01 19:30:52 +0000 UTC,LastTransitionTime:2022-12-01 19:36:22 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:PIDPressure,Status:Unknown,LastHeartbeatTime:2022-12-01 19:30:52 +0000 UTC,LastTransitionTime:2022-12-01 19:36:22 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},NodeCondition{Type:Ready,Status:Unknown,LastHeartbeatTime:2022-12-01 19:30:52 +0000 UTC,LastTransitionTime:2022-12-01 19:36:22 +0000 UTC,Reason:NodeStatusUnknown,Message:Kubelet stopped posting node status.,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.105.13.14,},NodeAddress{Type:InternalDNS,Address:ca-minion-group-36k6.c.k8s-jkns-gci-autoscaling-migs.internal,},NodeAddress{Type:Hostname,Address:ca-minion-group-36k6.c.k8s-jkns-gci-autoscaling-migs.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2ef2bb526ee701396cbdfeb5e63b5ee2,SystemUUID:2ef2bb52-6ee7-0139-6cbd-feb5e63b5ee2,BootID:5a4264fd-dd59-4027-890e-4a8770c5b609,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.6.6,KubeletVersion:v1.27.0-alpha.0.56+3e26e104bdf9d0,KubeProxyVersion:v1.27.0-alpha.0.56+3e26e104bdf9d0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.56_3e26e104bdf9d0],SizeBytes:67201736,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 1 19:36:46.455: INFO: Logging kubelet events for node ca-minion-group-36k6 Dec 1 19:36:46.658: INFO: Logging pods the kubelet thinks is on node ca-minion-group-36k6 Dec 1 19:36:51.857: INFO: Unable to retrieve kubelet pods for node ca-minion-group-36k6: error trying to reach service: dial tcp 10.138.0.4:10250: i/o timeout Dec 1 19:36:51.857: INFO: Logging node info for node ca-minion-group-fkwz Dec 1 19:36:51.901: INFO: Node Info: &Node{ObjectMeta:{ca-minion-group-fkwz 9b3afa30-7e72-452a-bee6-7a9e028dbd0f 2401 0 2022-12-01 19:25:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:ca-minion-group-fkwz kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-01 19:25:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-12-01 19:25:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-12-01 19:25:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-12-01 19:35:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-01 19:36:22 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-autoscaling-migs/us-west1-b/ca-minion-group-fkwz,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-12-01 19:35:15 +0000 UTC,LastTransitionTime:2022-12-01 19:25:13 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-12-01 19:35:15 +0000 UTC,LastTransitionTime:2022-12-01 19:25:13 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-12-01 19:35:15 +0000 UTC,LastTransitionTime:2022-12-01 19:25:13 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-12-01 19:35:15 +0000 UTC,LastTransitionTime:2022-12-01 19:25:13 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-12-01 19:35:15 +0000 UTC,LastTransitionTime:2022-12-01 19:25:13 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-12-01 19:35:15 +0000 UTC,LastTransitionTime:2022-12-01 19:25:13 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-12-01 19:35:15 +0000 UTC,LastTransitionTime:2022-12-01 19:25:13 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-01 19:25:20 +0000 UTC,LastTransitionTime:2022-12-01 19:25:20 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-01 19:36:22 +0000 UTC,LastTransitionTime:2022-12-01 19:25:10 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-01 19:36:22 +0000 UTC,LastTransitionTime:2022-12-01 19:25:10 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-01 19:36:22 +0000 UTC,LastTransitionTime:2022-12-01 19:25:10 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-01 19:36:22 +0000 UTC,LastTransitionTime:2022-12-01 19:25:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.84.140,},NodeAddress{Type:InternalDNS,Address:ca-minion-group-fkwz.c.k8s-jkns-gci-autoscaling-migs.internal,},NodeAddress{Type:Hostname,Address:ca-minion-group-fkwz.c.k8s-jkns-gci-autoscaling-migs.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:53a6123be745a7f7a8140b8b85b0ba3f,SystemUUID:53a6123b-e745-a7f7-a814-0b8b85b0ba3f,BootID:8d942b5e-0e92-4eef-aef0-421ea49de5be,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.6.6,KubeletVersion:v1.27.0-alpha.0.56+3e26e104bdf9d0,KubeProxyVersion:v1.27.0-alpha.0.56+3e26e104bdf9d0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.56_3e26e104bdf9d0],SizeBytes:67201736,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 1 19:36:51.901: INFO: Logging kubelet events for node ca-minion-group-fkwz Dec 1 19:36:51.944: INFO: Logging pods the kubelet thinks is on node ca-minion-group-fkwz Dec 1 19:36:51.994: INFO: l7-default-backend-8549d69d99-qmmwd started at 2022-12-01 19:25:20 +0000 UTC (0+1 container statuses recorded) Dec 1 19:36:51.994: INFO: Container default-http-backend ready: true, restart count 0 Dec 1 19:36:51.994: INFO: konnectivity-agent-rd4g6 started at 2022-12-01 19:25:20 +0000 UTC (0+1 container statuses recorded) Dec 1 19:36:51.994: INFO: Container konnectivity-agent ready: true, restart count 0 Dec 1 19:36:51.994: INFO: kube-proxy-ca-minion-group-fkwz started at 2022-12-01 19:25:10 +0000 UTC (0+1 container statuses recorded) Dec 1 19:36:51.994: INFO: Container kube-proxy ready: true, restart count 0 Dec 1 19:36:51.994: INFO: metadata-proxy-v0.1-k6m42 started at 2022-12-01 19:25:11 +0000 UTC (0+2 container statuses recorded) Dec 1 19:36:51.994: INFO: Container metadata-proxy ready: true, restart count 0 Dec 1 19:36:51.994: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Dec 1 19:36:51.994: INFO: coredns-6d97d5ddb-vl7wz started at 2022-12-01 19:25:20 +0000 UTC (0+1 container statuses recorded) Dec 1 19:36:51.994: INFO: Container coredns ready: true, restart count 0 Dec 1 19:36:51.994: INFO: volume-snapshot-controller-0 started at 2022-12-01 19:25:20 +0000 UTC (0+1 container statuses recorded) Dec 1 19:36:51.994: INFO: Container volume-snapshot-controller ready: true, restart count 0 Dec 1 19:36:52.167: INFO: Latency metrics for node ca-minion-group-fkwz Dec 1 19:36:52.224: INFO: Running kubectl logs on non-ready containers in kube-system ------------------------------ Automatically polling progress: In [SynchronizedBeforeSuite] (Node Runtime: 10m40.027s) test/e2e/e2e.go:77 At [By Step] Found 156 events. (Step Runtime: 18.011s) test/e2e/framework/debug/dump.go:46 Spec Goroutine goroutine 137 [select] k8s.io/kubernetes/vendor/golang.org/x/net/http2.(*ClientConn).RoundTrip(0xc000470d80, 0xc003788000) vendor/golang.org/x/net/http2/transport.go:1200 k8s.io/kubernetes/vendor/golang.org/x/net/http2.(*Transport).RoundTripOpt(0xc0009f8a80, 0xc003788000, {0xe0?}) vendor/golang.org/x/net/http2/transport.go:519 k8s.io/kubernetes/vendor/golang.org/x/net/http2.(*Transport).RoundTrip(...) vendor/golang.org/x/net/http2/transport.go:480 k8s.io/kubernetes/vendor/golang.org/x/net/http2.noDialH2RoundTripper.RoundTrip({0xc0032b8000?}, 0xc003788000?) vendor/golang.org/x/net/http2/transport.go:3020 net/http.(*Transport).roundTrip(0xc0032b8000, 0xc003788000) /usr/local/go/src/net/http/transport.go:540 net/http.(*Transport).RoundTrip(0x6fe4b20?, 0xc00367e2d0?) /usr/local/go/src/net/http/roundtrip.go:17 k8s.io/kubernetes/vendor/k8s.io/client-go/transport.(*bearerAuthRoundTripper).RoundTrip(0xc003263cb0, 0xc003547f00) vendor/k8s.io/client-go/transport/round_trippers.go:317 k8s.io/kubernetes/vendor/k8s.io/client-go/transport.(*userAgentRoundTripper).RoundTrip(0xc003291720, 0xc003547e00) vendor/k8s.io/client-go/transport/round_trippers.go:168 net/http.send(0xc003547e00, {0x7fad100, 0xc003291720}, {0x74d54e0?, 0x1?, 0x0?}) /usr/local/go/src/net/http/client.go:251 net/http.(*Client).send(0xc003263ce0, 0xc003547e00, {0x7f570c898108?, 0x100?, 0x0?}) /usr/local/go/src/net/http/client.go:175 net/http.(*Client).do(0xc003263ce0, 0xc003547e00) /usr/local/go/src/net/http/client.go:715 net/http.(*Client).Do(...) /usr/local/go/src/net/http/client.go:581 k8s.io/kubernetes/vendor/k8s.io/client-go/rest.(*Request).request(0xc003547c00, {0x7fe0bc8, 0xc00013c008}, 0x7f56dcf727e8?) vendor/k8s.io/client-go/rest/request.go:964 k8s.io/kubernetes/vendor/k8s.io/client-go/rest.(*Request).Do(0xc003547c00, {0x7fe0bc8, 0xc00013c008}) vendor/k8s.io/client-go/rest/request.go:1005 > k8s.io/kubernetes/test/e2e/framework/pod.getPodLogsInternal({0x801de88?, 0xc000e949c0?}, {0xc002a97620, 0xb}, {0xc0010d7290, 0x18}, {0xc0010d7440, 0x12}, 0x1, 0x0, ...) test/e2e/framework/pod/resource.go:572 > k8s.io/kubernetes/test/e2e/framework/pod.GetPreviousPodLogs(...) test/e2e/framework/pod/resource.go:555 > k8s.io/kubernetes/test/e2e/framework/kubectl.kubectlLogPod({_, _}, {{{0x0, 0x0}, {0x0, 0x0}}, {{0xc0010d7290, 0x18}, {0xc0010d72a8, 0x13}, ...}, ...}, ...) test/e2e/framework/kubectl/kubectl_utils.go:123 > k8s.io/kubernetes/test/e2e/framework/kubectl.LogFailedContainers({0x801de88, 0xc000e949c0}, {0x75ce977, 0xb}, 0x78959b8) test/e2e/framework/kubectl/kubectl_utils.go:112 > k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:248 > k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractSynchronizedBeforeSuiteProc1Body.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:472 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runSuiteNode.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/suite.go:555 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 1 [chan receive, 10 minutes] testing.(*T).Run(0xc0009fc4e0, {0x75bea0a?, 0x2755a25?}, 0x78952c8) /usr/local/go/src/testing/testing.go:1494 testing.runTests.func1(0xc0009fc4e0?) /usr/local/go/src/testing/testing.go:1846 testing.tRunner(0xc0009fc4e0, 0xc00121f7f0) /usr/local/go/src/testing/testing.go:1446 testing.runTests(0xc000bbcaa0?, {0xac3b7e0, 0x1, 0x1}, {0x0?, 0xf45d27d13bdefcb0?, 0x0?}) /usr/local/go/src/testing/testing.go:1844 testing.(*M).Run(0xc000bbcaa0) /usr/local/go/src/testing/testing.go:1726 > k8s.io/kubernetes/test/e2e.TestMain(0xffffffffffffffff?) test/e2e/e2e_test.go:142 main.main() /tmp.k8s/go-build4026029738/b001/_testmain.go:49 ------------------------------ Dec 1 19:37:02.346: INFO: Failed to get logs of pod konnectivity-agent-kc44t, container konnectivity-agent, err: an error on the server ("unknown") has prevented the request from succeeding (get pods konnectivity-agent-kc44t) Dec 1 19:37:02.346: INFO: Logs of kube-system/konnectivity-agent-kc44t:konnectivity-agent on node ca-minion-group-36k6 Dec 1 19:37:02.346: INFO: : STARTLOG ENDLOG for container kube-system:konnectivity-agent-kc44t:konnectivity-agent Dec 1 19:37:12.495: INFO: Failed to get logs of pod kube-proxy-ca-minion-group-36k6, container kube-proxy, err: an error on the server ("unknown") has prevented the request from succeeding (get pods kube-proxy-ca-minion-group-36k6) Dec 1 19:37:12.495: INFO: Logs of kube-system/kube-proxy-ca-minion-group-36k6:kube-proxy on node ca-minion-group-36k6 Dec 1 19:37:12.495: INFO: : STARTLOG ENDLOG for container kube-system:kube-proxy-ca-minion-group-36k6:kube-proxy ------------------------------ Automatically polling progress: In [SynchronizedBeforeSuite] (Node Runtime: 11m0.028s) test/e2e/e2e.go:77 At [By Step] Found 156 events. (Step Runtime: 38.012s) test/e2e/framework/debug/dump.go:46 Spec Goroutine goroutine 137 [select] k8s.io/kubernetes/vendor/golang.org/x/net/http2.(*ClientConn).RoundTrip(0xc000470d80, 0xc002d9b800) vendor/golang.org/x/net/http2/transport.go:1200 k8s.io/kubernetes/vendor/golang.org/x/net/http2.(*Transport).RoundTripOpt(0xc0009f8a80, 0xc002d9b800, {0xe0?}) vendor/golang.org/x/net/http2/transport.go:519 k8s.io/kubernetes/vendor/golang.org/x/net/http2.(*Transport).RoundTrip(...) vendor/golang.org/x/net/http2/transport.go:480 k8s.io/kubernetes/vendor/golang.org/x/net/http2.noDialH2RoundTripper.RoundTrip({0xc0032b8000?}, 0xc002d9b800?) vendor/golang.org/x/net/http2/transport.go:3020 net/http.(*Transport).roundTrip(0xc0032b8000, 0xc002d9b800) /usr/local/go/src/net/http/transport.go:540 net/http.(*Transport).RoundTrip(0x6fe4b20?, 0xc002edc540?) /usr/local/go/src/net/http/roundtrip.go:17 k8s.io/kubernetes/vendor/k8s.io/client-go/transport.(*bearerAuthRoundTripper).RoundTrip(0xc003263cb0, 0xc002d9b700) vendor/k8s.io/client-go/transport/round_trippers.go:317 k8s.io/kubernetes/vendor/k8s.io/client-go/transport.(*userAgentRoundTripper).RoundTrip(0xc003291720, 0xc002d9b600) vendor/k8s.io/client-go/transport/round_trippers.go:168 net/http.send(0xc002d9b600, {0x7fad100, 0xc003291720}, {0x74d54e0?, 0x1?, 0x0?}) /usr/local/go/src/net/http/client.go:251 net/http.(*Client).send(0xc003263ce0, 0xc002d9b600, {0x7f570c8985b8?, 0x100?, 0x0?}) /usr/local/go/src/net/http/client.go:175 net/http.(*Client).do(0xc003263ce0, 0xc002d9b600) /usr/local/go/src/net/http/client.go:715 net/http.(*Client).Do(...) /usr/local/go/src/net/http/client.go:581 k8s.io/kubernetes/vendor/k8s.io/client-go/rest.(*Request).request(0xc002d9b400, {0x7fe0bc8, 0xc00013c008}, 0x7f56dcf60550?) vendor/k8s.io/client-go/rest/request.go:964 k8s.io/kubernetes/vendor/k8s.io/client-go/rest.(*Request).Do(0xc002d9b400, {0x7fe0bc8, 0xc00013c008}) vendor/k8s.io/client-go/rest/request.go:1005 > k8s.io/kubernetes/test/e2e/framework/pod.getPodLogsInternal({0x801de88?, 0xc000e949c0?}, {0xc0036ea990, 0xb}, {0xc0047ac680, 0x19}, {0xc0036eaa90, 0xe}, 0x1, 0x0, ...) test/e2e/framework/pod/resource.go:572 > k8s.io/kubernetes/test/e2e/framework/pod.GetPreviousPodLogs(...) test/e2e/framework/pod/resource.go:555 > k8s.io/kubernetes/test/e2e/framework/kubectl.kubectlLogPod({_, _}, {{{0x0, 0x0}, {0x0, 0x0}}, {{0xc0047ac680, 0x19}, {0xc0031d0408, 0x14}, ...}, ...}, ...) test/e2e/framework/kubectl/kubectl_utils.go:123 > k8s.io/kubernetes/test/e2e/framework/kubectl.LogFailedContainers({0x801de88, 0xc000e949c0}, {0x75ce977, 0xb}, 0x78959b8) test/e2e/framework/kubectl/kubectl_utils.go:112 > k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:248 > k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractSynchronizedBeforeSuiteProc1Body.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:472 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runSuiteNode.func1({0x7fe9368?, 0xc003252e80?}) vendor/github.com/onsi/ginkgo/v2/internal/suite.go:555 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 Goroutines of Interest goroutine 1 [chan receive, 11 minutes] testing.(*T).Run(0xc0009fc4e0, {0x75bea0a?, 0x2755a25?}, 0x78952c8) /usr/local/go/src/testing/testing.go:1494 testing.runTests.func1(0xc0009fc4e0?) /usr/local/go/src/testing/testing.go:1846 testing.tRunner(0xc0009fc4e0, 0xc00121f7f0) /usr/local/go/src/testing/testing.go:1446 testing.runTests(0xc000bbcaa0?, {0xac3b7e0, 0x1, 0x1}, {0x0?, 0xf45d27d13bdefcb0?, 0x0?}) /usr/local/go/src/testing/testing.go:1844 testing.(*M).Run(0xc000bbcaa0) /usr/local/go/src/testing/testing.go:1726 > k8s.io/kubernetes/test/e2e.TestMain(0xffffffffffffffff?) test/e2e/e2e_test.go:142 main.main() /tmp.k8s/go-build4026029738/b001/_testmain.go:49 ------------------------------ Dec 1 19:37:22.602: INFO: Failed to get logs of pod metadata-proxy-v0.1-b7xw8, container metadata-proxy, err: an error on the server ("unknown") has prevented the request from succeeding (get pods metadata-proxy-v0.1-b7xw8) Dec 1 19:37:22.602: INFO: Logs of kube-system/metadata-proxy-v0.1-b7xw8:metadata-proxy on node ca-minion-group-36k6 Dec 1 19:37:22.602: INFO: : STARTLOG ENDLOG for container kube-system:metadata-proxy-v0.1-b7xw8:metadata-proxy Dec 1 19:37:32.724: INFO: Failed to get logs of pod metadata-proxy-v0.1-b7xw8, container prometheus-to-sd-exporter, err: an error on the server ("unknown") has prevented the request from succeeding (get pods metadata-proxy-v0.1-b7xw8) Dec 1 19:37:32.724: INFO: Logs of kube-system/metadata-proxy-v0.1-b7xw8:prometheus-to-sd-exporter on node ca-minion-group-36k6 Dec 1 19:37:32.724: INFO: : STARTLOG ENDLOG for container kube-system:metadata-proxy-v0.1-b7xw8:prometheus-to-sd-exporter Dec 1 19:37:32.724: FAIL: Error waiting for all pods to be running and ready: 3 / 16 pods in namespace kube-system are NOT in RUNNING and READY state in 10m0s POD NODE PHASE GRACE CONDITIONS konnectivity-agent-kc44t ca-minion-group-36k6 Running [{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-12-01 19:25:30 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-12-01 19:36:22 +0000 UTC Reason: Message:} {Type:ContainersReady Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-12-01 19:25:32 +0000 UTC Reason: Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-12-01 19:25:30 +0000 UTC Reason: Message:}] kube-proxy-ca-minion-group-36k6 ca-minion-group-36k6 Running [{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-12-01 19:25:15 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-12-01 19:36:22 +0000 UTC Reason: Message:} {Type:ContainersReady Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-12-01 19:25:17 +0000 UTC Reason: Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-12-01 19:25:15 +0000 UTC Reason: Message:}] metadata-proxy-v0.1-b7xw8 ca-minion-group-36k6 Running [{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-12-01 19:25:16 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-12-01 19:36:22 +0000 UTC Reason: Message:} {Type:ContainersReady Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-12-01 19:25:21 +0000 UTC Reason: Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-12-01 19:25:15 +0000 UTC Reason: Message:}] Full Stack Trace k8s.io/kubernetes/test/e2e.setupSuite() test/e2e/e2e.go:249 +0x4de k8s.io/kubernetes/test/e2e.glob..func1() test/e2e/e2e.go:81 +0x8f reflect.Value.call({0x66a9bc0?, 0x78952d0?, 0x13?}, {0x75b6e72, 0x4}, {0xc0000c7f20, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x66a9bc0?, 0x78952d0?, 0x0?}, {0xc00047a720?, 0x0?, 0x0?}) /usr/local/go/src/reflect/value.go:368 +0xbc
Filter through log files | View test history on testgrid
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:ClusterSizeAutoscalingScaleUp\]|\[Feature:ClusterSizeAutoscalingScaleDown\] --ginkgo.skip=\[Flaky\] --minStartupPods=8 --report-dir=/workspace/_artifacts --disable-log-dump=true --cluster-ip-range=10.64.0.0/14: exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
Kubernetes e2e suite [ReportAfterSuite] Kubernetes e2e suite report
Kubernetes e2e suite [SynchronizedAfterSuite]
kubetest Check APIReachability
kubetest Deferred TearDown
kubetest DumpClusterLogs
kubetest Extract
kubetest GetDeployer
kubetest IsUp
kubetest Prepare
kubetest TearDown
kubetest TearDown Previous
kubetest Timeout
kubetest Up
kubetest kubectl version
kubetest list nodes
kubetest test setup