This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 0 succeeded
Started2022-08-12 17:42
Elapsed1h42m
Revisionmaster

Test Failures


k8s.io/kubernetes/test/integration/scheduler_perf TestMain 0.00s

go test -v k8s.io/kubernetes/test/integration/scheduler_perf -run TestMain$
goos: linux
goarch: amd64
pkg: k8s.io/kubernetes/test/integration/scheduler_perf
cpu: Intel(R) Xeon(R) CPU @ 2.30GHz
BenchmarkPerfScheduling
BenchmarkPerfScheduling/SchedulingBasic
BenchmarkPerfScheduling/SchedulingBasic/500Nodes
E0812 17:47:38.212908   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 17:47:38.226058   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/500Nodes-8         	       1	14835577581 ns/op	1804584856 B/op	18788277 allocs/op
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes
E0812 17:49:15.378597   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 17:49:15.394582   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes-8        	       1	52233937043 ns/op	4431587784 B/op	48033635 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes
E0812 17:49:37.051587   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 17:49:37.081384   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes-8         	       1	16234706287 ns/op	1155785192 B/op	11313585 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes
E0812 17:52:05.012690   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 17:52:05.030710   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes-8        	       1	101262435236 ns/op	10024489344 B/op	101658428 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes
E0812 17:52:25.045226   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 17:52:25.080575   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes-8                 	       1	14081209483 ns/op	2102662120 B/op	22458554 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes
E0812 17:54:38.433265   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 17:54:38.447107   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes-8                	       1	84322949471 ns/op	14575361776 B/op	157520356 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes
E0812 17:55:13.024195   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 17:55:13.056514   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes-8               	       1	28333087146 ns/op	5401298288 B/op	68590320 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes
E0812 17:59:18.536820   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 17:59:18.549476   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes-8              	       1	195322317664 ns/op	46795611040 B/op	531520873 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes
E0812 17:59:57.411606   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 17:59:57.429229   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes-8       	       1	32711769969 ns/op	7386569512 B/op	77052685 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes
E0812 18:05:03.489566   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:05:03.547669   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes-8      	       1	229612576954 ns/op	56810749536 B/op	561504578 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes
E0812 18:06:06.439062   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:06:06.466791   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes-8                  	       1	51496367753 ns/op	4116284856 B/op	53463099 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes
E0812 18:12:24.681540   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:12:24.707408   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes-8                 	       1	298905097548 ns/op	35780457608 B/op	407948053 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes
E0812 18:13:02.724000   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:13:02.747593   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes-8             	       1	29102313710 ns/op	2654860136 B/op	26089456 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes
E0812 18:18:16.629769   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:18:16.653551   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes-8            	       1	240576228093 ns/op	36579622464 B/op	340352076 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes
E0812 18:18:50.934706   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:18:50.956746   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes-8    	       1	26212758956 ns/op	2064251920 B/op	22277228 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes
E0812 18:23:13.410192   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:23:13.449443   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes-8   	       1	190494275650 ns/op	17329266056 B/op	201557850 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes
E0812 18:23:47.988825   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:23:48.010238   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes-8         	       1	26179002684 ns/op	2072143448 B/op	22320300 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes
E0812 18:28:02.252891   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:28:02.273019   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes-8        	       1	184893440152 ns/op	17163538736 B/op	200149252 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes
E0812 18:28:33.312601   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:28:33.332571   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes-8                     	       1	23171070319 ns/op	2055702016 B/op	21247156 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes
E0812 18:32:31.036952   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:32:31.056768   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes-8                    	       1	166772771352 ns/op	15075690424 B/op	159692166 allocs/op
BenchmarkPerfScheduling/TopologySpreading
BenchmarkPerfScheduling/TopologySpreading/500Nodes
E0812 18:33:05.675163   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:33:05.695536   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/500Nodes-8                          	       1	26579023879 ns/op	2745880080 B/op	27891274 allocs/op
BenchmarkPerfScheduling/TopologySpreading/5000Nodes
E0812 18:37:12.146773   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:37:12.187766   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/5000Nodes-8                         	       1	178025516344 ns/op	21079250376 B/op	203885423 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes
E0812 18:37:45.322184   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:37:45.341691   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes-8                 	       1	25180429984 ns/op	2485561712 B/op	26182281 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes
E0812 18:41:43.162099   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:41:43.184854   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes-8                	       1	170458899235 ns/op	16221630536 B/op	175418235 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes
E0812 18:42:17.337337   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:42:17.358374   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes-8                     	       1	26162788617 ns/op	2587986664 B/op	27959972 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes
E0812 18:47:42.225248   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:47:42.266937   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes-8                    	       1	253386861642 ns/op	36256228936 B/op	402080017 allocs/op
BenchmarkPerfScheduling/PreemptionBasic
BenchmarkPerfScheduling/PreemptionBasic/500Nodes
E0812 18:49:25.202825   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:49:25.250097   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionBasic/500Nodes-8                            	       1	94705127904 ns/op	7303677480 B/op	75696775 allocs/op
BenchmarkPerfScheduling/PreemptionPVs
BenchmarkPerfScheduling/PreemptionPVs/500Nodes
E0812 18:51:26.002768   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:51:26.026299   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionPVs/500Nodes-8                              	       1	112880427657 ns/op	12057305280 B/op	139776254 allocs/op
BenchmarkPerfScheduling/Unschedulable
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods
E0812 18:51:52.084030   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:51:52.104959   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods-8                  	       1	17915385454 ns/op	1695003736 B/op	20324830 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods
E0812 18:54:42.816461   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:54:42.856293   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods-8                 	       1	102772887983 ns/op	13013385600 B/op	162152864 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods
E0812 18:59:15.212761   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:59:15.234139   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods-8                	       1	204218043075 ns/op	41302141760 B/op	681362331 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes
E0812 18:59:54.278706   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:59:54.299626   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes-8                  	       1	23816999802 ns/op	1872715200 B/op	19835319 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes
E0812 19:02:19.383084   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 19:02:19.405291   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes-8                  	       1	76246884262 ns/op	4649518256 B/op	50953853 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes
E0812 19:08:09.714591   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 19:08:09.759486   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes-8         	       1	276481164904 ns/op	39486865560 B/op	346055845 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes
E0812 19:13:40.053763   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 19:13:40.098450   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes-8           	       1	257872328744 ns/op	24588039880 B/op	239481153 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes
E0812 19:19:24.250195   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 19:19:24.267402   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes-8             	       1	273550683429 ns/op	37614917520 B/op	355663657 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes
E0812 19:24:41.631869   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 19:24:41.674516   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes-8               	       1	247298813944 ns/op	19568003256 B/op	229125568 allocs/op
PASS
F0812 19:24:47.775161   35974 etcd.go:213] unexpected number of goroutines: before: 2 after 42
goroutine 1 [running]:
k8s.io/kubernetes/vendor/k8s.io/klog/v2/internal/dbg.Stacks(0x0)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/internal/dbg/dbg.go:35 +0x89
k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).output(0x7dd57c0, 0x3, 0x0, 0xc02264c000, 0x1, {0x6695d69?, 0x2?}, 0xc01453fc00?, 0x0)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:936 +0x686
k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).printfDepth(0x7dd57c0, 0xf?, 0x0, {0x0, 0x0}, 0xa0?, {0x4d4dd18, 0x34}, {0xc0442ae000, 0x2, ...})
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:737 +0x1f3
k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).printf(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:719
k8s.io/kubernetes/vendor/k8s.io/klog/v2.Fatalf(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:1618
k8s.io/kubernetes/test/integration/framework.EtcdMain(0xc000e9ff60)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/framework/etcd.go:213 +0x345
k8s.io/kubernetes/test/integration/scheduler_perf.TestMain(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/scheduler_perf/main_test.go:26
main.main()
	_testmain.go:49 +0x1fc
exit status 255
FAIL	k8s.io/kubernetes/test/integration/scheduler_perf	5851.782s

				from junit_20220812-174437.xml

Find from mentions in log files | View test history on testgrid


Error lines from build-log.txt

... skipping 89 lines ...
BenchmarkPerfScheduling

BenchmarkPerfScheduling/SchedulingBasic

BenchmarkPerfScheduling/SchedulingBasic/500Nodes

E0812 17:47:38.212908   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 17:47:38.226058   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingBasic/500Nodes-8         	       1	14835577581 ns/op	1804584856 B/op	18788277 allocs/op

BenchmarkPerfScheduling/SchedulingBasic/5000Nodes

E0812 17:49:15.378597   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 17:49:15.394582   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingBasic/5000Nodes-8        	       1	52233937043 ns/op	4431587784 B/op	48033635 allocs/op

BenchmarkPerfScheduling/SchedulingPodAntiAffinity

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes

E0812 17:49:37.051587   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 17:49:37.081384   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes-8         	       1	16234706287 ns/op	1155785192 B/op	11313585 allocs/op

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes

E0812 17:52:05.012690   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 17:52:05.030710   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes-8        	       1	101262435236 ns/op	10024489344 B/op	101658428 allocs/op

BenchmarkPerfScheduling/SchedulingSecrets

BenchmarkPerfScheduling/SchedulingSecrets/500Nodes

E0812 17:52:25.045226   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 17:52:25.080575   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingSecrets/500Nodes-8                 	       1	14081209483 ns/op	2102662120 B/op	22458554 allocs/op

BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes

E0812 17:54:38.433265   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 17:54:38.447107   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes-8                	       1	84322949471 ns/op	14575361776 B/op	157520356 allocs/op

BenchmarkPerfScheduling/SchedulingInTreePVs

BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes

E0812 17:55:13.024195   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 17:55:13.056514   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes-8               	       1	28333087146 ns/op	5401298288 B/op	68590320 allocs/op

BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes

E0812 17:59:18.536820   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 17:59:18.549476   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes-8              	       1	195322317664 ns/op	46795611040 B/op	531520873 allocs/op

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes

E0812 17:59:57.411606   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 17:59:57.429229   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes-8       	       1	32711769969 ns/op	7386569512 B/op	77052685 allocs/op

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes

E0812 18:05:03.489566   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:05:03.547669   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes-8      	       1	229612576954 ns/op	56810749536 B/op	561504578 allocs/op

BenchmarkPerfScheduling/SchedulingCSIPVs

BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes

E0812 18:06:06.439062   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:06:06.466791   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes-8                  	       1	51496367753 ns/op	4116284856 B/op	53463099 allocs/op

BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes

E0812 18:12:24.681540   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:12:24.707408   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes-8                 	       1	298905097548 ns/op	35780457608 B/op	407948053 allocs/op

BenchmarkPerfScheduling/SchedulingPodAffinity

BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes

E0812 18:13:02.724000   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:13:02.747593   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes-8             	       1	29102313710 ns/op	2654860136 B/op	26089456 allocs/op

BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes

E0812 18:18:16.629769   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:18:16.653551   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes-8            	       1	240576228093 ns/op	36579622464 B/op	340352076 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes

E0812 18:18:50.934706   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:18:50.956746   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes-8    	       1	26212758956 ns/op	2064251920 B/op	22277228 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes

E0812 18:23:13.410192   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:23:13.449443   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes-8   	       1	190494275650 ns/op	17329266056 B/op	201557850 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes

E0812 18:23:47.988825   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:23:48.010238   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes-8         	       1	26179002684 ns/op	2072143448 B/op	22320300 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes

E0812 18:28:02.252891   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:28:02.273019   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes-8        	       1	184893440152 ns/op	17163538736 B/op	200149252 allocs/op

BenchmarkPerfScheduling/SchedulingNodeAffinity

BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes

E0812 18:28:33.312601   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:28:33.332571   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes-8                     	       1	23171070319 ns/op	2055702016 B/op	21247156 allocs/op

BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes

E0812 18:32:31.036952   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:32:31.056768   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes-8                    	
       1	166772771352 ns/op	15075690424 B/op	159692166 allocs/op

BenchmarkPerfScheduling/TopologySpreading

BenchmarkPerfScheduling/TopologySpreading/500Nodes

E0812 18:33:05.675163   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:33:05.695536   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/TopologySpreading/500Nodes-8                          	       1	26579023879 ns/op	2745880080 B/op	27891274 allocs/op

BenchmarkPerfScheduling/TopologySpreading/5000Nodes

E0812 18:37:12.146773   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:37:12.187766   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/TopologySpreading/5000Nodes-8                         	       1	178025516344 ns/op	21079250376 B/op	203885423 allocs/op

BenchmarkPerfScheduling/PreferredTopologySpreading

BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes

E0812 18:37:45.322184   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:37:45.341691   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes-8                 	       1	25180429984 ns/op	2485561712 B/op	26182281 allocs/op

BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes

E0812 18:41:43.162099   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:41:43.184854   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes-8                	       1	170458899235 ns/op	16221630536 B/op	175418235 allocs/op

BenchmarkPerfScheduling/MixedSchedulingBasePod

BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes

E0812 18:42:17.337337   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:42:17.358374   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes-8                     	       1	26162788617 ns/op	2587986664 B/op	27959972 allocs/op

BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes

E0812 18:47:42.225248   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:47:42.266937   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes-8                    	       1	253386861642 ns/op	36256228936 B/op	402080017 allocs/op

BenchmarkPerfScheduling/PreemptionBasic

BenchmarkPerfScheduling/PreemptionBasic/500Nodes

E0812 18:49:25.202825   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:49:25.250097   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreemptionBasic/500Nodes-8                            	       1	94705127904 ns/op	7303677480 B/op	75696775 allocs/op

BenchmarkPerfScheduling/PreemptionPVs

BenchmarkPerfScheduling/PreemptionPVs/500Nodes

E0812 18:51:26.002768   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:51:26.026299   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreemptionPVs/500Nodes-8                              	       1	112880427657 ns/op	12057305280 B/op	139776254 allocs/op

BenchmarkPerfScheduling/Unschedulable

BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods

E0812 18:51:52.084030   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:51:52.104959   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods-8                  	       1	17915385454 ns/op	1695003736 B/op	20324830 allocs/op

BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods

E0812 18:54:42.816461   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:54:42.856293   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods-8                 	       1	102772887983 ns/op	13013385600 B/op	162152864 allocs/op

BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods

E0812 18:59:15.212761   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:59:15.234139   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods-8                	       1	204218043075 ns/op	41302141760 B/op	681362331 allocs/op

BenchmarkPerfScheduling/SchedulingWithMixedChurn

BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes

E0812 18:59:54.278706   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 18:59:54.299626   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes-8                  	       1	23816999802 ns/op	1872715200 B/op	19835319 allocs/op

BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes

E0812 19:02:19.383084   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 19:02:19.405291   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes-8                  	       1	76246884262 ns/op	4649518256 B/op	50953853 allocs/op

BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes

E0812 19:08:09.714591   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 19:08:09.759486   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes-8         	       1	276481164904 ns/op	39486865560 B/op	346055845 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes

E0812 19:13:40.053763   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 19:13:40.098450   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes-8           	       1	257872328744 ns/op	24588039880 B/op	239481153 allocs/op

BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes

E0812 19:19:24.250195   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 19:19:24.267402   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes-8             	       1	273550683429 ns/op	37614917520 B/op	355663657 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes

E0812 19:24:41.631869   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 19:24:41.674516   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes-8               	       1	247298813944 ns/op	19568003256 B/op	229125568 allocs/op

PASS
... skipping 33 lines ...
main.main()

	_testmain.go:49 +0x1fc

exit status 255

FAIL	k8s.io/kubernetes/test/integration/scheduler_perf	5851.782s


✖  test/integration/scheduler_perf (1h37m31.782s)

=== Failed
=== FAIL: test/integration/scheduler_perf  (0.00s)
goos: linux
goarch: amd64
pkg: k8s.io/kubernetes/test/integration/scheduler_perf
cpu: Intel(R) Xeon(R) CPU @ 2.30GHz
BenchmarkPerfScheduling
BenchmarkPerfScheduling/SchedulingBasic
BenchmarkPerfScheduling/SchedulingBasic/500Nodes
E0812 17:47:38.212908   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 17:47:38.226058   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/500Nodes-8         	       1	14835577581 ns/op	1804584856 B/op	18788277 allocs/op
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes
E0812 17:49:15.378597   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 17:49:15.394582   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes-8        	       1	52233937043 ns/op	4431587784 B/op	48033635 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes
E0812 17:49:37.051587   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 17:49:37.081384   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes-8         	       1	16234706287 ns/op	1155785192 B/op	11313585 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes
E0812 17:52:05.012690   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 17:52:05.030710   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes-8        	       1	101262435236 ns/op	10024489344 B/op	101658428 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes
E0812 17:52:25.045226   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 17:52:25.080575   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes-8                 	       1	14081209483 ns/op	2102662120 B/op	22458554 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes
E0812 17:54:38.433265   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 17:54:38.447107   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes-8                	       1	84322949471 ns/op	14575361776 B/op	157520356 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes
E0812 17:55:13.024195   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 17:55:13.056514   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes-8               	       1	28333087146 ns/op	5401298288 B/op	68590320 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes
E0812 17:59:18.536820   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 17:59:18.549476   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes-8              	       1	195322317664 ns/op	46795611040 B/op	531520873 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes
E0812 17:59:57.411606   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 17:59:57.429229   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes-8       	       1	32711769969 ns/op	7386569512 B/op	77052685 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes
E0812 18:05:03.489566   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:05:03.547669   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes-8      	       1	229612576954 ns/op	56810749536 B/op	561504578 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes
E0812 18:06:06.439062   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:06:06.466791   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes-8                  	       1	51496367753 ns/op	4116284856 B/op	53463099 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes
E0812 18:12:24.681540   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:12:24.707408   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes-8                 	       1	298905097548 ns/op	35780457608 B/op	407948053 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes
E0812 18:13:02.724000   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:13:02.747593   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes-8             	       1	29102313710 ns/op	2654860136 B/op	26089456 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes
E0812 18:18:16.629769   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:18:16.653551   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes-8            	       1	240576228093 ns/op	36579622464 B/op	340352076 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes
E0812 18:18:50.934706   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:18:50.956746   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes-8    	       1	26212758956 ns/op	2064251920 B/op	22277228 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes
E0812 18:23:13.410192   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:23:13.449443   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes-8   	       1	190494275650 ns/op	17329266056 B/op	201557850 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes
E0812 18:23:47.988825   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:23:48.010238   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes-8         	       1	26179002684 ns/op	2072143448 B/op	22320300 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes
E0812 18:28:02.252891   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:28:02.273019   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes-8        	       1	184893440152 ns/op	17163538736 B/op	200149252 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes
E0812 18:28:33.312601   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:28:33.332571   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes-8                     	       1	23171070319 ns/op	2055702016 B/op	21247156 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes
E0812 18:32:31.036952   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:32:31.056768   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes-8                    	       1	166772771352 ns/op	15075690424 B/op	159692166 allocs/op
BenchmarkPerfScheduling/TopologySpreading
BenchmarkPerfScheduling/TopologySpreading/500Nodes
E0812 18:33:05.675163   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:33:05.695536   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/500Nodes-8                          	       1	26579023879 ns/op	2745880080 B/op	27891274 allocs/op
BenchmarkPerfScheduling/TopologySpreading/5000Nodes
E0812 18:37:12.146773   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:37:12.187766   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/5000Nodes-8                         	       1	178025516344 ns/op	21079250376 B/op	203885423 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes
E0812 18:37:45.322184   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:37:45.341691   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes-8                 	       1	25180429984 ns/op	2485561712 B/op	26182281 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes
E0812 18:41:43.162099   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:41:43.184854   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes-8                	       1	170458899235 ns/op	16221630536 B/op	175418235 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes
E0812 18:42:17.337337   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:42:17.358374   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes-8                     	       1	26162788617 ns/op	2587986664 B/op	27959972 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes
E0812 18:47:42.225248   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:47:42.266937   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes-8                    	       1	253386861642 ns/op	36256228936 B/op	402080017 allocs/op
BenchmarkPerfScheduling/PreemptionBasic
BenchmarkPerfScheduling/PreemptionBasic/500Nodes
E0812 18:49:25.202825   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:49:25.250097   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionBasic/500Nodes-8                            	       1	94705127904 ns/op	7303677480 B/op	75696775 allocs/op
BenchmarkPerfScheduling/PreemptionPVs
BenchmarkPerfScheduling/PreemptionPVs/500Nodes
E0812 18:51:26.002768   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:51:26.026299   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionPVs/500Nodes-8                              	       1	112880427657 ns/op	12057305280 B/op	139776254 allocs/op
BenchmarkPerfScheduling/Unschedulable
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods
E0812 18:51:52.084030   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:51:52.104959   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods-8                  	       1	17915385454 ns/op	1695003736 B/op	20324830 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods
E0812 18:54:42.816461   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:54:42.856293   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods-8                 	       1	102772887983 ns/op	13013385600 B/op	162152864 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods
E0812 18:59:15.212761   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:59:15.234139   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods-8                	       1	204218043075 ns/op	41302141760 B/op	681362331 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes
E0812 18:59:54.278706   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 18:59:54.299626   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes-8                  	       1	23816999802 ns/op	1872715200 B/op	19835319 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes
E0812 19:02:19.383084   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 19:02:19.405291   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes-8                  	       1	76246884262 ns/op	4649518256 B/op	50953853 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes
E0812 19:08:09.714591   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 19:08:09.759486   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes-8         	       1	276481164904 ns/op	39486865560 B/op	346055845 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes
E0812 19:13:40.053763   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 19:13:40.098450   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes-8           	       1	257872328744 ns/op	24588039880 B/op	239481153 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes
E0812 19:19:24.250195   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 19:19:24.267402   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes-8             	       1	273550683429 ns/op	37614917520 B/op	355663657 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes
E0812 19:24:41.631869   35974 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 19:24:41.674516   35974 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes-8               	       1	247298813944 ns/op	19568003256 B/op	229125568 allocs/op
PASS
F0812 19:24:47.775161   35974 etcd.go:213] unexpected number of goroutines: before: 2 after 42
goroutine 1 [running]:
k8s.io/kubernetes/vendor/k8s.io/klog/v2/internal/dbg.Stacks(0x0)
... skipping 10 lines ...
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/framework/etcd.go:213 +0x345
k8s.io/kubernetes/test/integration/scheduler_perf.TestMain(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/scheduler_perf/main_test.go:26
main.main()
	_testmain.go:49 +0x1fc
exit status 255
FAIL	k8s.io/kubernetes/test/integration/scheduler_perf	5851.782s

DONE 0 tests, 1 failure in 0.005s
+++ [0812 19:24:48] prune-junit-xml not found; installing from hack/tools
processing junit xml file : /logs/artifacts/junit_20220812-174437.xml
done.
+++ [0812 19:24:48] Saved JUnit XML test report to /logs/artifacts/junit_20220812-174437.xml
make[1]: *** [Makefile:188: test] Error 1
!!! [0812 19:24:48] Call tree:
!!! [0812 19:24:48]  1: hack/make-rules/test-integration.sh:102 runTests(...)
+++ [0812 19:24:48] Cleaning up etcd
+++ [0812 19:24:49] Integration test cleanup complete
make: *** [Makefile:207: test-integration] Error 1