This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 0 succeeded
Started2022-08-10 21:31
Elapsed47m32s
Revisionmaster

Test Failures


k8s.io/kubernetes/test/integration/scheduler_perf TestMain 0.00s

go test -v k8s.io/kubernetes/test/integration/scheduler_perf -run TestMain$
goos: linux
goarch: amd64
pkg: k8s.io/kubernetes/test/integration/scheduler_perf
cpu: Intel(R) Xeon(R) CPU @ 2.30GHz
BenchmarkPerfScheduling
BenchmarkPerfScheduling/SchedulingBasic
BenchmarkPerfScheduling/SchedulingBasic/500Nodes
E0810 21:37:02.280824   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:37:02.283419   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/500Nodes-8         	       1	10730094703 ns/op	1811494120 B/op	18832735 allocs/op
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes
E0810 21:37:38.303287   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:37:38.306233   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes-8        	       1	24367849139 ns/op	4355208776 B/op	47238731 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes
E0810 21:37:49.814453   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:37:49.817396   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes-8         	       1	9204866941 ns/op	1152113432 B/op	11426175 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes
E0810 21:38:46.387599   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:38:46.390527   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes-8        	       1	44943789801 ns/op	9664828776 B/op	96834345 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes
E0810 21:39:00.512857   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:39:00.515643   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes-8                 	       1	11853098703 ns/op	2124908792 B/op	22547924 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes
E0810 21:40:07.935883   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:40:07.938821   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes-8                	       1	55533819697 ns/op	14515945952 B/op	156084295 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes
E0810 21:40:35.439389   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:40:35.442311   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes-8               	       1	25098980480 ns/op	5488565416 B/op	69447466 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes
E0810 21:43:50.659921   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:43:50.664097   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes-8              	       1	182879851940 ns/op	48385739184 B/op	541173648 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes
E0810 21:44:19.632041   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:44:19.636176   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes-8       	       1	26447550683 ns/op	7480421592 B/op	77877254 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes
E0810 21:47:35.742314   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:47:35.745662   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes-8      	       1	183451843624 ns/op	57910981736 B/op	565881379 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes
E0810 21:48:00.390068   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:48:00.392830   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes-8                  	       1	22049147011 ns/op	4085959848 B/op	53647379 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes
E0810 21:50:56.794742   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:50:56.797719   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes-8                 	       1	163691709193 ns/op	34531720152 B/op	398939874 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes
E0810 21:51:12.886173   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:51:12.889460   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes-8             	       1	13420411175 ns/op	2613026752 B/op	25679504 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes
E0810 21:53:11.668282   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:53:11.671492   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes-8            	       1	106828553618 ns/op	34962688832 B/op	321286830 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes
E0810 21:53:26.485939   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:53:26.488832   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes-8    	       1	12390298141 ns/op	2053771760 B/op	22229038 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes
E0810 21:54:48.439311   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:54:48.442623   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes-8   	       1	69963603559 ns/op	15941602624 B/op	184500687 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes
E0810 21:55:02.192186   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:55:02.195499   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes-8         	       1	11334491455 ns/op	2052475224 B/op	22273565 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes
E0810 21:56:23.377955   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:56:23.381039   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes-8        	       1	69269735669 ns/op	15990098240 B/op	185142431 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes
E0810 21:56:37.697882   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:56:37.700728   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes-8                     	       1	11885411013 ns/op	2043650696 B/op	21162910 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes
E0810 21:57:49.201983   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:57:49.205024   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes-8                    	       1	59794130848 ns/op	14221719576 B/op	149045100 allocs/op
BenchmarkPerfScheduling/TopologySpreading
BenchmarkPerfScheduling/TopologySpreading/500Nodes
E0810 21:58:05.689318   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:58:05.692173   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/500Nodes-8                          	       1	14091164195 ns/op	2718501016 B/op	27487920 allocs/op
BenchmarkPerfScheduling/TopologySpreading/5000Nodes
E0810 21:59:29.879979   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:59:29.883021   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/5000Nodes-8                         	       1	72436560100 ns/op	19882500896 B/op	188718639 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes
E0810 21:59:45.020375   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:59:45.023358   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes-8                 	       1	12705384072 ns/op	2453505024 B/op	25893253 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes
E0810 22:01:04.832473   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:01:04.835324   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes-8                	       1	68074014260 ns/op	15328794456 B/op	164367814 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes
E0810 22:01:20.516108   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:01:20.519490   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes-8                     	       1	13060298584 ns/op	2554047472 B/op	27569561 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes
E0810 22:03:33.911083   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:03:33.914341   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes-8                    	       1	121576166760 ns/op	33180668568 B/op	371543028 allocs/op
BenchmarkPerfScheduling/PreemptionBasic
BenchmarkPerfScheduling/PreemptionBasic/500Nodes
E0810 22:03:59.039155   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:03:59.041876   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionBasic/500Nodes-8                            	       1	22583784629 ns/op	5655344640 B/op	64881857 allocs/op
BenchmarkPerfScheduling/PreemptionPVs
BenchmarkPerfScheduling/PreemptionPVs/500Nodes
E0810 22:04:44.905308   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:04:44.908212   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionPVs/500Nodes-8                              	       1	43583776629 ns/op	10184397584 B/op	127832845 allocs/op
BenchmarkPerfScheduling/Unschedulable
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods
E0810 22:04:57.139647   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:04:57.142928   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods-8                  	       1	9970860040 ns/op	1701509464 B/op	20377199 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods
E0810 22:05:55.859666   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:05:55.862830   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods-8                 	       1	47132512068 ns/op	12878830528 B/op	162241890 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods
E0810 22:07:52.188933   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:07:52.192931   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods-8                	       1	104526173158 ns/op	39213793448 B/op	665858954 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes
E0810 22:08:06.233361   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:08:06.236715   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes-8                  	       1	10556014486 ns/op	1841783232 B/op	19593870 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes
E0810 22:08:41.769538   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:08:41.772404   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes-8                  	       1	24059268024 ns/op	4481182184 B/op	49200665 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes
E0810 22:11:29.063839   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:11:29.067009   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes-8         	       1	155241913919 ns/op	38619854520 B/op	336083791 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes
E0810 22:14:04.277684   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:14:04.280583   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes-8           	       1	142964025244 ns/op	23707398408 B/op	228825571 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes
E0810 22:16:42.878000   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:16:42.880984   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes-8             	       1	146246411191 ns/op	36098079720 B/op	338528978 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes
E0810 22:19:12.133628   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:19:12.136995   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes-8               	       1	136868358276 ns/op	18577716664 B/op	216719508 allocs/op
PASS
F0810 22:19:18.222952   36087 etcd.go:213] unexpected number of goroutines: before: 2 after 42
goroutine 1 [running]:
k8s.io/kubernetes/vendor/k8s.io/klog/v2/internal/dbg.Stacks(0x0)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/internal/dbg/dbg.go:35 +0x89
k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).output(0x7dd57c0, 0x3, 0x0, 0xc02cdbd030, 0x1, {0x6695d69?, 0x2?}, 0x7dffac0?, 0x0)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:936 +0x686
k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).printfDepth(0x7dd57c0, 0xf?, 0x0, {0x0, 0x0}, 0xa0?, {0x4d4dd18, 0x34}, {0xc01f352000, 0x2, ...})
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:737 +0x1f3
k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).printf(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:719
k8s.io/kubernetes/vendor/k8s.io/klog/v2.Fatalf(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:1618
k8s.io/kubernetes/test/integration/framework.EtcdMain(0xc000e9ff60)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/framework/etcd.go:213 +0x345
k8s.io/kubernetes/test/integration/scheduler_perf.TestMain(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/scheduler_perf/main_test.go:26
main.main()
	_testmain.go:49 +0x1fc
exit status 255
FAIL	k8s.io/kubernetes/test/integration/scheduler_perf	2547.869s

				from junit_20220810-213356.xml

Find from mentions in log files | View test history on testgrid


Error lines from build-log.txt

... skipping 89 lines ...
BenchmarkPerfScheduling

BenchmarkPerfScheduling/SchedulingBasic

BenchmarkPerfScheduling/SchedulingBasic/500Nodes

E0810 21:37:02.280824   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:37:02.283419   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingBasic/500Nodes-8         	       1	10730094703 ns/op	1811494120 B/op	18832735 allocs/op

BenchmarkPerfScheduling/SchedulingBasic/5000Nodes

E0810 21:37:38.303287   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:37:38.306233   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingBasic/5000Nodes-8        	       1	24367849139 ns/op	4355208776 B/op	47238731 allocs/op

BenchmarkPerfScheduling/SchedulingPodAntiAffinity

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes

E0810 21:37:49.814453   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:37:49.817396   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes-8         	       1	9204866941 ns/op	1152113432 B/op	11426175 allocs/op

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes

E0810 21:38:46.387599   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:38:46.390527   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes-8        	       1	44943789801 ns/op	9664828776 B/op	96834345 allocs/op

BenchmarkPerfScheduling/SchedulingSecrets

BenchmarkPerfScheduling/SchedulingSecrets/500Nodes

E0810 21:39:00.512857   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:39:00.515643   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingSecrets/500Nodes-8                 	       1	11853098703 ns/op	2124908792 B/op	22547924 allocs/op

BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes

E0810 21:40:07.935883   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:40:07.938821   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes-8                	       1	55533819697 ns/op	14515945952 B/op	156084295 allocs/op

BenchmarkPerfScheduling/SchedulingInTreePVs

BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes

E0810 21:40:35.439389   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:40:35.442311   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes-8               	       1	25098980480 ns/op	5488565416 B/op	69447466 allocs/op

BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes

E0810 21:43:50.659921   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:43:50.664097   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes-8              	       1	182879851940 ns/op	48385739184 B/op	541173648 allocs/op

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes

E0810 21:44:19.632041   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:44:19.636176   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes-8       	       1	26447550683 ns/op	7480421592 B/op	77877254 allocs/op

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes

E0810 21:47:35.742314   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:47:35.745662   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes-8      	       1	183451843624 ns/op	57910981736 B/op	565881379 allocs/op

BenchmarkPerfScheduling/SchedulingCSIPVs

BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes

E0810 21:48:00.390068   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:48:00.392830   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes-8                  	       1	22049147011 ns/op	4085959848 B/op	53647379 allocs/op

BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes

E0810 21:50:56.794742   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:50:56.797719   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes-8                 	       1	163691709193 ns/op	34531720152 B/op	398939874 allocs/op

BenchmarkPerfScheduling/SchedulingPodAffinity

BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes

E0810 21:51:12.886173   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:51:12.889460   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes-8             	       1	13420411175 ns/op	2613026752 B/op	25679504 allocs/op

BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes

E0810 21:53:11.668282   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:53:11.671492   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes-8            	       1	106828553618 ns/op	34962688832 B/op	321286830 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes

E0810 21:53:26.485939   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:53:26.488832   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes-8    	       1	12390298141 ns/op	2053771760 B/op	22229038 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes

E0810 21:54:48.439311   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:54:48.442623   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes-8   	       1	69963603559 ns/op	15941602624 B/op	184500687 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes

E0810 21:55:02.192186   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:55:02.195499   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes-8         	       1	11334491455 ns/op	2052475224 B/op	22273565 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes

E0810 21:56:23.377955   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:56:23.381039   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes-8        	       1	69269735669 ns/op	15990098240 B/op	185142431 allocs/op

BenchmarkPerfScheduling/SchedulingNodeAffinity

BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes

E0810 21:56:37.697882   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:56:37.700728   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes-8                     	       1	11885411013 ns/op	2043650696 B/op	21162910 allocs/op

BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes

E0810 21:57:49.201983   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:57:49.205024   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes-8                    	       1	59794130848 ns/op	14221719576 B/op	149045100 allocs/op

BenchmarkPerfScheduling/TopologySpreading

BenchmarkPerfScheduling/TopologySpreading/500Nodes

E0810 21:58:05.689318   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:58:05.692173   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/TopologySpreading/500Nodes-8                          	       1	14091164195 ns/op	2718501016 B/op	27487920 allocs/op

BenchmarkPerfScheduling/TopologySpreading/5000Nodes

E0810 21:59:29.879979   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:59:29.883021   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/TopologySpreading/5000Nodes-8                         	       1	72436560100 ns/op	19882500896 B/op	188718639 allocs/op

BenchmarkPerfScheduling/PreferredTopologySpreading

BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes

E0810 21:59:45.020375   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 21:59:45.023358   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes-8                 	       1	12705384072 ns/op	2453505024 B/op	25893253 allocs/op

BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes

E0810 22:01:04.832473   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 22:01:04.835324   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes-8                	       1	68074014260 ns/op	15328794456 B/op	164367814 allocs/op

BenchmarkPerfScheduling/MixedSchedulingBasePod

BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes

E0810 22:01:20.516108   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 22:01:20.519490   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes-8                     	       1	13060298584 ns/op	2554047472 B/op	27569561 allocs/op

BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes

E0810 22:03:33.911083   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 22:03:33.914341   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes-8                    	       1	121576166760 ns/op	33180668568 B/op	371543028 allocs/op

BenchmarkPerfScheduling/PreemptionBasic

BenchmarkPerfScheduling/PreemptionBasic/500Nodes

E0810 22:03:59.039155   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 22:03:59.041876   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreemptionBasic/500Nodes-8                            	       1	22583784629 ns/op	5655344640 B/op	64881857 allocs/op

BenchmarkPerfScheduling/PreemptionPVs

BenchmarkPerfScheduling/PreemptionPVs/500Nodes

E0810 22:04:44.905308   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 22:04:44.908212   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreemptionPVs/500Nodes-8                              	       1	43583776629 ns/op	10184397584 B/op	127832845 allocs/op

BenchmarkPerfScheduling/Unschedulable

BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods

E0810 22:04:57.139647   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 22:04:57.142928   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods-8                  	       1	9970860040 ns/op	1701509464 B/op	20377199 allocs/op

BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods

E0810 22:05:55.859666   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 22:05:55.862830   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods-8                 	       1	47132512068 ns/op	12878830528 B/op	162241890 allocs/op

BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods

E0810 22:07:52.188933   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 22:07:52.192931   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods-8                	       1	104526173158 ns/op	39213793448 B/op	665858954 allocs/op

BenchmarkPerfScheduling/SchedulingWithMixedChurn

BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes

E0810 22:08:06.233361   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 22:08:06.236715   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes-8                  	       1	10556014486 ns/op	1841783232 B/op	19593870 allocs/op

BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes

E0810 22:08:41.769538   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 22:08:41.772404   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes-8                  	       1	24059268024 ns/op	4481182184 B/op	49200665 allocs/op

BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes

E0810 22:11:29.063839   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 22:11:29.067009   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes-8         	       1	155241913919 ns/op	38619854520 B/op	336083791 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes

E0810 22:14:04.277684   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 22:14:04.280583   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes-8           	       1	142964025244 ns/op	23707398408 B/op	228825571 allocs/op

BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes

E0810 22:16:42.878000   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 22:16:42.880984   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes-8             	       1	146246411191 ns/op	36098079720 B/op	338528978 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes

E0810 22:19:12.133628   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0810 22:19:12.136995   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes-8               	       1	136868358276 ns/op	18577716664 B/op	216719508 allocs/op

PASS
... skipping 33 lines ...
main.main()

	_testmain.go:49 +0x1fc

exit status 255

FAIL	k8s.io/kubernetes/test/integration/scheduler_perf	2547.869s


✖  test/integration/scheduler_perf (42m27.869s)

=== Failed
=== FAIL: test/integration/scheduler_perf  (0.00s)
goos: linux
goarch: amd64
pkg: k8s.io/kubernetes/test/integration/scheduler_perf
cpu: Intel(R) Xeon(R) CPU @ 2.30GHz
BenchmarkPerfScheduling
BenchmarkPerfScheduling/SchedulingBasic
BenchmarkPerfScheduling/SchedulingBasic/500Nodes
E0810 21:37:02.280824   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:37:02.283419   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/500Nodes-8         	       1	10730094703 ns/op	1811494120 B/op	18832735 allocs/op
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes
E0810 21:37:38.303287   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:37:38.306233   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes-8        	       1	24367849139 ns/op	4355208776 B/op	47238731 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes
E0810 21:37:49.814453   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:37:49.817396   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes-8         	       1	9204866941 ns/op	1152113432 B/op	11426175 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes
E0810 21:38:46.387599   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:38:46.390527   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes-8        	       1	44943789801 ns/op	9664828776 B/op	96834345 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes
E0810 21:39:00.512857   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:39:00.515643   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes-8                 	       1	11853098703 ns/op	2124908792 B/op	22547924 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes
E0810 21:40:07.935883   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:40:07.938821   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes-8                	       1	55533819697 ns/op	14515945952 B/op	156084295 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes
E0810 21:40:35.439389   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:40:35.442311   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes-8               	       1	25098980480 ns/op	5488565416 B/op	69447466 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes
E0810 21:43:50.659921   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:43:50.664097   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes-8              	       1	182879851940 ns/op	48385739184 B/op	541173648 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes
E0810 21:44:19.632041   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:44:19.636176   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes-8       	       1	26447550683 ns/op	7480421592 B/op	77877254 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes
E0810 21:47:35.742314   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:47:35.745662   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes-8      	       1	183451843624 ns/op	57910981736 B/op	565881379 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes
E0810 21:48:00.390068   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:48:00.392830   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes-8                  	       1	22049147011 ns/op	4085959848 B/op	53647379 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes
E0810 21:50:56.794742   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:50:56.797719   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes-8                 	       1	163691709193 ns/op	34531720152 B/op	398939874 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes
E0810 21:51:12.886173   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:51:12.889460   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes-8             	       1	13420411175 ns/op	2613026752 B/op	25679504 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes
E0810 21:53:11.668282   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:53:11.671492   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes-8            	       1	106828553618 ns/op	34962688832 B/op	321286830 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes
E0810 21:53:26.485939   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:53:26.488832   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes-8    	       1	12390298141 ns/op	2053771760 B/op	22229038 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes
E0810 21:54:48.439311   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:54:48.442623   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes-8   	       1	69963603559 ns/op	15941602624 B/op	184500687 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes
E0810 21:55:02.192186   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:55:02.195499   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes-8         	       1	11334491455 ns/op	2052475224 B/op	22273565 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes
E0810 21:56:23.377955   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:56:23.381039   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes-8        	       1	69269735669 ns/op	15990098240 B/op	185142431 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes
E0810 21:56:37.697882   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:56:37.700728   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes-8                     	       1	11885411013 ns/op	2043650696 B/op	21162910 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes
E0810 21:57:49.201983   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:57:49.205024   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes-8                    	       1	59794130848 ns/op	14221719576 B/op	149045100 allocs/op
BenchmarkPerfScheduling/TopologySpreading
BenchmarkPerfScheduling/TopologySpreading/500Nodes
E0810 21:58:05.689318   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:58:05.692173   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/500Nodes-8                          	       1	14091164195 ns/op	2718501016 B/op	27487920 allocs/op
BenchmarkPerfScheduling/TopologySpreading/5000Nodes
E0810 21:59:29.879979   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:59:29.883021   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/5000Nodes-8                         	       1	72436560100 ns/op	19882500896 B/op	188718639 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes
E0810 21:59:45.020375   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 21:59:45.023358   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes-8                 	       1	12705384072 ns/op	2453505024 B/op	25893253 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes
E0810 22:01:04.832473   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:01:04.835324   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes-8                	       1	68074014260 ns/op	15328794456 B/op	164367814 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes
E0810 22:01:20.516108   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:01:20.519490   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes-8                     	       1	13060298584 ns/op	2554047472 B/op	27569561 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes
E0810 22:03:33.911083   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:03:33.914341   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes-8                    	       1	121576166760 ns/op	33180668568 B/op	371543028 allocs/op
BenchmarkPerfScheduling/PreemptionBasic
BenchmarkPerfScheduling/PreemptionBasic/500Nodes
E0810 22:03:59.039155   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:03:59.041876   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionBasic/500Nodes-8                            	       1	22583784629 ns/op	5655344640 B/op	64881857 allocs/op
BenchmarkPerfScheduling/PreemptionPVs
BenchmarkPerfScheduling/PreemptionPVs/500Nodes
E0810 22:04:44.905308   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:04:44.908212   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionPVs/500Nodes-8                              	       1	43583776629 ns/op	10184397584 B/op	127832845 allocs/op
BenchmarkPerfScheduling/Unschedulable
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods
E0810 22:04:57.139647   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:04:57.142928   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods-8                  	       1	9970860040 ns/op	1701509464 B/op	20377199 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods
E0810 22:05:55.859666   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:05:55.862830   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods-8                 	       1	47132512068 ns/op	12878830528 B/op	162241890 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods
E0810 22:07:52.188933   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:07:52.192931   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods-8                	       1	104526173158 ns/op	39213793448 B/op	665858954 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes
E0810 22:08:06.233361   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:08:06.236715   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes-8                  	       1	10556014486 ns/op	1841783232 B/op	19593870 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes
E0810 22:08:41.769538   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:08:41.772404   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes-8                  	       1	24059268024 ns/op	4481182184 B/op	49200665 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes
E0810 22:11:29.063839   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:11:29.067009   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes-8         	       1	155241913919 ns/op	38619854520 B/op	336083791 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes
E0810 22:14:04.277684   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:14:04.280583   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes-8           	       1	142964025244 ns/op	23707398408 B/op	228825571 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes
E0810 22:16:42.878000   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:16:42.880984   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes-8             	       1	146246411191 ns/op	36098079720 B/op	338528978 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes
E0810 22:19:12.133628   36087 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0810 22:19:12.136995   36087 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes-8               	       1	136868358276 ns/op	18577716664 B/op	216719508 allocs/op
PASS
F0810 22:19:18.222952   36087 etcd.go:213] unexpected number of goroutines: before: 2 after 42
goroutine 1 [running]:
k8s.io/kubernetes/vendor/k8s.io/klog/v2/internal/dbg.Stacks(0x0)
... skipping 10 lines ...
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/framework/etcd.go:213 +0x345
k8s.io/kubernetes/test/integration/scheduler_perf.TestMain(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/scheduler_perf/main_test.go:26
main.main()
	_testmain.go:49 +0x1fc
exit status 255
FAIL	k8s.io/kubernetes/test/integration/scheduler_perf	2547.869s

DONE 0 tests, 1 failure in 0.004s
+++ [0810 22:19:18] prune-junit-xml not found; installing from hack/tools
processing junit xml file : /logs/artifacts/junit_20220810-213356.xml
done.
+++ [0810 22:19:19] Saved JUnit XML test report to /logs/artifacts/junit_20220810-213356.xml
make[1]: *** [Makefile:188: test] Error 1
!!! [0810 22:19:19] Call tree:
!!! [0810 22:19:19]  1: hack/make-rules/test-integration.sh:102 runTests(...)
+++ [0810 22:19:19] Cleaning up etcd
+++ [0810 22:19:19] Integration test cleanup complete
make: *** [Makefile:207: test-integration] Error 1