This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 0 succeeded
Started2022-08-11 21:37
Elapsed1h20m
Revisionmaster

Test Failures


k8s.io/kubernetes/test/integration/scheduler_perf TestMain 0.00s

go test -v k8s.io/kubernetes/test/integration/scheduler_perf -run TestMain$
goos: linux
goarch: amd64
pkg: k8s.io/kubernetes/test/integration/scheduler_perf
cpu: Intel(R) Xeon(R) CPU @ 2.30GHz
BenchmarkPerfScheduling
BenchmarkPerfScheduling/SchedulingBasic
BenchmarkPerfScheduling/SchedulingBasic/500Nodes
E0811 21:42:29.779671   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:42:29.792644   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/500Nodes-8         	       1	12775900775 ns/op	1797906024 B/op	18805516 allocs/op
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes
E0811 21:44:07.889630   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:44:07.903647   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes-8        	       1	55397992654 ns/op	4442545048 B/op	48380060 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes
E0811 21:44:29.430414   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:44:29.461448   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes-8         	       1	15886370984 ns/op	1147828096 B/op	11288373 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes
E0811 21:47:06.212122   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:47:06.226561   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes-8        	       1	110631356708 ns/op	10169554568 B/op	103896466 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes
E0811 21:47:27.998097   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:47:28.013614   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes-8                 	       1	15278604391 ns/op	2106629200 B/op	22427011 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes
E0811 21:49:42.133626   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:49:42.147580   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes-8                	       1	83891604185 ns/op	14514035376 B/op	157122987 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes
E0811 21:50:14.671398   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:50:14.685999   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes-8               	       1	26594909016 ns/op	5374803008 B/op	68494865 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes
E0811 21:54:27.684940   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:54:27.703756   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes-8              	       1	196419103161 ns/op	47153252464 B/op	533425293 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes
E0811 21:55:08.152649   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:55:08.166733   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes-8       	       1	33870658508 ns/op	7399693720 B/op	77144455 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes
E0811 21:59:57.201527   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:59:57.215632   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes-8      	       1	244096160517 ns/op	57226405752 B/op	563851900 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes
E0811 22:00:31.143646   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:00:31.157159   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes-8                  	       1	27656460127 ns/op	3991964280 B/op	52682997 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes
E0811 22:04:54.381260   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:04:54.395538   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes-8                 	       1	218843841440 ns/op	33917997632 B/op	397681368 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes
E0811 22:05:20.657321   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:05:20.669809   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes-8             	       1	20382009493 ns/op	2628939512 B/op	25863197 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes
E0811 22:08:53.163718   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:08:53.181070   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes-8            	       1	161755198854 ns/op	35036620344 B/op	323176661 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes
E0811 22:09:18.370975   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:09:18.388672   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes-8    	       1	19043506422 ns/op	2021235232 B/op	21702943 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes
E0811 22:12:22.648577   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:12:22.670240   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes-8   	       1	135828508575 ns/op	16278810264 B/op	190553488 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes
E0811 22:12:52.836615   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:12:52.853507   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes-8         	       1	23611640206 ns/op	2062351704 B/op	22293930 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes
E0811 22:16:07.348776   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:16:07.365591   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes-8        	       1	142441156130 ns/op	16349206896 B/op	190090065 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes
E0811 22:16:33.733570   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:16:33.750904   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes-8                     	       1	19807620767 ns/op	2044014776 B/op	21252638 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes
E0811 22:19:14.141568   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:19:14.156792   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes-8                    	       1	115635531185 ns/op	14572067632 B/op	154360744 allocs/op
BenchmarkPerfScheduling/TopologySpreading
BenchmarkPerfScheduling/TopologySpreading/500Nodes
E0811 22:19:41.505649   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:19:41.522346   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/500Nodes-8                          	       1	20873830493 ns/op	2694087328 B/op	27360762 allocs/op
BenchmarkPerfScheduling/TopologySpreading/5000Nodes
E0811 22:22:33.467217   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:22:33.480935   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/5000Nodes-8                         	       1	124366963057 ns/op	20042852760 B/op	192074504 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes
E0811 22:22:58.317984   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:22:58.331404   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes-8                 	       1	19298702601 ns/op	2459240688 B/op	26044548 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes
E0811 22:25:33.412530   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:25:33.433494   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes-8                	       1	113780613721 ns/op	15365745408 B/op	166396444 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes
E0811 22:25:59.419441   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:25:59.435384   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes-8                     	       1	20287813665 ns/op	2555847088 B/op	27564212 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes
E0811 22:29:28.932461   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:29:28.968201   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes-8                    	       1	161475835146 ns/op	32738989736 B/op	368773352 allocs/op
BenchmarkPerfScheduling/PreemptionBasic
BenchmarkPerfScheduling/PreemptionBasic/500Nodes
E0811 22:30:41.436437   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:30:41.451400   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionBasic/500Nodes-8                            	       1	66344296609 ns/op	6699625288 B/op	72023611 allocs/op
BenchmarkPerfScheduling/PreemptionPVs
BenchmarkPerfScheduling/PreemptionPVs/500Nodes
E0811 22:32:08.871528   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:32:08.911920   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionPVs/500Nodes-8                              	       1	81139603991 ns/op	11255708472 B/op	134592969 allocs/op
BenchmarkPerfScheduling/Unschedulable
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods
E0811 22:32:30.847956   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:32:30.866349   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods-8                  	       1	16182488285 ns/op	1695737616 B/op	20263557 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods
E0811 22:34:44.583295   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:34:44.595581   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods-8                 	       1	82375689655 ns/op	12886002520 B/op	162339555 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods
E0811 22:38:02.241729   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:38:02.257373   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods-8                	       1	150051224095 ns/op	40073605528 B/op	674670182 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes
E0811 22:38:31.170598   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:38:31.190136   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes-8                  	       1	17947963487 ns/op	1838062608 B/op	19420143 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes
E0811 22:40:19.458531   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:40:19.471005   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes-8                  	       1	59727461721 ns/op	4549580232 B/op	50190564 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes
E0811 22:44:56.630195   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:44:56.666934   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes-8         	       1	226148741003 ns/op	39160661632 B/op	343378358 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes
E0811 22:49:25.793190   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:49:25.809883   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes-8           	       1	214957807006 ns/op	24252257456 B/op	235722201 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes
E0811 22:53:56.465851   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:53:56.481372   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes-8             	       1	218295552140 ns/op	36774668808 B/op	347511072 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes
E0811 22:58:04.199506   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:58:04.211353   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes-8               	       1	204339433856 ns/op	19197520456 B/op	225007014 allocs/op
PASS
F0811 22:58:10.260399   36059 etcd.go:213] unexpected number of goroutines: before: 2 after 42
goroutine 1 [running]:
k8s.io/kubernetes/vendor/k8s.io/klog/v2/internal/dbg.Stacks(0x0)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/internal/dbg/dbg.go:35 +0x89
k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).output(0x7dd57c0, 0x3, 0x0, 0xc02d793c00, 0x1, {0x6695d69?, 0x2?}, 0xc0055be000?, 0x0)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:936 +0x686
k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).printfDepth(0x7dd57c0, 0xf?, 0x0, {0x0, 0x0}, 0xa0?, {0x4d4dd18, 0x34}, {0xc0411d2000, 0x2, ...})
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:737 +0x1f3
k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).printf(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:719
k8s.io/kubernetes/vendor/k8s.io/klog/v2.Fatalf(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:1618
k8s.io/kubernetes/test/integration/framework.EtcdMain(0xc000dbff60)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/framework/etcd.go:213 +0x345
k8s.io/kubernetes/test/integration/scheduler_perf.TestMain(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/scheduler_perf/main_test.go:26
main.main()
	_testmain.go:49 +0x1fc
exit status 255
FAIL	k8s.io/kubernetes/test/integration/scheduler_perf	4557.977s

				from junit_20220811-213927.xml

Find from mentions in log files | View test history on testgrid


Error lines from build-log.txt

... skipping 89 lines ...
BenchmarkPerfScheduling

BenchmarkPerfScheduling/SchedulingBasic

BenchmarkPerfScheduling/SchedulingBasic/500Nodes

E0811 21:42:29.779671   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 21:42:29.792644   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingBasic/500Nodes-8         	       1	12775900775 ns/op	1797906024 B/op	18805516 allocs/op

BenchmarkPerfScheduling/SchedulingBasic/5000Nodes

E0811 21:44:07.889630   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 21:44:07.903647   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingBasic/5000Nodes-8        	       1	55397992654 ns/op	4442545048 B/op	48380060 allocs/op

BenchmarkPerfScheduling/SchedulingPodAntiAffinity

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes

E0811 21:44:29.430414   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 21:44:29.461448   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes-8         	       1	15886370984 ns/op	1147828096 B/op	11288373 allocs/op

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes

E0811 21:47:06.212122   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 21:47:06.226561   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes-8        	       1	110631356708 ns/op	10169554568 B/op	103896466 allocs/op

BenchmarkPerfScheduling/SchedulingSecrets

BenchmarkPerfScheduling/SchedulingSecrets/500Nodes

E0811 21:47:27.998097   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 21:47:28.013614   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingSecrets/500Nodes-8                 	       1	15278604391 ns/op	2106629200 B/op	22427011 allocs/op

BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes

E0811 21:49:42.133626   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 21:49:42.147580   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes-8                	       1	83891604185 ns/op	14514035376 B/op	157122987 allocs/op

BenchmarkPerfScheduling/SchedulingInTreePVs

BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes

E0811 21:50:14.671398   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 21:50:14.685999   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes-8               	       1	26594909016 ns/op	5374803008 B/op	68494865 allocs/op

BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes

E0811 21:54:27.684940   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 21:54:27.703756   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes-8              	       1	196419103161 ns/op	47153252464 B/op	533425293 allocs/op

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes

E0811 21:55:08.152649   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 21:55:08.166733   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes-8       	       1	33870658508 ns/op	7399693720 B/op	77144455 allocs/op

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes

E0811 21:59:57.201527   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 21:59:57.215632   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes-8      	       1	244096160517 ns/op	57226405752 B/op	563851900 allocs/op

BenchmarkPerfScheduling/SchedulingCSIPVs

BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes

E0811 22:00:31.143646   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:00:31.157159   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes-8                  	       1	27656460127 ns/op	3991964280 B/op	52682997 allocs/op

BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes

E0811 22:04:54.381260   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:04:54.395538   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes-8                 	       1	218843841440 ns/op	33917997632 B/op	397681368 allocs/op

BenchmarkPerfScheduling/SchedulingPodAffinity

BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes

E0811 22:05:20.657321   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:05:20.669809   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes-8             	       1	20382009493 ns/op	2628939512 B/op	25863197 allocs/op

BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes

E0811 22:08:53.163718   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:08:53.181070   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes-8            	       1	161755198854 ns/op	35036620344 B/op	323176661 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes

E0811 22:09:18.370975   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:09:18.388672   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes-8    	       1	19043506422 ns/op	2021235232 B/op	21702943 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes

E0811 22:12:22.648577   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:12:22.670240   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes-8   	       1	135828508575 ns/op	16278810264 B/op	190553488 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes

E0811 22:12:52.836615   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:12:52.853507   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes-8         	       1	23611640206 ns/op	2062351704 B/op	22293930 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes

E0811 22:16:07.348776   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:16:07.365591   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes-8        	       1	142441156130 ns/op	16349206896 B/op	190090065 allocs/op

BenchmarkPerfScheduling/SchedulingNodeAffinity

BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes

E0811 22:16:33.733570   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:16:33.750904   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes-8                     	       1	19807620767 ns/op	2044014776 B/op	21252638 allocs/op

BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes

E0811 22:19:14.141568   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:19:14.156792   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes-8                    	       1	115635531185 ns/op	14572067632 B/op	154360744 allocs/op

BenchmarkPerfScheduling/TopologySpreading

BenchmarkPerfScheduling/TopologySpreading/500Nodes

E0811 22:19:41.505649   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:19:41.522346   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/TopologySpreading/500Nodes-8                          	       1	20873830493 ns/op	2694087328 B/op	27360762 allocs/op

BenchmarkPerfScheduling/TopologySpreading/5000Nodes

E0811 22:22:33.467217   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:22:33.480935   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/TopologySpreading/5000Nodes-8                         	       1	124366963057 ns/op	20042852760 B/op	192074504 allocs/op

BenchmarkPerfScheduling/PreferredTopologySpreading

BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes

E0811 22:22:58.317984   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:22:58.331404   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes-8                 	       1	19298702601 ns/op	2459240688 B/op	26044548 allocs/op

BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes

E0811 22:25:33.412530   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:25:33.433494   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes-8                	       1	113780613721 ns/op	15365745408 B/op	166396444 allocs/op

BenchmarkPerfScheduling/MixedSchedulingBasePod

BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes

E0811 22:25:59.419441   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:25:59.435384   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes-8                     	       1	20287813665 ns/op	2555847088 B/op	27564212 allocs/op

BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes

E0811 22:29:28.932461   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:29:28.968201   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes-8                    	       1	161475835146 ns/op	32738989736 B/op	368773352 allocs/op

BenchmarkPerfScheduling/PreemptionBasic

BenchmarkPerfScheduling/PreemptionBasic/500Nodes

E0811 22:30:41.436437   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:30:41.451400   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreemptionBasic/500Nodes-8                            	       1	66344296609 ns/op	6699625288 B/op	72023611 allocs/op

BenchmarkPerfScheduling/PreemptionPVs

BenchmarkPerfScheduling/PreemptionPVs/500Nodes

E0811 22:32:08.871528   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:32:08.911920   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreemptionPVs/500Nodes-8                              	       1	81139603991 ns/op	11255708472 B/op	134592969 allocs/op

BenchmarkPerfScheduling/Unschedulable

BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods

E0811 22:32:30.847956   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:32:30.866349   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods-8                  	       1	16182488285 ns/op	1695737616 B/op	20263557 allocs/op

BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods

E0811 22:34:44.583295   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:34:44.595581   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods-8                 	       1	82375689655 ns/op	12886002520 B/op	162339555 allocs/op

BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods

E0811 22:38:02.241729   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:38:02.257373   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods-8                	       1	150051224095 ns/op	40073605528 B/op	674670182 allocs/op

BenchmarkPerfScheduling/SchedulingWithMixedChurn

BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes

E0811 22:38:31.170598   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:38:31.190136   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes-8                  	       1	17947963487 ns/op	1838062608 B/op	19420143 allocs/op

BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes

E0811 22:40:19.458531   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:40:19.471005   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes-8                  	       1	59727461721 ns/op	4549580232 B/op	50190564 allocs/op

BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes

E0811 22:44:56.630195   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:44:56.666934   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes-8         	       1	226148741003 ns/op	39160661632 B/op	343378358 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes

E0811 22:49:25.793190   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:49:25.809883   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes-8           	       1	214957807006 ns/op	24252257456 B/op	235722201 allocs/op

BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes

E0811 22:53:56.465851   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:53:56.481372   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes-8             	       1	218295552140 ns/op	36774668808 B/op	347511072 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes

E0811 22:58:04.199506   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0811 22:58:04.211353   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes-8               	       1	204339433856 ns/op	19197520456 B/op	225007014 allocs/op

PASS
... skipping 33 lines ...
main.main()

	_testmain.go:49 +0x1fc

exit status 255

FAIL	k8s.io/kubernetes/test/integration/scheduler_perf	4557.977s


✖  test/integration/scheduler_perf (1h15m57.978s)

=== Failed
=== FAIL: test/integration/scheduler_perf  (0.00s)
goos: linux
goarch: amd64
pkg: k8s.io/kubernetes/test/integration/scheduler_perf
cpu: Intel(R) Xeon(R) CPU @ 2.30GHz
BenchmarkPerfScheduling
BenchmarkPerfScheduling/SchedulingBasic
BenchmarkPerfScheduling/SchedulingBasic/500Nodes
E0811 21:42:29.779671   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:42:29.792644   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/500Nodes-8         	       1	12775900775 ns/op	1797906024 B/op	18805516 allocs/op
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes
E0811 21:44:07.889630   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:44:07.903647   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes-8        	       1	55397992654 ns/op	4442545048 B/op	48380060 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes
E0811 21:44:29.430414   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:44:29.461448   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes-8         	       1	15886370984 ns/op	1147828096 B/op	11288373 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes
E0811 21:47:06.212122   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:47:06.226561   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes-8        	       1	110631356708 ns/op	10169554568 B/op	103896466 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes
E0811 21:47:27.998097   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:47:28.013614   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes-8                 	       1	15278604391 ns/op	2106629200 B/op	22427011 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes
E0811 21:49:42.133626   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:49:42.147580   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes-8                	       1	83891604185 ns/op	14514035376 B/op	157122987 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes
E0811 21:50:14.671398   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:50:14.685999   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes-8               	       1	26594909016 ns/op	5374803008 B/op	68494865 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes
E0811 21:54:27.684940   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:54:27.703756   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes-8              	       1	196419103161 ns/op	47153252464 B/op	533425293 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes
E0811 21:55:08.152649   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:55:08.166733   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes-8       	       1	33870658508 ns/op	7399693720 B/op	77144455 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes
E0811 21:59:57.201527   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 21:59:57.215632   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes-8      	       1	244096160517 ns/op	57226405752 B/op	563851900 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes
E0811 22:00:31.143646   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:00:31.157159   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes-8                  	       1	27656460127 ns/op	3991964280 B/op	52682997 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes
E0811 22:04:54.381260   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:04:54.395538   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes-8                 	       1	218843841440 ns/op	33917997632 B/op	397681368 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes
E0811 22:05:20.657321   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:05:20.669809   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes-8             	       1	20382009493 ns/op	2628939512 B/op	25863197 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes
E0811 22:08:53.163718   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:08:53.181070   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes-8            	       1	161755198854 ns/op	35036620344 B/op	323176661 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes
E0811 22:09:18.370975   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:09:18.388672   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes-8    	       1	19043506422 ns/op	2021235232 B/op	21702943 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes
E0811 22:12:22.648577   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:12:22.670240   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes-8   	       1	135828508575 ns/op	16278810264 B/op	190553488 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes
E0811 22:12:52.836615   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:12:52.853507   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes-8         	       1	23611640206 ns/op	2062351704 B/op	22293930 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes
E0811 22:16:07.348776   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:16:07.365591   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes-8        	       1	142441156130 ns/op	16349206896 B/op	190090065 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes
E0811 22:16:33.733570   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:16:33.750904   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes-8                     	       1	19807620767 ns/op	2044014776 B/op	21252638 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes
E0811 22:19:14.141568   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:19:14.156792   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes-8                    	       1	115635531185 ns/op	14572067632 B/op	154360744 allocs/op
BenchmarkPerfScheduling/TopologySpreading
BenchmarkPerfScheduling/TopologySpreading/500Nodes
E0811 22:19:41.505649   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:19:41.522346   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/500Nodes-8                          	       1	20873830493 ns/op	2694087328 B/op	27360762 allocs/op
BenchmarkPerfScheduling/TopologySpreading/5000Nodes
E0811 22:22:33.467217   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:22:33.480935   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/5000Nodes-8                         	       1	124366963057 ns/op	20042852760 B/op	192074504 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes
E0811 22:22:58.317984   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:22:58.331404   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes-8                 	       1	19298702601 ns/op	2459240688 B/op	26044548 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes
E0811 22:25:33.412530   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:25:33.433494   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes-8                	       1	113780613721 ns/op	15365745408 B/op	166396444 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes
E0811 22:25:59.419441   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:25:59.435384   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes-8                     	       1	20287813665 ns/op	2555847088 B/op	27564212 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes
E0811 22:29:28.932461   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:29:28.968201   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes-8                    	       1	161475835146 ns/op	32738989736 B/op	368773352 allocs/op
BenchmarkPerfScheduling/PreemptionBasic
BenchmarkPerfScheduling/PreemptionBasic/500Nodes
E0811 22:30:41.436437   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:30:41.451400   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionBasic/500Nodes-8                            	       1	66344296609 ns/op	6699625288 B/op	72023611 allocs/op
BenchmarkPerfScheduling/PreemptionPVs
BenchmarkPerfScheduling/PreemptionPVs/500Nodes
E0811 22:32:08.871528   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:32:08.911920   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionPVs/500Nodes-8                              	       1	81139603991 ns/op	11255708472 B/op	134592969 allocs/op
BenchmarkPerfScheduling/Unschedulable
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods
E0811 22:32:30.847956   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:32:30.866349   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods-8                  	       1	16182488285 ns/op	1695737616 B/op	20263557 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods
E0811 22:34:44.583295   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:34:44.595581   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods-8                 	       1	82375689655 ns/op	12886002520 B/op	162339555 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods
E0811 22:38:02.241729   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:38:02.257373   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods-8                	       1	150051224095 ns/op	40073605528 B/op	674670182 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes
E0811 22:38:31.170598   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:38:31.190136   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes-8                  	       1	17947963487 ns/op	1838062608 B/op	19420143 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes
E0811 22:40:19.458531   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:40:19.471005   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes-8                  	       1	59727461721 ns/op	4549580232 B/op	50190564 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes
E0811 22:44:56.630195   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:44:56.666934   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes-8         	       1	226148741003 ns/op	39160661632 B/op	343378358 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes
E0811 22:49:25.793190   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:49:25.809883   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes-8           	       1	214957807006 ns/op	24252257456 B/op	235722201 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes
E0811 22:53:56.465851   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:53:56.481372   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes-8             	       1	218295552140 ns/op	36774668808 B/op	347511072 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes
E0811 22:58:04.199506   36059 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0811 22:58:04.211353   36059 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes-8               	       1	204339433856 ns/op	19197520456 B/op	225007014 allocs/op
PASS
F0811 22:58:10.260399   36059 etcd.go:213] unexpected number of goroutines: before: 2 after 42
goroutine 1 [running]:
k8s.io/kubernetes/vendor/k8s.io/klog/v2/internal/dbg.Stacks(0x0)
... skipping 10 lines ...
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/framework/etcd.go:213 +0x345
k8s.io/kubernetes/test/integration/scheduler_perf.TestMain(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/scheduler_perf/main_test.go:26
main.main()
	_testmain.go:49 +0x1fc
exit status 255
FAIL	k8s.io/kubernetes/test/integration/scheduler_perf	4557.977s

DONE 0 tests, 1 failure in 0.002s
+++ [0811 22:58:10] prune-junit-xml not found; installing from hack/tools
processing junit xml file : /logs/artifacts/junit_20220811-213927.xml
done.
+++ [0811 22:58:11] Saved JUnit XML test report to /logs/artifacts/junit_20220811-213927.xml
make[1]: *** [Makefile:188: test] Error 1
!!! [0811 22:58:11] Call tree:
!!! [0811 22:58:11]  1: hack/make-rules/test-integration.sh:102 runTests(...)
+++ [0811 22:58:11] Cleaning up etcd
+++ [0811 22:58:11] Integration test cleanup complete
make: *** [Makefile:207: test-integration] Error 1