This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 0 succeeded
Started2022-08-12 03:40
Elapsed47m3s
Revisionmaster

Test Failures


k8s.io/kubernetes/test/integration/scheduler_perf TestMain 0.00s

go test -v k8s.io/kubernetes/test/integration/scheduler_perf -run TestMain$
goos: linux
goarch: amd64
pkg: k8s.io/kubernetes/test/integration/scheduler_perf
cpu: Intel(R) Xeon(R) CPU @ 2.30GHz
BenchmarkPerfScheduling
BenchmarkPerfScheduling/SchedulingBasic
BenchmarkPerfScheduling/SchedulingBasic/500Nodes
E0812 03:45:30.423265   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:45:30.425992   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/500Nodes-8         	       1	10656421106 ns/op	1805018144 B/op	18755858 allocs/op
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes
E0812 03:46:05.049185   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:46:05.051980   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes-8        	       1	23594247553 ns/op	4330248792 B/op	46759853 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes
E0812 03:46:16.203070   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:46:16.206175   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes-8         	       1	8954492660 ns/op	1144490832 B/op	11285566 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes
E0812 03:47:13.744175   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:47:13.747137   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes-8        	       1	45898027817 ns/op	9667043520 B/op	96845714 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes
E0812 03:47:27.404704   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:47:27.407819   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes-8                 	       1	11340862652 ns/op	2121115344 B/op	22621205 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes
E0812 03:48:42.225584   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:48:42.228928   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes-8                	       1	61843723089 ns/op	14718729048 B/op	158670728 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes
E0812 03:49:10.383821   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:49:10.388303   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes-8               	       1	25731588997 ns/op	5459908080 B/op	69140995 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes
E0812 03:52:21.898931   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:52:21.901796   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes-8              	       1	179760213756 ns/op	48150413960 B/op	539348149 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes
E0812 03:52:49.670339   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:52:49.673603   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes-8       	       1	25225812386 ns/op	7459377288 B/op	77631556 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes
E0812 03:56:11.185304   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:56:11.187974   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes-8      	       1	188928716892 ns/op	58173409664 B/op	566423873 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes
E0812 03:56:35.281817   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:56:35.285072   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes-8                  	       1	21548725560 ns/op	4086499776 B/op	53750574 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes
E0812 03:59:32.842730   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:59:32.845958   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes-8                 	       1	164647765135 ns/op	34643997488 B/op	399151758 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes
E0812 03:59:49.436597   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:59:49.442976   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes-8             	       1	13883844366 ns/op	2614753296 B/op	25817299 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes
E0812 04:01:42.579575   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:01:42.588657   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes-8            	       1	101787834039 ns/op	34754915720 B/op	318782088 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes
E0812 04:01:56.560369   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:01:56.563394   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes-8    	       1	11534004427 ns/op	2030845808 B/op	21800491 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes
E0812 04:03:19.746650   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:03:19.749804   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes-8   	       1	71284571687 ns/op	16109612816 B/op	185971156 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes
E0812 04:03:34.678736   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:03:34.683283   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes-8         	       1	12554155273 ns/op	2053803992 B/op	22124630 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes
E0812 04:04:56.026425   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:04:56.029350   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes-8        	       1	69810613835 ns/op	15982252600 B/op	185242690 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes
E0812 04:05:10.113399   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:05:10.116312   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes-8                     	       1	11605733839 ns/op	2041549904 B/op	21097623 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes
E0812 04:06:19.571108   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:06:19.573854   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes-8                    	       1	57906157511 ns/op	14091496920 B/op	147822457 allocs/op
BenchmarkPerfScheduling/TopologySpreading
BenchmarkPerfScheduling/TopologySpreading/500Nodes
E0812 04:06:34.829381   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:06:34.832234   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/500Nodes-8                          	       1	12870350780 ns/op	2699319504 B/op	27439774 allocs/op
BenchmarkPerfScheduling/TopologySpreading/5000Nodes
E0812 04:07:56.068096   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:07:56.071037   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/5000Nodes-8                         	       1	69797462884 ns/op	19826482824 B/op	189021219 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes
E0812 04:08:11.940474   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:08:11.943721   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes-8                 	       1	13456322458 ns/op	2462870736 B/op	25996100 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes
E0812 04:09:32.542484   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:09:32.545074   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes-8                	       1	68870610123 ns/op	15355774672 B/op	164239377 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes
E0812 04:09:49.393631   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:09:49.396753   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes-8                     	       1	14417255068 ns/op	2584169616 B/op	27882517 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes
E0812 04:11:54.434898   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:11:54.438078   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes-8                    	       1	113866406335 ns/op	32841197648 B/op	368125125 allocs/op
BenchmarkPerfScheduling/PreemptionBasic
BenchmarkPerfScheduling/PreemptionBasic/500Nodes
E0812 04:12:18.994498   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:12:18.997678   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionBasic/500Nodes-8                            	       1	22084725106 ns/op	5603931584 B/op	64232052 allocs/op
BenchmarkPerfScheduling/PreemptionPVs
BenchmarkPerfScheduling/PreemptionPVs/500Nodes
E0812 04:13:03.265419   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:13:03.267972   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionPVs/500Nodes-8                              	       1	41948766496 ns/op	10123134120 B/op	126988375 allocs/op
BenchmarkPerfScheduling/Unschedulable
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods
E0812 04:13:14.503747   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:13:14.506889   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods-8                  	       1	8997145881 ns/op	1674043464 B/op	20121573 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods
E0812 04:14:12.047853   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:14:12.051400   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods-8                 	       1	46266341769 ns/op	12831256184 B/op	161968634 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods
E0812 04:15:58.860318   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:15:58.863034   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods-8                	       1	95816924253 ns/op	38979966040 B/op	664445655 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes
E0812 04:16:11.734829   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:16:11.738444   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes-8                  	       1	9608598604 ns/op	1816270496 B/op	19213789 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes
E0812 04:16:46.055548   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:16:46.058419   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes-8                  	       1	23567090764 ns/op	4449437688 B/op	48623639 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes
E0812 04:19:28.155559   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:19:28.158418   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes-8         	       1	150891561841 ns/op	38520299648 B/op	335179121 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes
E0812 04:22:00.866034   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:22:00.869027   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes-8           	       1	140597229857 ns/op	23655007704 B/op	228049926 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes
E0812 04:24:36.887618   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:24:36.890957   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes-8             	       1	143879095297 ns/op	36024646872 B/op	337670223 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes
E0812 04:27:05.650757   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:27:05.653560   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes-8               	       1	137207399830 ns/op	18606081160 B/op	217068308 allocs/op
PASS
F0812 04:27:11.729170   36009 etcd.go:213] unexpected number of goroutines: before: 2 after 42
goroutine 1 [running]:
k8s.io/kubernetes/vendor/k8s.io/klog/v2/internal/dbg.Stacks(0x0)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/internal/dbg/dbg.go:35 +0x89
k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).output(0x7dd57c0, 0x3, 0x0, 0xc03f6c7a40, 0x1, {0x6695d69?, 0x2?}, 0xc0000c6c00?, 0x0)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:936 +0x686
k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).printfDepth(0x7dd57c0, 0xf?, 0x0, {0x0, 0x0}, 0xa0?, {0x4d4dd18, 0x34}, {0xc01842a0e0, 0x2, ...})
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:737 +0x1f3
k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).printf(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:719
k8s.io/kubernetes/vendor/k8s.io/klog/v2.Fatalf(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:1618
k8s.io/kubernetes/test/integration/framework.EtcdMain(0xc000e1ff60)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/framework/etcd.go:213 +0x345
k8s.io/kubernetes/test/integration/scheduler_perf.TestMain(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/scheduler_perf/main_test.go:26
main.main()
	_testmain.go:49 +0x1fc
exit status 255
FAIL	k8s.io/kubernetes/test/integration/scheduler_perf	2513.094s

				from junit_20220812-034228.xml

Find from mentions in log files | View test history on testgrid


Error lines from build-log.txt

... skipping 89 lines ...
BenchmarkPerfScheduling

BenchmarkPerfScheduling/SchedulingBasic

BenchmarkPerfScheduling/SchedulingBasic/500Nodes

E0812 03:45:30.423265   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 03:45:30.425992   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingBasic/500Nodes-8         	       1	10656421106 ns/op	1805018144 B/op	18755858 allocs/op

BenchmarkPerfScheduling/SchedulingBasic/5000Nodes

E0812 03:46:05.049185   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 03:46:05.051980   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingBasic/5000Nodes-8        	       1	23594247553 ns/op	4330248792 B/op	46759853 allocs/op

BenchmarkPerfScheduling/SchedulingPodAntiAffinity

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes

E0812 03:46:16.203070   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 03:46:16.206175   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes-8         	       1	8954492660 ns/op	1144490832 B/op	11285566 allocs/op

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes

E0812 03:47:13.744175   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 03:47:13.747137   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes-8        	       1	45898027817 ns/op	9667043520 B/op	96845714 allocs/op

BenchmarkPerfScheduling/SchedulingSecrets

BenchmarkPerfScheduling/SchedulingSecrets/500Nodes

E0812 03:47:27.404704   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 03:47:27.407819   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingSecrets/500Nodes-8                 	       1	11340862652 ns/op	2121115344 B/op	22621205 allocs/op

BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes

E0812 03:48:42.225584   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 03:48:42.228928   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes-8                	       1	61843723089 ns/op	14718729048 B/op	158670728 allocs/op

BenchmarkPerfScheduling/SchedulingInTreePVs

BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes

E0812 03:49:10.383821   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 03:49:10.388303   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes-8               	       1	25731588997 ns/op	5459908080 B/op	69140995 allocs/op

BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes

E0812 03:52:21.898931   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 03:52:21.901796   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes-8              	       1	179760213756 ns/op	48150413960 B/op	539348149 allocs/op

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes

E0812 03:52:49.670339   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 03:52:49.673603   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes-8       	       1	25225812386 ns/op	7459377288 B/op	77631556 allocs/op

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes

E0812 03:56:11.185304   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 03:56:11.187974   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes-8      	       1	188928716892 ns/op	58173409664 B/op	566423873 allocs/op

BenchmarkPerfScheduling/SchedulingCSIPVs

BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes

E0812 03:56:35.281817   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 03:56:35.285072   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes-8                  	       1	21548725560 ns/op	4086499776 B/op	53750574 allocs/op

BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes

E0812 03:59:32.842730   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 03:59:32.845958   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes-8                 	       1	164647765135 ns/op	34643997488 B/op	399151758 allocs/op

BenchmarkPerfScheduling/SchedulingPodAffinity

BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes

E0812 03:59:49.436597   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 03:59:49.442976   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes-8             	       1	13883844366 ns/op	2614753296 B/op	25817299 allocs/op

BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes

E0812 04:01:42.579575   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:01:42.588657   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes-8            	       1	101787834039 ns/op	34754915720 B/op	318782088 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes

E0812 04:01:56.560369   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:01:56.563394   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes-8    	       1	11534004427 ns/op	2030845808 B/op	21800491 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes

E0812 04:03:19.746650   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:03:19.749804   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes-8   	       1	71284571687 ns/op	16109612816 B/op	185971156 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes

E0812 04:03:34.678736   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:03:34.683283   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes-8         	       1	12554155273 ns/op	2053803992 B/op	22124630 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes

E0812 04:04:56.026425   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:04:56.029350   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes-8        	       1	69810613835 ns/op	15982252600 B/op	185242690 allocs/op

BenchmarkPerfScheduling/SchedulingNodeAffinity

BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes

E0812 04:05:10.113399   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:05:10.116312   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes-8                     	       1	11605733839 ns/op	2041549904 B/op	21097623 allocs/op

BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes

E0812 04:06:19.571108   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:06:19.573854   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes-8                    	       1	57906157511 ns/op	14091496920 B/op	147822457 allocs/op

BenchmarkPerfScheduling/TopologySpreading

BenchmarkPerfScheduling/TopologySpreading/500Nodes

E0812 04:06:34.829381   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:06:34.832234   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/TopologySpreading/500Nodes-8                          	       1	12870350780 ns/op	2699319504 B/op	27439774 allocs/op

BenchmarkPerfScheduling/TopologySpreading/5000Nodes

E0812 04:07:56.068096   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:07:56.071037   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/TopologySpreading/5000Nodes-8                         	       1	69797462884 ns/op	19826482824 B/op	189021219 allocs/op

BenchmarkPerfScheduling/PreferredTopologySpreading

BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes

E0812 04:08:11.940474   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:08:11.943721   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes-8                 	       1	13456322458 ns/op	2462870736 B/op	25996100 allocs/op

BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes

E0812 04:09:32.542484   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:09:32.545074   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes-8                	       1	68870610123 ns/op	15355774672 B/op	164239377 allocs/op

BenchmarkPerfScheduling/MixedSchedulingBasePod

BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes

E0812 04:09:49.393631   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:09:49.396753   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes-8                     	       1	14417255068 ns/op	2584169616 B/op	27882517 allocs/op

BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes

E0812 04:11:54.434898   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:11:54.438078   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes-8                    	       1	113866406335 ns/op	32841197648 B/op	368125125 allocs/op

BenchmarkPerfScheduling/PreemptionBasic

BenchmarkPerfScheduling/PreemptionBasic/500Nodes

E0812 04:12:18.994498   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:12:18.997678   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreemptionBasic/500Nodes-8                            	       1	22084725106 ns/op	5603931584 B/op	64232052 allocs/op

BenchmarkPerfScheduling/PreemptionPVs

BenchmarkPerfScheduling/PreemptionPVs/500Nodes

E0812 04:13:03.265419   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:13:03.267972   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreemptionPVs/500Nodes-8                              	       1	41948766496 ns/op	10123134120 B/op	126988375 allocs/op

BenchmarkPerfScheduling/Unschedulable

BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods

E0812 04:13:14.503747   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:13:14.506889   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods-8                  	       1	8997145881 ns/op	1674043464 B/op	20121573 allocs/op

BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods

E0812 04:14:12.047853   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:14:12.051400   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods-8                 	       1	46266341769 ns/op	12831256184 B/op	161968634 allocs/op

BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods

E0812 04:15:58.860318   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:15:58.863034   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods-8                	       1	95816924253 ns/op	38979966040 B/op	664445655 allocs/op

BenchmarkPerfScheduling/SchedulingWithMixedChurn

BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes

E0812 04:16:11.734829   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:16:11.738444   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes-8                  	       1	9608598604 ns/op	1816270496 B/op	19213789 allocs/op

BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes

E0812 04:16:46.055548   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:16:46.058419   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes-8                  	       1	23567090764 ns/op	4449437688 B/op	48623639 allocs/op

BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes

E0812 04:19:28.155559   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:19:28.158418   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes-8         	       1	150891561841 ns/op	38520299648 B/op	335179121 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes

E0812 04:22:00.866034   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:22:00.869027   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes-8           	       1	140597229857 ns/op	23655007704 B/op	228049926 allocs/op

BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes

E0812 04:24:36.887618   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:24:36.890957   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes-8             	       1	143879095297 ns/op	36024646872 B/op	337670223 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes

E0812 04:27:05.650757   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0812 04:27:05.653560   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes-8               	       1	137207399830 ns/op	18606081160 B/op	217068308 allocs/op

PASS
... skipping 33 lines ...
main.main()

	_testmain.go:49 +0x1fc

exit status 255

FAIL	k8s.io/kubernetes/test/integration/scheduler_perf	2513.094s


✖  test/integration/scheduler_perf (41m53.095s)

=== Failed
=== FAIL: test/integration/scheduler_perf  (0.00s)
goos: linux
goarch: amd64
pkg: k8s.io/kubernetes/test/integration/scheduler_perf
cpu: Intel(R) Xeon(R) CPU @ 2.30GHz
BenchmarkPerfScheduling
BenchmarkPerfScheduling/SchedulingBasic
BenchmarkPerfScheduling/SchedulingBasic/500Nodes
E0812 03:45:30.423265   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:45:30.425992   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/500Nodes-8         	       1	10656421106 ns/op	1805018144 B/op	18755858 allocs/op
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes
E0812 03:46:05.049185   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:46:05.051980   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes-8        	       1	23594247553 ns/op	4330248792 B/op	46759853 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes
E0812 03:46:16.203070   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:46:16.206175   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes-8         	       1	8954492660 ns/op	1144490832 B/op	11285566 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes
E0812 03:47:13.744175   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:47:13.747137   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes-8        	       1	45898027817 ns/op	9667043520 B/op	96845714 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes
E0812 03:47:27.404704   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:47:27.407819   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes-8                 	       1	11340862652 ns/op	2121115344 B/op	22621205 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes
E0812 03:48:42.225584   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:48:42.228928   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes-8                	       1	61843723089 ns/op	14718729048 B/op	158670728 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes
E0812 03:49:10.383821   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:49:10.388303   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes-8               	       1	25731588997 ns/op	5459908080 B/op	69140995 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes
E0812 03:52:21.898931   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:52:21.901796   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes-8              	       1	179760213756 ns/op	48150413960 B/op	539348149 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes
E0812 03:52:49.670339   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:52:49.673603   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes-8       	       1	25225812386 ns/op	7459377288 B/op	77631556 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes
E0812 03:56:11.185304   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:56:11.187974   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes-8      	       1	188928716892 ns/op	58173409664 B/op	566423873 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes
E0812 03:56:35.281817   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:56:35.285072   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes-8                  	       1	21548725560 ns/op	4086499776 B/op	53750574 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes
E0812 03:59:32.842730   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:59:32.845958   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes-8                 	       1	164647765135 ns/op	34643997488 B/op	399151758 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes
E0812 03:59:49.436597   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 03:59:49.442976   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes-8             	       1	13883844366 ns/op	2614753296 B/op	25817299 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes
E0812 04:01:42.579575   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:01:42.588657   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes-8            	       1	101787834039 ns/op	34754915720 B/op	318782088 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes
E0812 04:01:56.560369   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:01:56.563394   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes-8    	       1	11534004427 ns/op	2030845808 B/op	21800491 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes
E0812 04:03:19.746650   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:03:19.749804   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes-8   	       1	71284571687 ns/op	16109612816 B/op	185971156 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes
E0812 04:03:34.678736   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:03:34.683283   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes-8         	       1	12554155273 ns/op	2053803992 B/op	22124630 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes
E0812 04:04:56.026425   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:04:56.029350   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes-8        	       1	69810613835 ns/op	15982252600 B/op	185242690 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes
E0812 04:05:10.113399   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:05:10.116312   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes-8                     	       1	11605733839 ns/op	2041549904 B/op	21097623 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes
E0812 04:06:19.571108   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:06:19.573854   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes-8                    	       1	57906157511 ns/op	14091496920 B/op	147822457 allocs/op
BenchmarkPerfScheduling/TopologySpreading
BenchmarkPerfScheduling/TopologySpreading/500Nodes
E0812 04:06:34.829381   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:06:34.832234   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/500Nodes-8                          	       1	12870350780 ns/op	2699319504 B/op	27439774 allocs/op
BenchmarkPerfScheduling/TopologySpreading/5000Nodes
E0812 04:07:56.068096   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:07:56.071037   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/5000Nodes-8                         	       1	69797462884 ns/op	19826482824 B/op	189021219 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes
E0812 04:08:11.940474   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:08:11.943721   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes-8                 	       1	13456322458 ns/op	2462870736 B/op	25996100 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes
E0812 04:09:32.542484   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:09:32.545074   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes-8                	       1	68870610123 ns/op	15355774672 B/op	164239377 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes
E0812 04:09:49.393631   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:09:49.396753   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes-8                     	       1	14417255068 ns/op	2584169616 B/op	27882517 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes
E0812 04:11:54.434898   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:11:54.438078   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes-8                    	       1	113866406335 ns/op	32841197648 B/op	368125125 allocs/op
BenchmarkPerfScheduling/PreemptionBasic
BenchmarkPerfScheduling/PreemptionBasic/500Nodes
E0812 04:12:18.994498   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:12:18.997678   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionBasic/500Nodes-8                            	       1	22084725106 ns/op	5603931584 B/op	64232052 allocs/op
BenchmarkPerfScheduling/PreemptionPVs
BenchmarkPerfScheduling/PreemptionPVs/500Nodes
E0812 04:13:03.265419   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:13:03.267972   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionPVs/500Nodes-8                              	       1	41948766496 ns/op	10123134120 B/op	126988375 allocs/op
BenchmarkPerfScheduling/Unschedulable
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods
E0812 04:13:14.503747   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:13:14.506889   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods-8                  	       1	8997145881 ns/op	1674043464 B/op	20121573 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods
E0812 04:14:12.047853   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:14:12.051400   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods-8                 	       1	46266341769 ns/op	12831256184 B/op	161968634 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods
E0812 04:15:58.860318   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:15:58.863034   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods-8                	       1	95816924253 ns/op	38979966040 B/op	664445655 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes
E0812 04:16:11.734829   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:16:11.738444   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes-8                  	       1	9608598604 ns/op	1816270496 B/op	19213789 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes
E0812 04:16:46.055548   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:16:46.058419   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes-8                  	       1	23567090764 ns/op	4449437688 B/op	48623639 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes
E0812 04:19:28.155559   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:19:28.158418   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes-8         	       1	150891561841 ns/op	38520299648 B/op	335179121 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes
E0812 04:22:00.866034   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:22:00.869027   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes-8           	       1	140597229857 ns/op	23655007704 B/op	228049926 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes
E0812 04:24:36.887618   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:24:36.890957   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes-8             	       1	143879095297 ns/op	36024646872 B/op	337670223 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes
E0812 04:27:05.650757   36009 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0812 04:27:05.653560   36009 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes-8               	       1	137207399830 ns/op	18606081160 B/op	217068308 allocs/op
PASS
F0812 04:27:11.729170   36009 etcd.go:213] unexpected number of goroutines: before: 2 after 42
goroutine 1 [running]:
k8s.io/kubernetes/vendor/k8s.io/klog/v2/internal/dbg.Stacks(0x0)
... skipping 10 lines ...
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/framework/etcd.go:213 +0x345
k8s.io/kubernetes/test/integration/scheduler_perf.TestMain(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/scheduler_perf/main_test.go:26
main.main()
	_testmain.go:49 +0x1fc
exit status 255
FAIL	k8s.io/kubernetes/test/integration/scheduler_perf	2513.094s

DONE 0 tests, 1 failure in 0.003s
+++ [0812 04:27:12] prune-junit-xml not found; installing from hack/tools
processing junit xml file : /logs/artifacts/junit_20220812-034228.xml
done.
+++ [0812 04:27:12] Saved JUnit XML test report to /logs/artifacts/junit_20220812-034228.xml
make[1]: *** [Makefile:188: test] Error 1
!!! [0812 04:27:12] Call tree:
!!! [0812 04:27:12]  1: hack/make-rules/test-integration.sh:102 runTests(...)
+++ [0812 04:27:12] Cleaning up etcd
+++ [0812 04:27:13] Integration test cleanup complete
make: *** [Makefile:207: test-integration] Error 1