This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 0 succeeded
Started2022-08-13 05:43
Elapsed44m29s
Revisionmaster

Test Failures


k8s.io/kubernetes/test/integration/scheduler_perf TestMain 0.00s

go test -v k8s.io/kubernetes/test/integration/scheduler_perf -run TestMain$
goos: linux
goarch: amd64
pkg: k8s.io/kubernetes/test/integration/scheduler_perf
cpu: Intel(R) Xeon(R) CPU @ 2.30GHz
BenchmarkPerfScheduling
BenchmarkPerfScheduling/SchedulingBasic
BenchmarkPerfScheduling/SchedulingBasic/500Nodes
E0813 05:48:53.324893   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:48:53.327866   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/500Nodes-8         	       1	10727235638 ns/op	1808074600 B/op	18734752 allocs/op
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes
E0813 05:49:27.826696   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:49:27.829835   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes-8        	       1	23344301283 ns/op	4363418992 B/op	47356222 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes
E0813 05:49:39.268374   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:49:39.271023   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes-8         	       1	9275119928 ns/op	1151190488 B/op	11372809 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes
E0813 05:50:31.999420   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:50:32.002468   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes-8        	       1	41159135378 ns/op	9634035784 B/op	96804062 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes
E0813 05:50:44.517706   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:50:44.520712   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes-8                 	       1	10320570707 ns/op	2110028712 B/op	22596746 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes
E0813 05:51:49.285621   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:51:49.288392   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes-8                	       1	52462723285 ns/op	14430448792 B/op	155641265 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes
E0813 05:52:15.096938   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:52:15.101282   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes-8               	       1	23483705409 ns/op	5436956488 B/op	69061079 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes
E0813 05:55:11.741068   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:55:11.744032   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes-8              	       1	165164725311 ns/op	46979796640 B/op	532124949 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes
E0813 05:55:39.547569   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:55:39.550313   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes-8       	       1	25362716540 ns/op	7456201552 B/op	77701822 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes
E0813 05:58:32.412148   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:58:32.414988   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes-8      	       1	161137981283 ns/op	56302669352 B/op	554945423 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes
E0813 05:58:55.589765   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:58:55.592412   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes-8                  	       1	20607335092 ns/op	4052284176 B/op	53417980 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes
E0813 06:01:31.288671   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:01:31.291410   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes-8                 	       1	144124936826 ns/op	33094818968 B/op	389419885 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes
E0813 06:01:46.561772   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:01:46.564958   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes-8             	       1	12750160134 ns/op	2614780768 B/op	25748191 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes
E0813 06:03:31.325322   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:03:31.328535   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes-8            	       1	93497539036 ns/op	34331877320 B/op	314532242 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes
E0813 06:03:45.610112   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:03:45.612864   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes-8    	       1	11980226769 ns/op	2048934040 B/op	22040920 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes
E0813 06:05:01.302074   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:05:01.305074   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes-8   	       1	64135780545 ns/op	15770164712 B/op	182975561 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes
E0813 06:05:15.584414   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:05:15.587316   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes-8         	       1	11898532069 ns/op	2029701920 B/op	21820423 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes
E0813 06:06:30.789173   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:06:30.792059   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes-8        	       1	64047278120 ns/op	15734207920 B/op	182493135 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes
E0813 06:06:45.052483   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:06:45.055544   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes-8                     	       1	11921371368 ns/op	2037450664 B/op	21041040 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes
E0813 06:07:53.397427   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:07:53.400414   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes-8                    	       1	57029430660 ns/op	14027171968 B/op	146594410 allocs/op
BenchmarkPerfScheduling/TopologySpreading
BenchmarkPerfScheduling/TopologySpreading/500Nodes
E0813 06:08:08.879885   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:08:08.882629   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/500Nodes-8                          	       1	13098058366 ns/op	2683927840 B/op	27115715 allocs/op
BenchmarkPerfScheduling/TopologySpreading/5000Nodes
E0813 06:09:26.613653   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:09:26.616433   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/5000Nodes-8                         	       1	66464350612 ns/op	19715461664 B/op	188267492 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes
E0813 06:09:42.481097   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:09:42.483991   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes-8                 	       1	13554348420 ns/op	2471178416 B/op	26045797 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes
E0813 06:10:58.244541   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:10:58.247483   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes-8                	       1	64627632860 ns/op	15214245672 B/op	163519936 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes
E0813 06:11:13.551644   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:11:13.554406   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes-8                     	       1	12886256850 ns/op	2549438984 B/op	27615841 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes
E0813 06:13:12.519405   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:13:12.522535   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes-8                    	       1	107556288446 ns/op	32330388472 B/op	363664014 allocs/op
BenchmarkPerfScheduling/PreemptionBasic
BenchmarkPerfScheduling/PreemptionBasic/500Nodes
E0813 06:13:37.356775   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:13:37.360280   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionBasic/500Nodes-8                            	       1	22426235474 ns/op	5592522376 B/op	64016003 allocs/op
BenchmarkPerfScheduling/PreemptionPVs
BenchmarkPerfScheduling/PreemptionPVs/500Nodes
E0813 06:14:19.381171   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:14:19.383838   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionPVs/500Nodes-8                              	       1	39896687546 ns/op	10052304224 B/op	126484366 allocs/op
BenchmarkPerfScheduling/Unschedulable
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods
E0813 06:14:31.835322   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:14:31.837848   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods-8                  	       1	10252009534 ns/op	1696218280 B/op	20206715 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods
E0813 06:15:26.839992   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:15:26.842984   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods-8                 	       1	43593913720 ns/op	12764628488 B/op	161378626 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods
E0813 06:17:12.081333   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:17:12.085040   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods-8                	       1	94232977765 ns/op	38947104968 B/op	664853513 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes
E0813 06:17:25.399519   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:17:25.402055   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes-8                  	       1	10084420492 ns/op	1836454144 B/op	19507890 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes
E0813 06:17:59.134926   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:17:59.140118   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes-8                  	       1	22922657014 ns/op	4401932016 B/op	47935334 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes
E0813 06:20:42.688341   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:20:42.691049   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes-8         	       1	152094195483 ns/op	38534752088 B/op	335538187 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes
E0813 06:23:12.779941   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:23:12.782748   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes-8           	       1	138588314404 ns/op	23583094024 B/op	227359864 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes
E0813 06:25:46.618818   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:25:46.621741   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes-8             	       1	142145617994 ns/op	35944121992 B/op	336701216 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes
E0813 06:28:12.320954   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:28:12.323987   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes-8               	       1	134162706552 ns/op	18601540776 B/op	217364987 allocs/op
PASS
F0813 06:28:18.398663   35973 etcd.go:213] unexpected number of goroutines: before: 2 after 42
goroutine 1 [running]:
k8s.io/kubernetes/vendor/k8s.io/klog/v2/internal/dbg.Stacks(0x0)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/internal/dbg/dbg.go:35 +0x89
k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).output(0x7dd57c0, 0x3, 0x0, 0xc0222b11f0, 0x1, {0x6695d69?, 0x2?}, 0xc000600000?, 0x0)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:936 +0x686
k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).printfDepth(0x7dd57c0, 0xf?, 0x0, {0x0, 0x0}, 0xa0?, {0x4d4dd18, 0x34}, {0xc0455f4000, 0x2, ...})
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:737 +0x1f3
k8s.io/kubernetes/vendor/k8s.io/klog/v2.(*loggingT).printf(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:719
k8s.io/kubernetes/vendor/k8s.io/klog/v2.Fatalf(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/k8s.io/klog/v2/klog.go:1618
k8s.io/kubernetes/test/integration/framework.EtcdMain(0xc000d3ff60)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/framework/etcd.go:213 +0x345
k8s.io/kubernetes/test/integration/scheduler_perf.TestMain(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/scheduler_perf/main_test.go:26
main.main()
	_testmain.go:49 +0x1fc
exit status 255
FAIL	k8s.io/kubernetes/test/integration/scheduler_perf	2376.935s

				from junit_20220813-054553.xml

Find from mentions in log files | View test history on testgrid


Error lines from build-log.txt

... skipping 89 lines ...
BenchmarkPerfScheduling

BenchmarkPerfScheduling/SchedulingBasic

BenchmarkPerfScheduling/SchedulingBasic/500Nodes

E0813 05:48:53.324893   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 05:48:53.327866   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingBasic/500Nodes-8         	       1	10727235638 ns/op	1808074600 B/op	18734752 allocs/op

BenchmarkPerfScheduling/SchedulingBasic/5000Nodes

E0813 05:49:27.826696   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 05:49:27.829835   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingBasic/5000Nodes-8        	       1	23344301283 ns/op	4363418992 B/op	47356222 allocs/op

BenchmarkPerfScheduling/SchedulingPodAntiAffinity

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes

E0813 05:49:39.268374   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 05:49:39.271023   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes-8         	       1	9275119928 ns/op	1151190488 B/op	11372809 allocs/op

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes

E0813 05:50:31.999420   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 05:50:32.002468   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes-8        	       1	41159135378 ns/op	9634035784 B/op	96804062 allocs/op

BenchmarkPerfScheduling/SchedulingSecrets

BenchmarkPerfScheduling/SchedulingSecrets/500Nodes

E0813 05:50:44.517706   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 05:50:44.520712   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingSecrets/500Nodes-8                 	       1	10320570707 ns/op	2110028712 B/op	22596746 allocs/op

BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes

E0813 05:51:49.285621   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 05:51:49.288392   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes-8                	       1	52462723285 ns/op	14430448792 B/op	155641265 allocs/op

BenchmarkPerfScheduling/SchedulingInTreePVs

BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes

E0813 05:52:15.096938   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 05:52:15.101282   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes-8               	       1	23483705409 ns/op	5436956488 B/op	69061079 allocs/op

BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes

E0813 05:55:11.741068   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 05:55:11.744032   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes-8              	       1	165164725311 ns/op	46979796640 B/op	532124949 allocs/op

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes

E0813 05:55:39.547569   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 05:55:39.550313   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes-8       	       1	25362716540 ns/op	7456201552 B/op	77701822 allocs/op

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes

E0813 05:58:32.412148   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 05:58:32.414988   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes-8      	       1	161137981283 ns/op	56302669352 B/op	554945423 allocs/op

BenchmarkPerfScheduling/SchedulingCSIPVs

BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes

E0813 05:58:55.589765   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 05:58:55.592412   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes-8                  	       1	20607335092 ns/op	4052284176 B/op	53417980 allocs/op

BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes

E0813 06:01:31.288671   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:01:31.291410   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes-8                 	       1	144124936826 ns/op	33094818968 B/op	389419885 allocs/op

BenchmarkPerfScheduling/SchedulingPodAffinity

BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes

E0813 06:01:46.561772   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:01:46.564958   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes-8             	       1	12750160134 ns/op	2614780768 B/op	25748191 allocs/op

BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes

E0813 06:03:31.325322   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:03:31.328535   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes-8            	       1	93497539036 ns/op	34331877320 B/op	314532242 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes

E0813 06:03:45.610112   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:03:45.612864   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes-8    	       1	11980226769 ns/op	2048934040 B/op	22040920 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes

E0813 06:05:01.302074   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:05:01.305074   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes-8   	       1	64135780545 ns/op	15770164712 B/op	182975561 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes

E0813 06:05:15.584414   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:05:15.587316   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes-8         	       1	11898532069 ns/op	2029701920 B/op	21820423 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes

E0813 06:06:30.789173   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:06:30.792059   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes-8        	       1	64047278120 ns/op	15734207920 B/op	182493135 allocs/op

BenchmarkPerfScheduling/SchedulingNodeAffinity

BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes

E0813 06:06:45.052483   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:06:45.055544   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes-8                     	       1	11921371368 ns/op	2037450664 B/op	21041040 allocs/op

BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes

E0813 06:07:53.397427   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:07:53.400414   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes-8                    	       1	57029430660 ns/op	14027171968 B/op	146594410 allocs/op

BenchmarkPerfScheduling/TopologySpreading

BenchmarkPerfScheduling/TopologySpreading/500Nodes

E0813 06:08:08.879885   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:08:08.882629   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/TopologySpreading/500Nodes-8                          	       1	13098058366 ns/op	2683927840 B/op	27115715 allocs/op

BenchmarkPerfScheduling/TopologySpreading/5000Nodes

E0813 06:09:26.613653   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:09:26.616433   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/TopologySpreading/5000Nodes-8                         	       1	66464350612 ns/op	19715461664 B/op	188267492 allocs/op

BenchmarkPerfScheduling/PreferredTopologySpreading

BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes

E0813 06:09:42.481097   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:09:42.483991   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes-8                 	       1	13554348420 ns/op	2471178416 B/op	26045797 allocs/op

BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes

E0813 06:10:58.244541   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:10:58.247483   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes-8                	       1	64627632860 ns/op	15214245672 B/op	163519936 allocs/op

BenchmarkPerfScheduling/MixedSchedulingBasePod

BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes

E0813 06:11:13.551644   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:11:13.554406   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes-8                     	       1	12886256850 ns/op	2549438984 B/op	27615841 allocs/op

BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes

E0813 06:13:12.519405   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:13:12.522535   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes-8                    	       1	107556288446 ns/op	32330388472 B/op	363664014 allocs/op

BenchmarkPerfScheduling/PreemptionBasic

BenchmarkPerfScheduling/PreemptionBasic/500Nodes

E0813 06:13:37.356775   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:13:37.360280   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreemptionBasic/500Nodes-8                            	       1	22426235474 ns/op	5592522376 B/op	64016003 allocs/op

BenchmarkPerfScheduling/PreemptionPVs

BenchmarkPerfScheduling/PreemptionPVs/500Nodes

E0813 06:14:19.381171   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:14:19.383838   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/PreemptionPVs/500Nodes-8                              	       1	39896687546 ns/op	10052304224 B/op	126484366 allocs/op

BenchmarkPerfScheduling/Unschedulable

BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods

E0813 06:14:31.835322   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:14:31.837848   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods-8                  	       1	10252009534 ns/op	1696218280 B/op	20206715 allocs/op

BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods

E0813 06:15:26.839992   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:15:26.842984   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods-8                 	       1	43593913720 ns/op	12764628488 B/op	161378626 allocs/op

BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods

E0813 06:17:12.081333   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:17:12.085040   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods-8                	       1	94232977765 ns/op	38947104968 B/op	664853513 allocs/op

BenchmarkPerfScheduling/SchedulingWithMixedChurn

BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes

E0813 06:17:25.399519   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:17:25.402055   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes-8                  	       1	10084420492 ns/op	1836454144 B/op	19507890 allocs/op

BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes

E0813 06:17:59.134926   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:17:59.140118   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes-8                  	       1	22922657014 ns/op	4401932016 B/op	47935334 allocs/op

BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes

E0813 06:20:42.688341   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:20:42.691049   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes-8         	       1	152094195483 ns/op	38534752088 B/op	335538187 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes

E0813 06:23:12.779941   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:23:12.782748   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes-8           	       1	138588314404 ns/op	23583094024 B/op	227359864 allocs/op

BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes

E0813 06:25:46.618818   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:25:46.621741   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes-8             	       1	142145617994 ns/op	35944121992 B/op	336701216 allocs/op

BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector

BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes

E0813 06:28:12.320954   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"

E0813 06:28:12.323987   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service

BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes-8               	       1	134162706552 ns/op	18601540776 B/op	217364987 allocs/op

PASS
... skipping 33 lines ...
main.main()

	_testmain.go:49 +0x1fc

exit status 255

FAIL	k8s.io/kubernetes/test/integration/scheduler_perf	2376.935s


✖  test/integration/scheduler_perf (39m36.936s)

=== Failed
=== FAIL: test/integration/scheduler_perf  (0.00s)
goos: linux
goarch: amd64
pkg: k8s.io/kubernetes/test/integration/scheduler_perf
cpu: Intel(R) Xeon(R) CPU @ 2.30GHz
BenchmarkPerfScheduling
BenchmarkPerfScheduling/SchedulingBasic
BenchmarkPerfScheduling/SchedulingBasic/500Nodes
E0813 05:48:53.324893   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:48:53.327866   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/500Nodes-8         	       1	10727235638 ns/op	1808074600 B/op	18734752 allocs/op
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes
E0813 05:49:27.826696   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:49:27.829835   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingBasic/5000Nodes-8        	       1	23344301283 ns/op	4363418992 B/op	47356222 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes
E0813 05:49:39.268374   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:49:39.271023   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/500Nodes-8         	       1	9275119928 ns/op	1151190488 B/op	11372809 allocs/op
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes
E0813 05:50:31.999420   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:50:32.002468   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAntiAffinity/5000Nodes-8        	       1	41159135378 ns/op	9634035784 B/op	96804062 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes
E0813 05:50:44.517706   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:50:44.520712   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/500Nodes-8                 	       1	10320570707 ns/op	2110028712 B/op	22596746 allocs/op
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes
E0813 05:51:49.285621   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:51:49.288392   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingSecrets/5000Nodes-8                	       1	52462723285 ns/op	14430448792 B/op	155641265 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes
E0813 05:52:15.096938   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:52:15.101282   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/500Nodes-8               	       1	23483705409 ns/op	5436956488 B/op	69061079 allocs/op
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes
E0813 05:55:11.741068   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:55:11.744032   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingInTreePVs/5000Nodes-8              	       1	165164725311 ns/op	46979796640 B/op	532124949 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes
E0813 05:55:39.547569   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:55:39.550313   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/500Nodes-8       	       1	25362716540 ns/op	7456201552 B/op	77701822 allocs/op
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes
E0813 05:58:32.412148   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:58:32.414988   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingMigratedInTreePVs/5000Nodes-8      	       1	161137981283 ns/op	56302669352 B/op	554945423 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes
E0813 05:58:55.589765   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 05:58:55.592412   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/500Nodes-8                  	       1	20607335092 ns/op	4052284176 B/op	53417980 allocs/op
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes
E0813 06:01:31.288671   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:01:31.291410   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingCSIPVs/5000Nodes-8                 	       1	144124936826 ns/op	33094818968 B/op	389419885 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes
E0813 06:01:46.561772   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:01:46.564958   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/500Nodes-8             	       1	12750160134 ns/op	2614780768 B/op	25748191 allocs/op
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes
E0813 06:03:31.325322   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:03:31.328535   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPodAffinity/5000Nodes-8            	       1	93497539036 ns/op	34331877320 B/op	314532242 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes
E0813 06:03:45.610112   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:03:45.612864   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/500Nodes-8    	       1	11980226769 ns/op	2048934040 B/op	22040920 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes
E0813 06:05:01.302074   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:05:01.305074   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAffinity/5000Nodes-8   	       1	64135780545 ns/op	15770164712 B/op	182975561 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes
E0813 06:05:15.584414   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:05:15.587316   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/500Nodes-8         	       1	11898532069 ns/op	2029701920 B/op	21820423 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes
E0813 06:06:30.789173   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:06:30.792059   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredPodAntiAffinity/5000Nodes-8        	       1	64047278120 ns/op	15734207920 B/op	182493135 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes
E0813 06:06:45.052483   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:06:45.055544   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/500Nodes-8                     	       1	11921371368 ns/op	2037450664 B/op	21041040 allocs/op
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes
E0813 06:07:53.397427   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:07:53.400414   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingNodeAffinity/5000Nodes-8                    	       1	57029430660 ns/op	14027171968 B/op	146594410 allocs/op
BenchmarkPerfScheduling/TopologySpreading
BenchmarkPerfScheduling/TopologySpreading/500Nodes
E0813 06:08:08.879885   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:08:08.882629   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/500Nodes-8                          	       1	13098058366 ns/op	2683927840 B/op	27115715 allocs/op
BenchmarkPerfScheduling/TopologySpreading/5000Nodes
E0813 06:09:26.613653   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:09:26.616433   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/TopologySpreading/5000Nodes-8                         	       1	66464350612 ns/op	19715461664 B/op	188267492 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes
E0813 06:09:42.481097   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:09:42.483991   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/500Nodes-8                 	       1	13554348420 ns/op	2471178416 B/op	26045797 allocs/op
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes
E0813 06:10:58.244541   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:10:58.247483   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreferredTopologySpreading/5000Nodes-8                	       1	64627632860 ns/op	15214245672 B/op	163519936 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes
E0813 06:11:13.551644   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:11:13.554406   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/500Nodes-8                     	       1	12886256850 ns/op	2549438984 B/op	27615841 allocs/op
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes
E0813 06:13:12.519405   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:13:12.522535   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/MixedSchedulingBasePod/5000Nodes-8                    	       1	107556288446 ns/op	32330388472 B/op	363664014 allocs/op
BenchmarkPerfScheduling/PreemptionBasic
BenchmarkPerfScheduling/PreemptionBasic/500Nodes
E0813 06:13:37.356775   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:13:37.360280   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionBasic/500Nodes-8                            	       1	22426235474 ns/op	5592522376 B/op	64016003 allocs/op
BenchmarkPerfScheduling/PreemptionPVs
BenchmarkPerfScheduling/PreemptionPVs/500Nodes
E0813 06:14:19.381171   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:14:19.383838   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/PreemptionPVs/500Nodes-8                              	       1	39896687546 ns/op	10052304224 B/op	126484366 allocs/op
BenchmarkPerfScheduling/Unschedulable
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods
E0813 06:14:31.835322   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:14:31.837848   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/500Nodes/200InitPods-8                  	       1	10252009534 ns/op	1696218280 B/op	20206715 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods
E0813 06:15:26.839992   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:15:26.842984   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/200InitPods-8                 	       1	43593913720 ns/op	12764628488 B/op	161378626 allocs/op
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods
E0813 06:17:12.081333   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:17:12.085040   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/Unschedulable/5000Nodes/2000InitPods-8                	       1	94232977765 ns/op	38947104968 B/op	664853513 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes
E0813 06:17:25.399519   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:17:25.402055   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/1000Nodes-8                  	       1	10084420492 ns/op	1836454144 B/op	19507890 allocs/op
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes
E0813 06:17:59.134926   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:17:59.140118   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingWithMixedChurn/5000Nodes-8                  	       1	22922657014 ns/op	4401932016 B/op	47935334 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes
E0813 06:20:42.688341   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:20:42.691049   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAntiAffinityWithNSSelector/5000Nodes-8         	       1	152094195483 ns/op	38534752088 B/op	335538187 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes
E0813 06:23:12.779941   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:23:12.782748   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAntiAffinityWithNSSelector/5000Nodes-8           	       1	138588314404 ns/op	23583094024 B/op	227359864 allocs/op
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes
E0813 06:25:46.618818   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:25:46.621741   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingRequiredPodAffinityWithNSSelector/5000Nodes-8             	       1	142145617994 ns/op	35944121992 B/op	336701216 allocs/op
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes
E0813 06:28:12.320954   35973 scheduling_queue.go:963] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0813 06:28:12.323987   35973 controller.go:214] Unable to remove endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
BenchmarkPerfScheduling/SchedulingPreferredAffinityWithNSSelector/5000Nodes-8               	       1	134162706552 ns/op	18601540776 B/op	217364987 allocs/op
PASS
F0813 06:28:18.398663   35973 etcd.go:213] unexpected number of goroutines: before: 2 after 42
goroutine 1 [running]:
k8s.io/kubernetes/vendor/k8s.io/klog/v2/internal/dbg.Stacks(0x0)
... skipping 10 lines ...
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/framework/etcd.go:213 +0x345
k8s.io/kubernetes/test/integration/scheduler_perf.TestMain(...)
	/home/prow/go/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/integration/scheduler_perf/main_test.go:26
main.main()
	_testmain.go:49 +0x1fc
exit status 255
FAIL	k8s.io/kubernetes/test/integration/scheduler_perf	2376.935s

DONE 0 tests, 1 failure in 0.002s
+++ [0813 06:28:18] prune-junit-xml not found; installing from hack/tools
processing junit xml file : /logs/artifacts/junit_20220813-054553.xml
done.
+++ [0813 06:28:19] Saved JUnit XML test report to /logs/artifacts/junit_20220813-054553.xml
make[1]: *** [Makefile:188: test] Error 1
!!! [0813 06:28:19] Call tree:
!!! [0813 06:28:19]  1: hack/make-rules/test-integration.sh:102 runTests(...)
+++ [0813 06:28:19] Cleaning up etcd
+++ [0813 06:28:19] Integration test cleanup complete
make: *** [Makefile:207: test-integration] Error 1