Recent runs || View in Spyglass
PR | mimowo: Design for all-or-nothing semantics for workload resource assignment |
Result | ABORTED |
Tests | 0 failed / 36 succeeded |
Started | |
Elapsed | 2m55s |
Revision | 9ea30375e712d5044fa45e631decf5407ea2e750 |
Refs |
433 |
Core Controllers Suite [AfterSuite]
Core Controllers Suite [AfterSuite]
Core Controllers Suite [BeforeSuite]
Core Controllers Suite [BeforeSuite]
Core Controllers Suite [It] ClusterQueue controller when Deleting clusterQueues Should be stuck in termination until admitted workloads finished running
Core Controllers Suite [It] ClusterQueue controller when Deleting clusterQueues Should be stuck in termination until admitted workloads finished running
Core Controllers Suite [It] ClusterQueue controller when Deleting clusterQueues Should delete clusterQueues successfully when no admitted workloads are running
Core Controllers Suite [It] ClusterQueue controller when Deleting clusterQueues Should delete clusterQueues successfully when no admitted workloads are running
Core Controllers Suite [It] ClusterQueue controller when Reconciling clusterQueue status Should update status when workloads are assigned and finish
Core Controllers Suite [It] ClusterQueue controller when Reconciling clusterQueue status Should update status when workloads are assigned and finish
Core Controllers Suite [It] Queue controller Should update status when workloads are created
Core Controllers Suite [It] Queue controller Should update status when workloads are created
Core Controllers Suite [It] ResourceFlavor controller when one clusterQueue references resourceFlavors Should delete the resourceFlavor when the corresponding clusterQueue is deleted
Core Controllers Suite [It] ResourceFlavor controller when one clusterQueue references resourceFlavors Should delete the resourceFlavor when the corresponding clusterQueue is deleted
Core Controllers Suite [It] ResourceFlavor controller when one clusterQueue references resourceFlavors Should delete the resourceFlavor when the corresponding clusterQueue no longer uses the resourceFlavor
Core Controllers Suite [It] ResourceFlavor controller when one clusterQueue references resourceFlavors Should delete the resourceFlavor when the corresponding clusterQueue no longer uses the resourceFlavor
Core Controllers Suite [It] Workload controller when Workload with RuntimeClass defined Should accumulate RuntimeClass's overhead
Core Controllers Suite [It] Workload controller when Workload with RuntimeClass defined Should accumulate RuntimeClass's overhead
Core Controllers Suite [It] Workload controller when Workload with non-existent RuntimeClass defined Should not accumulate RuntimeClass's overhead
Core Controllers Suite [It] Workload controller when Workload with non-existent RuntimeClass defined Should not accumulate RuntimeClass's overhead
Core Controllers Suite [It] Workload controller when the clusterqueue doesn't exist Should update status when workloads are created
Core Controllers Suite [It] Workload controller when the clusterqueue doesn't exist Should update status when workloads are created
Core Controllers Suite [It] Workload controller when the queue doesn't exist Should update status when workloads are created
Core Controllers Suite [It] Workload controller when the queue doesn't exist Should update status when workloads are created
Core Controllers Suite [It] Workload controller when the queue is not defined in the workload Should update status when workloads are created
Core Controllers Suite [It] Workload controller when the queue is not defined in the workload Should update status when workloads are created
Core Controllers Suite [It] Workload controller when the workload is admitted Should update the workload's condition
Core Controllers Suite [It] Workload controller when the workload is admitted Should update the workload's condition
Job Controller Suite [It] Job Webhook when With manageJobsWithoutQueueName enabled Should not update unsuspend Job successfully when adding queue name
Job Controller Suite [It] Job Webhook when With manageJobsWithoutQueueName enabled Should suspend a Job even no queue name specified
Job Controller Suite [It] Job Webhook when with manageJobsWithoutQueueName disabled should not suspend a Job when no queue name specified
Job Controller Suite [It] Job Webhook when with manageJobsWithoutQueueName disabled should not update unsuspend Job successfully when changing queue name
Job Controller Suite [It] Job Webhook when with manageJobsWithoutQueueName disabled should suspend a Job when created in unsuspend state
Job Controller Suite [It] Job controller Should reconcile workload and job for all jobs
Job Controller Suite [It] Job controller for workloads with no queue set Should reconcile jobs only when queue is set
Job Controller Suite [It] Job controller interacting with scheduler Should schedule jobs as they fit in their ClusterQueue
... skipping 608 lines ... 2022-11-25T13:27:25.266250343Z DEBUG controller-runtime.webhook.webhooks admission/http.go:96 received request {"webhook": "/mutate-kueue-x-k8s-io-v1alpha2-workload", "UID": "c9dca8a4-f819-48a4-a7ed-160a0fb8f3f1", "kind": "kueue.x-k8s.io/v1alpha2, Kind=Workload", "resource": {"group":"kueue.x-k8s.io","version":"v1alpha2","resource":"workloads"}} 2022-11-25T13:27:25.266631157Z DEBUG controller-runtime.webhook.webhooks admission/http.go:143 wrote response {"webhook": "/mutate-kueue-x-k8s-io-v1alpha2-workload", "code": 200, "reason": "", "UID": "c9dca8a4-f819-48a4-a7ed-160a0fb8f3f1", "allowed": true} 2022-11-25T13:27:25.268455348Z DEBUG controller-runtime.webhook.webhooks admission/http.go:96 received request {"webhook": "/validate-kueue-x-k8s-io-v1alpha2-workload", "UID": "9f412d46-422f-4444-816d-6976c5378dfb", "kind": "kueue.x-k8s.io/v1alpha2, Kind=Workload", "resource": {"group":"kueue.x-k8s.io","version":"v1alpha2","resource":"workloads"}} 2022-11-25T13:27:25.268664023Z DEBUG controller-runtime.webhook.webhooks admission/http.go:143 wrote response {"webhook": "/validate-kueue-x-k8s-io-v1alpha2-workload", "code": 200, "reason": "", "UID": "9f412d46-422f-4444-816d-6976c5378dfb", "allowed": true} 2022-11-25T13:27:25.271568796Z LEVEL(-2) workload-reconciler core/workload_controller.go:119 Workload create event {"workload": {"name":"one","namespace":"core-workload-ffsr2"}, "queue": "queue", "status": "admitted"} [1mSTEP:[0m Got ClusterQueueStatus [38;5;243m11/25/22 13:27:25.271[0m 2022-11-25T13:27:25.271639802Z ERROR workload-reconciler core/workload_controller.go:287 Could not get RuntimeClass {"error": "RuntimeClass.node.k8s.io \"kata\" not found"} sigs.k8s.io/kueue/pkg/controller/core.handlePodOverhead /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:287 sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Create /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:126 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnAdd /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:57 ... skipping 12 lines ... k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:73 2022-11-25T13:27:25.271749002Z LEVEL(-2) core/workload_controller.go:82 Reconciling Workload {"controller": "workload", "controllerGroup": "kueue.x-k8s.io", "controllerKind": "Workload", "workload": {"name":"one","namespace":"core-workload-ffsr2"}, "namespace": "core-workload-ffsr2", "name": "one", "reconcileID": "02d2d58c-1635-4979-85bb-1cf25ac8880b", "workload": {"name":"one","namespace":"core-workload-ffsr2"}} 2022-11-25T13:27:25.271772902Z LEVEL(-3) localqueue-reconciler core/localqueue_controller.go:144 Got Workload event {"workload": {"name":"one","namespace":"core-workload-ffsr2"}} 2022-11-25T13:27:25.271852036Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"one","namespace":"core-workload-ffsr2"}} 2022-11-25T13:27:25.277321609Z LEVEL(-2) workload-reconciler core/workload_controller.go:198 Workload update event {"workload": {"name":"one","namespace":"core-workload-ffsr2"}, "queue": "queue", "status": "admitted", "clusterQueue": "clusterqueue"} 2022-11-25T13:27:25.277406426Z ERROR workload-reconciler core/workload_controller.go:287 Could not get RuntimeClass {"error": "RuntimeClass.node.k8s.io \"kata\" not found"} sigs.k8s.io/kueue/pkg/controller/core.handlePodOverhead /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:287 sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Update /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:202 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnUpdate /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:88 ... skipping 55 lines ... 2022-11-25T13:27:25.266250343Z DEBUG controller-runtime.webhook.webhooks admission/http.go:96 received request {"webhook": "/mutate-kueue-x-k8s-io-v1alpha2-workload", "UID": "c9dca8a4-f819-48a4-a7ed-160a0fb8f3f1", "kind": "kueue.x-k8s.io/v1alpha2, Kind=Workload", "resource": {"group":"kueue.x-k8s.io","version":"v1alpha2","resource":"workloads"}} 2022-11-25T13:27:25.266631157Z DEBUG controller-runtime.webhook.webhooks admission/http.go:143 wrote response {"webhook": "/mutate-kueue-x-k8s-io-v1alpha2-workload", "code": 200, "reason": "", "UID": "c9dca8a4-f819-48a4-a7ed-160a0fb8f3f1", "allowed": true} 2022-11-25T13:27:25.268455348Z DEBUG controller-runtime.webhook.webhooks admission/http.go:96 received request {"webhook": "/validate-kueue-x-k8s-io-v1alpha2-workload", "UID": "9f412d46-422f-4444-816d-6976c5378dfb", "kind": "kueue.x-k8s.io/v1alpha2, Kind=Workload", "resource": {"group":"kueue.x-k8s.io","version":"v1alpha2","resource":"workloads"}} 2022-11-25T13:27:25.268664023Z DEBUG controller-runtime.webhook.webhooks admission/http.go:143 wrote response {"webhook": "/validate-kueue-x-k8s-io-v1alpha2-workload", "code": 200, "reason": "", "UID": "9f412d46-422f-4444-816d-6976c5378dfb", "allowed": true} 2022-11-25T13:27:25.271568796Z LEVEL(-2) workload-reconciler core/workload_controller.go:119 Workload create event {"workload": {"name":"one","namespace":"core-workload-ffsr2"}, "queue": "queue", "status": "admitted"} [1mSTEP:[0m Got ClusterQueueStatus [38;5;243m11/25/22 13:27:25.271[0m 2022-11-25T13:27:25.271639802Z ERROR workload-reconciler core/workload_controller.go:287 Could not get RuntimeClass {"error": "RuntimeClass.node.k8s.io \"kata\" not found"} sigs.k8s.io/kueue/pkg/controller/core.handlePodOverhead /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:287 sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Create /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:126 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnAdd /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:57 ... skipping 12 lines ... k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:73 2022-11-25T13:27:25.271749002Z LEVEL(-2) core/workload_controller.go:82 Reconciling Workload {"controller": "workload", "controllerGroup": "kueue.x-k8s.io", "controllerKind": "Workload", "workload": {"name":"one","namespace":"core-workload-ffsr2"}, "namespace": "core-workload-ffsr2", "name": "one", "reconcileID": "02d2d58c-1635-4979-85bb-1cf25ac8880b", "workload": {"name":"one","namespace":"core-workload-ffsr2"}} 2022-11-25T13:27:25.271772902Z LEVEL(-3) localqueue-reconciler core/localqueue_controller.go:144 Got Workload event {"workload": {"name":"one","namespace":"core-workload-ffsr2"}} 2022-11-25T13:27:25.271852036Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"one","namespace":"core-workload-ffsr2"}} 2022-11-25T13:27:25.277321609Z LEVEL(-2) workload-reconciler core/workload_controller.go:198 Workload update event {"workload": {"name":"one","namespace":"core-workload-ffsr2"}, "queue": "queue", "status": "admitted", "clusterQueue": "clusterqueue"} 2022-11-25T13:27:25.277406426Z ERROR workload-reconciler core/workload_controller.go:287 Could not get RuntimeClass {"error": "RuntimeClass.node.k8s.io \"kata\" not found"} sigs.k8s.io/kueue/pkg/controller/core.handlePodOverhead /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:287 sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Update /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:202 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnUpdate /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:88 ... skipping 684 lines ... 2022-11-25T13:27:31.235167254Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:31.235203248Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:31.235332048Z LEVEL(-2) core/workload_controller.go:82 Reconciling Workload {"controller": "workload", "controllerGroup": "kueue.x-k8s.io", "controllerKind": "Workload", "workload": {"name":"five","namespace":"core-clusterqueue-m994d"}, "namespace": "core-clusterqueue-m994d", "name": "five", "reconcileID": "284a6f17-c83e-448d-8d7c-3a34785e2c91", "workload": {"name":"five","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:31.239752076Z DEBUG controller-runtime.webhook.webhooks admission/http.go:96 received request {"webhook": "/mutate-kueue-x-k8s-io-v1alpha2-workload", "UID": "53d9311e-e250-421d-90c4-2a7c76ac7f8a", "kind": "kueue.x-k8s.io/v1alpha2, Kind=Workload", "resource": {"group":"kueue.x-k8s.io","version":"v1alpha2","resource":"workloads"}} 2022-11-25T13:27:31.240189704Z DEBUG controller-runtime.webhook.webhooks admission/http.go:143 wrote response {"webhook": "/mutate-kueue-x-k8s-io-v1alpha2-workload", "code": 200, "reason": "", "UID": "53d9311e-e250-421d-90c4-2a7c76ac7f8a", "allowed": true} 2022-11-25T13:27:31.242202357Z LEVEL(-2) workload-reconciler core/workload_controller.go:198 Workload update event {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}, "queue": "other", "status": "admitted", "clusterQueue": "other"} 2022-11-25T13:27:31.242257516Z ERROR workload-reconciler core/workload_controller.go:240 Updating workload in cache {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}, "queue": "other", "status": "admitted", "clusterQueue": "other", "error": "old ClusterQueue doesn't exist"} sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Update /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:240 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnUpdate /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:88 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:816 ... skipping 45 lines ... 2022-11-25T13:27:32.307925822Z LEVEL(-2) core/workload_controller.go:82 Reconciling Workload {"controller": "workload", "controllerGroup": "kueue.x-k8s.io", "controllerKind": "Workload", "workload": {"name":"four","namespace":"core-clusterqueue-m994d"}, "namespace": "core-clusterqueue-m994d", "name": "four", "reconcileID": "ebcfd05b-5e92-4b4f-885b-c5ff8c748c43", "workload": {"name":"four","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:32.307953604Z LEVEL(-3) localqueue-reconciler core/localqueue_controller.go:144 Got Workload event {"workload": {"name":"four","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:32.307967966Z LEVEL(-3) localqueue-reconciler core/localqueue_controller.go:144 Got Workload event {"workload": {"name":"four","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:32.307987247Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"four","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:32.307999045Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"four","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:32.31633172Z LEVEL(-2) workload-reconciler core/workload_controller.go:198 Workload update event {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}, "queue": "other", "status": "finished", "prevStatus": "admitted", "clusterQueue": "other"} 2022-11-25T13:27:32.316429642Z ERROR workload-reconciler core/workload_controller.go:207 Failed to delete workload from cache {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}, "queue": "other", "status": "finished", "prevStatus": "admitted", "clusterQueue": "other", "error": "cluster queue not found"} sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Update /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:207 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnUpdate /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:88 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:816 ... skipping 31 lines ... 2022-11-25T13:27:33.360423129Z DEBUG controller-runtime.webhook.webhooks admission/http.go:96 received request {"webhook": "/validate-kueue-x-k8s-io-v1alpha2-clusterqueue", "UID": "a8ded321-b649-46d5-b29e-41a98fb3f9b4", "kind": "kueue.x-k8s.io/v1alpha2, Kind=ClusterQueue", "resource": {"group":"kueue.x-k8s.io","version":"v1alpha2","resource":"clusterqueues"}} 2022-11-25T13:27:33.360975618Z DEBUG controller-runtime.webhook.webhooks admission/http.go:143 wrote response {"webhook": "/validate-kueue-x-k8s-io-v1alpha2-clusterqueue", "code": 200, "reason": "", "UID": "a8ded321-b649-46d5-b29e-41a98fb3f9b4", "allowed": true} 2022-11-25T13:27:33.363147784Z LEVEL(-2) localqueue-reconciler core/localqueue_controller.go:119 LocalQueue delete event {"localQueue": {"name":"queue","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.366211246Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:165 ClusterQueue delete event {"clusterQueue": {"name":"cluster-queue"}} 2022-11-25T13:27:33.366562976Z LEVEL(-2) resourceflavor-reconciler core/resourceflavor_controller.go:156 Got generic event {"obj": {"name":"cluster-queue"}, "kind": "/, Kind="} 2022-11-25T13:27:33.370873764Z LEVEL(-2) workload-reconciler core/workload_controller.go:149 Workload delete event {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}, "queue": "other", "status": "finished"} 2022-11-25T13:27:33.370933293Z ERROR workload-reconciler core/workload_controller.go:158 Failed to delete workload from cache {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}, "queue": "other", "status": "finished", "error": "cluster queue not found"} sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Delete /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:158 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnDelete /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:131 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:820 ... skipping 9 lines ... /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:812 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:73 2022-11-25T13:27:33.37105139Z LEVEL(-3) localqueue-reconciler core/localqueue_controller.go:144 Got Workload event {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.371093773Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.372918598Z LEVEL(-2) workload-reconciler core/workload_controller.go:149 Workload delete event {"workload": {"name":"four","namespace":"core-clusterqueue-m994d"}, "queue": "queue", "status": "finished"} 2022-11-25T13:27:33.37297514Z ERROR workload-reconciler core/workload_controller.go:158 Failed to delete workload from cache {"workload": {"name":"four","namespace":"core-clusterqueue-m994d"}, "queue": "queue", "status": "finished", "error": "cluster queue not found"} sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Delete /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:158 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnDelete /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:131 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:820 ... skipping 9 lines ... /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:812 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:73 2022-11-25T13:27:33.373361298Z LEVEL(-3) localqueue-reconciler core/localqueue_controller.go:144 Got Workload event {"workload": {"name":"four","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.373473123Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"four","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.375710319Z LEVEL(-2) workload-reconciler core/workload_controller.go:149 Workload delete event {"workload": {"name":"one","namespace":"core-clusterqueue-m994d"}, "queue": "queue", "status": "finished"} 2022-11-25T13:27:33.375849167Z ERROR workload-reconciler core/workload_controller.go:158 Failed to delete workload from cache {"workload": {"name":"one","namespace":"core-clusterqueue-m994d"}, "queue": "queue", "status": "finished", "error": "cluster queue not found"} sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Delete /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:158 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnDelete /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:131 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:820 ... skipping 12 lines ... 2022-11-25T13:27:33.3760206Z LEVEL(-3) localqueue-reconciler core/localqueue_controller.go:144 Got Workload event {"workload": {"name":"one","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.376062555Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"one","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.377867629Z LEVEL(-2) workload-reconciler core/workload_controller.go:149 Workload delete event {"workload": {"name":"six","namespace":"core-clusterqueue-m994d"}, "queue": "queue", "status": "finished"} 2022-11-25T13:27:33.377972586Z LEVEL(-3) localqueue-reconciler core/localqueue_controller.go:144 Got Workload event {"workload": {"name":"six","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.378005863Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"six","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.380996214Z LEVEL(-2) workload-reconciler core/workload_controller.go:149 Workload delete event {"workload": {"name":"three","namespace":"core-clusterqueue-m994d"}, "queue": "queue", "status": "finished"} 2022-11-25T13:27:33.381048394Z ERROR workload-reconciler core/workload_controller.go:158 Failed to delete workload from cache {"workload": {"name":"three","namespace":"core-clusterqueue-m994d"}, "queue": "queue", "status": "finished", "error": "cluster queue not found"} sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Delete /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:158 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnDelete /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:131 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:820 ... skipping 9 lines ... /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:812 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:73 2022-11-25T13:27:33.381157304Z LEVEL(-3) localqueue-reconciler core/localqueue_controller.go:144 Got Workload event {"workload": {"name":"three","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.381190128Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"three","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.384335128Z LEVEL(-2) workload-reconciler core/workload_controller.go:149 Workload delete event {"workload": {"name":"two","namespace":"core-clusterqueue-m994d"}, "queue": "queue", "status": "finished"} 2022-11-25T13:27:33.384385328Z ERROR workload-reconciler core/workload_controller.go:158 Failed to delete workload from cache {"workload": {"name":"two","namespace":"core-clusterqueue-m994d"}, "queue": "queue", "status": "finished", "error": "cluster queue not found"} sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Delete /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:158 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnDelete /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:131 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:820 ... skipping 208 lines ... 2022-11-25T13:27:31.235167254Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:31.235203248Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:31.235332048Z LEVEL(-2) core/workload_controller.go:82 Reconciling Workload {"controller": "workload", "controllerGroup": "kueue.x-k8s.io", "controllerKind": "Workload", "workload": {"name":"five","namespace":"core-clusterqueue-m994d"}, "namespace": "core-clusterqueue-m994d", "name": "five", "reconcileID": "284a6f17-c83e-448d-8d7c-3a34785e2c91", "workload": {"name":"five","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:31.239752076Z DEBUG controller-runtime.webhook.webhooks admission/http.go:96 received request {"webhook": "/mutate-kueue-x-k8s-io-v1alpha2-workload", "UID": "53d9311e-e250-421d-90c4-2a7c76ac7f8a", "kind": "kueue.x-k8s.io/v1alpha2, Kind=Workload", "resource": {"group":"kueue.x-k8s.io","version":"v1alpha2","resource":"workloads"}} 2022-11-25T13:27:31.240189704Z DEBUG controller-runtime.webhook.webhooks admission/http.go:143 wrote response {"webhook": "/mutate-kueue-x-k8s-io-v1alpha2-workload", "code": 200, "reason": "", "UID": "53d9311e-e250-421d-90c4-2a7c76ac7f8a", "allowed": true} 2022-11-25T13:27:31.242202357Z LEVEL(-2) workload-reconciler core/workload_controller.go:198 Workload update event {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}, "queue": "other", "status": "admitted", "clusterQueue": "other"} 2022-11-25T13:27:31.242257516Z ERROR workload-reconciler core/workload_controller.go:240 Updating workload in cache {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}, "queue": "other", "status": "admitted", "clusterQueue": "other", "error": "old ClusterQueue doesn't exist"} sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Update /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:240 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnUpdate /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:88 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:816 ... skipping 45 lines ... 2022-11-25T13:27:32.307925822Z LEVEL(-2) core/workload_controller.go:82 Reconciling Workload {"controller": "workload", "controllerGroup": "kueue.x-k8s.io", "controllerKind": "Workload", "workload": {"name":"four","namespace":"core-clusterqueue-m994d"}, "namespace": "core-clusterqueue-m994d", "name": "four", "reconcileID": "ebcfd05b-5e92-4b4f-885b-c5ff8c748c43", "workload": {"name":"four","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:32.307953604Z LEVEL(-3) localqueue-reconciler core/localqueue_controller.go:144 Got Workload event {"workload": {"name":"four","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:32.307967966Z LEVEL(-3) localqueue-reconciler core/localqueue_controller.go:144 Got Workload event {"workload": {"name":"four","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:32.307987247Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"four","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:32.307999045Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"four","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:32.31633172Z LEVEL(-2) workload-reconciler core/workload_controller.go:198 Workload update event {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}, "queue": "other", "status": "finished", "prevStatus": "admitted", "clusterQueue": "other"} 2022-11-25T13:27:32.316429642Z ERROR workload-reconciler core/workload_controller.go:207 Failed to delete workload from cache {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}, "queue": "other", "status": "finished", "prevStatus": "admitted", "clusterQueue": "other", "error": "cluster queue not found"} sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Update /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:207 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnUpdate /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:88 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:816 ... skipping 31 lines ... 2022-11-25T13:27:33.360423129Z DEBUG controller-runtime.webhook.webhooks admission/http.go:96 received request {"webhook": "/validate-kueue-x-k8s-io-v1alpha2-clusterqueue", "UID": "a8ded321-b649-46d5-b29e-41a98fb3f9b4", "kind": "kueue.x-k8s.io/v1alpha2, Kind=ClusterQueue", "resource": {"group":"kueue.x-k8s.io","version":"v1alpha2","resource":"clusterqueues"}} 2022-11-25T13:27:33.360975618Z DEBUG controller-runtime.webhook.webhooks admission/http.go:143 wrote response {"webhook": "/validate-kueue-x-k8s-io-v1alpha2-clusterqueue", "code": 200, "reason": "", "UID": "a8ded321-b649-46d5-b29e-41a98fb3f9b4", "allowed": true} 2022-11-25T13:27:33.363147784Z LEVEL(-2) localqueue-reconciler core/localqueue_controller.go:119 LocalQueue delete event {"localQueue": {"name":"queue","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.366211246Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:165 ClusterQueue delete event {"clusterQueue": {"name":"cluster-queue"}} 2022-11-25T13:27:33.366562976Z LEVEL(-2) resourceflavor-reconciler core/resourceflavor_controller.go:156 Got generic event {"obj": {"name":"cluster-queue"}, "kind": "/, Kind="} 2022-11-25T13:27:33.370873764Z LEVEL(-2) workload-reconciler core/workload_controller.go:149 Workload delete event {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}, "queue": "other", "status": "finished"} 2022-11-25T13:27:33.370933293Z ERROR workload-reconciler core/workload_controller.go:158 Failed to delete workload from cache {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}, "queue": "other", "status": "finished", "error": "cluster queue not found"} sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Delete /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:158 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnDelete /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:131 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:820 ... skipping 9 lines ... /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:812 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:73 2022-11-25T13:27:33.37105139Z LEVEL(-3) localqueue-reconciler core/localqueue_controller.go:144 Got Workload event {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.371093773Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"five","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.372918598Z LEVEL(-2) workload-reconciler core/workload_controller.go:149 Workload delete event {"workload": {"name":"four","namespace":"core-clusterqueue-m994d"}, "queue": "queue", "status": "finished"} 2022-11-25T13:27:33.37297514Z ERROR workload-reconciler core/workload_controller.go:158 Failed to delete workload from cache {"workload": {"name":"four","namespace":"core-clusterqueue-m994d"}, "queue": "queue", "status": "finished", "error": "cluster queue not found"} sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Delete /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:158 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnDelete /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:131 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:820 ... skipping 9 lines ... /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:812 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:73 2022-11-25T13:27:33.373361298Z LEVEL(-3) localqueue-reconciler core/localqueue_controller.go:144 Got Workload event {"workload": {"name":"four","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.373473123Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"four","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.375710319Z LEVEL(-2) workload-reconciler core/workload_controller.go:149 Workload delete event {"workload": {"name":"one","namespace":"core-clusterqueue-m994d"}, "queue": "queue", "status": "finished"} 2022-11-25T13:27:33.375849167Z ERROR workload-reconciler core/workload_controller.go:158 Failed to delete workload from cache {"workload": {"name":"one","namespace":"core-clusterqueue-m994d"}, "queue": "queue", "status": "finished", "error": "cluster queue not found"} sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Delete /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:158 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnDelete /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:131 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:820 ... skipping 12 lines ... 2022-11-25T13:27:33.3760206Z LEVEL(-3) localqueue-reconciler core/localqueue_controller.go:144 Got Workload event {"workload": {"name":"one","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.376062555Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"one","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.377867629Z LEVEL(-2) workload-reconciler core/workload_controller.go:149 Workload delete event {"workload": {"name":"six","namespace":"core-clusterqueue-m994d"}, "queue": "queue", "status": "finished"} 2022-11-25T13:27:33.377972586Z LEVEL(-3) localqueue-reconciler core/localqueue_controller.go:144 Got Workload event {"workload": {"name":"six","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.378005863Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"six","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.380996214Z LEVEL(-2) workload-reconciler core/workload_controller.go:149 Workload delete event {"workload": {"name":"three","namespace":"core-clusterqueue-m994d"}, "queue": "queue", "status": "finished"} 2022-11-25T13:27:33.381048394Z ERROR workload-reconciler core/workload_controller.go:158 Failed to delete workload from cache {"workload": {"name":"three","namespace":"core-clusterqueue-m994d"}, "queue": "queue", "status": "finished", "error": "cluster queue not found"} sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Delete /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:158 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnDelete /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:131 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:820 ... skipping 9 lines ... /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:812 k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1 /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:73 2022-11-25T13:27:33.381157304Z LEVEL(-3) localqueue-reconciler core/localqueue_controller.go:144 Got Workload event {"workload": {"name":"three","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.381190128Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:201 Got Workload event {"workload": {"name":"three","namespace":"core-clusterqueue-m994d"}} 2022-11-25T13:27:33.384335128Z LEVEL(-2) workload-reconciler core/workload_controller.go:149 Workload delete event {"workload": {"name":"two","namespace":"core-clusterqueue-m994d"}, "queue": "queue", "status": "finished"} 2022-11-25T13:27:33.384385328Z ERROR workload-reconciler core/workload_controller.go:158 Failed to delete workload from cache {"workload": {"name":"two","namespace":"core-clusterqueue-m994d"}, "queue": "queue", "status": "finished", "error": "cluster queue not found"} sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Delete /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:158 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnDelete /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:131 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:820 ... skipping 106 lines ... 2022-11-25T13:27:34.957753675Z DEBUG controller-runtime.webhook.webhooks admission/http.go:96 received request {"webhook": "/validate-kueue-x-k8s-io-v1alpha2-clusterqueue", "UID": "276ade6a-9258-4a5b-8d0a-da6cc356414a", "kind": "kueue.x-k8s.io/v1alpha2, Kind=ClusterQueue", "resource": {"group":"kueue.x-k8s.io","version":"v1alpha2","resource":"clusterqueues"}} 2022-11-25T13:27:34.957977689Z DEBUG controller-runtime.webhook.webhooks admission/http.go:143 wrote response {"webhook": "/validate-kueue-x-k8s-io-v1alpha2-clusterqueue", "code": 200, "reason": "", "UID": "276ade6a-9258-4a5b-8d0a-da6cc356414a", "allowed": true} 2022-11-25T13:27:34.960976582Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:165 ClusterQueue delete event {"clusterQueue": {"name":"foo-cq"}} 2022-11-25T13:27:34.961102404Z LEVEL(-2) resourceflavor-reconciler core/resourceflavor_controller.go:156 Got generic event {"obj": {"name":"foo-cq"}, "kind": "/, Kind="} 2022-11-25T13:27:34.993859234Z LEVEL(-2) localqueue-reconciler core/localqueue_controller.go:119 LocalQueue delete event {"localQueue": {"name":"queue","namespace":"core-clusterqueue-5rbbv"}} 2022-11-25T13:27:34.999901047Z LEVEL(-2) workload-reconciler core/workload_controller.go:149 Workload delete event {"workload": {"name":"workload","namespace":"core-clusterqueue-5rbbv"}, "queue": "queue", "status": "finished"} 2022-11-25T13:27:34.999961002Z ERROR workload-reconciler core/workload_controller.go:158 Failed to delete workload from cache {"workload": {"name":"workload","namespace":"core-clusterqueue-5rbbv"}, "queue": "queue", "status": "finished", "error": "cluster queue not found"} sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Delete /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:158 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnDelete /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:131 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:820 ... skipping 62 lines ... 2022-11-25T13:27:34.957753675Z DEBUG controller-runtime.webhook.webhooks admission/http.go:96 received request {"webhook": "/validate-kueue-x-k8s-io-v1alpha2-clusterqueue", "UID": "276ade6a-9258-4a5b-8d0a-da6cc356414a", "kind": "kueue.x-k8s.io/v1alpha2, Kind=ClusterQueue", "resource": {"group":"kueue.x-k8s.io","version":"v1alpha2","resource":"clusterqueues"}} 2022-11-25T13:27:34.957977689Z DEBUG controller-runtime.webhook.webhooks admission/http.go:143 wrote response {"webhook": "/validate-kueue-x-k8s-io-v1alpha2-clusterqueue", "code": 200, "reason": "", "UID": "276ade6a-9258-4a5b-8d0a-da6cc356414a", "allowed": true} 2022-11-25T13:27:34.960976582Z LEVEL(-2) cluster-queue-reconciler core/clusterqueue_controller.go:165 ClusterQueue delete event {"clusterQueue": {"name":"foo-cq"}} 2022-11-25T13:27:34.961102404Z LEVEL(-2) resourceflavor-reconciler core/resourceflavor_controller.go:156 Got generic event {"obj": {"name":"foo-cq"}, "kind": "/, Kind="} 2022-11-25T13:27:34.993859234Z LEVEL(-2) localqueue-reconciler core/localqueue_controller.go:119 LocalQueue delete event {"localQueue": {"name":"queue","namespace":"core-clusterqueue-5rbbv"}} 2022-11-25T13:27:34.999901047Z LEVEL(-2) workload-reconciler core/workload_controller.go:149 Workload delete event {"workload": {"name":"workload","namespace":"core-clusterqueue-5rbbv"}, "queue": "queue", "status": "finished"} 2022-11-25T13:27:34.999961002Z ERROR workload-reconciler core/workload_controller.go:158 Failed to delete workload from cache {"workload": {"name":"workload","namespace":"core-clusterqueue-5rbbv"}, "queue": "queue", "status": "finished", "error": "cluster queue not found"} sigs.k8s.io/kueue/pkg/controller/core.(*WorkloadReconciler).Delete /home/prow/go/src/sigs.k8s.io/kueue/pkg/controller/core/workload_controller.go:158 sigs.k8s.io/controller-runtime/pkg/source/internal.EventHandler.OnDelete /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/internal/eventsource.go:131 k8s.io/client-go/tools/cache.(*processorListener).run.func1 /home/prow/go/pkg/mod/k8s.io/client-go@v0.24.3/tools/cache/shared_informer.go:820 ... skipping 26 lines ... 2022-11-25T13:27:35.004661429Z INFO controller/controller.go:249 All workers finished {"controller": "localqueue", "controllerGroup": "kueue.x-k8s.io", "controllerKind": "LocalQueue"} 2022-11-25T13:27:35.004688258Z INFO controller/controller.go:249 All workers finished {"controller": "clusterqueue", "controllerGroup": "kueue.x-k8s.io", "controllerKind": "ClusterQueue"} 2022-11-25T13:27:35.004705344Z INFO controller/controller.go:249 All workers finished {"controller": "workload", "controllerGroup": "kueue.x-k8s.io", "controllerKind": "Workload"} 2022-11-25T13:27:35.004723512Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for caches 2022-11-25T13:27:35.00489902Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for webhooks 2022-11-25T13:27:35.004914513Z DEBUG controller-runtime.certwatcher logr@v1.2.3/logr.go:261 certificate event {"event": "\"/tmp/envtest-serving-certs-2323300415/tls.key\": REMOVE"} 2022-11-25T13:27:35.005091197Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-watching file {"error": "no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:147 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:35.00514416Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-reading certificate {"error": "open /tmp/envtest-serving-certs-2323300415/tls.crt: no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:152 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:35.005157615Z INFO controller-runtime.webhook logr@v1.2.3/logr.go:261 shutting down webhook server ... skipping 15 lines ... 2022-11-25T13:27:35.004661429Z INFO controller/controller.go:249 All workers finished {"controller": "localqueue", "controllerGroup": "kueue.x-k8s.io", "controllerKind": "LocalQueue"} 2022-11-25T13:27:35.004688258Z INFO controller/controller.go:249 All workers finished {"controller": "clusterqueue", "controllerGroup": "kueue.x-k8s.io", "controllerKind": "ClusterQueue"} 2022-11-25T13:27:35.004705344Z INFO controller/controller.go:249 All workers finished {"controller": "workload", "controllerGroup": "kueue.x-k8s.io", "controllerKind": "Workload"} 2022-11-25T13:27:35.004723512Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for caches 2022-11-25T13:27:35.00489902Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for webhooks 2022-11-25T13:27:35.004914513Z DEBUG controller-runtime.certwatcher logr@v1.2.3/logr.go:261 certificate event {"event": "\"/tmp/envtest-serving-certs-2323300415/tls.key\": REMOVE"} 2022-11-25T13:27:35.005091197Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-watching file {"error": "no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:147 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:35.00514416Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-reading certificate {"error": "open /tmp/envtest-serving-certs-2323300415/tls.crt: no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:152 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:35.005157615Z INFO controller-runtime.webhook logr@v1.2.3/logr.go:261 shutting down webhook server ... skipping 6 lines ... [38;5;10m[ReportAfterSuite] PASSED [0.003 seconds][0m [ReportAfterSuite] Autogenerated ReportAfterSuite for --junit-report [38;5;243mautogenerated by Ginkgo[0m [38;5;243m------------------------------[0m [38;5;10m[1mRan 12 of 12 Specs in 21.655 seconds[0m [38;5;10m[1mSUCCESS![0m -- [38;5;10m[1m12 Passed[0m | [38;5;9m[1m0 Failed[0m | [38;5;11m[1m0 Pending[0m | [38;5;14m[1m0 Skipped[0m PASS Running Suite: Job Controller Suite - /home/prow/go/src/sigs.k8s.io/kueue/test/integration/controller/job ========================================================================================================= Random Seed: [1m1669382825[0m Will run [1m8[0m of [1m8[0m specs ... skipping 38 lines ... 2022-11-25T13:27:41.517358492Z INFO controller/controller.go:185 Starting EventSource {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job", "source": "kind source: *v1.Job"} 2022-11-25T13:27:41.517445557Z INFO controller/controller.go:185 Starting EventSource {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job", "source": "kind source: *v1alpha2.Workload"} 2022-11-25T13:27:41.51745601Z INFO controller/controller.go:193 Starting Controller {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job"} [1mSTEP:[0m tearing down the test environment [38;5;243m11/25/22 13:27:41.534[0m 2022-11-25T13:27:41.534585652Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for non leader election runnables 2022-11-25T13:27:41.534689763Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for leader election runnables 2022-11-25T13:27:41.534744228Z ERROR controller-runtime.source logr@v1.2.3/logr.go:279 failed to get informer from cache {"error": "Timeout: failed waiting for *v1.Job Informer to sync"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/source.(*Kind).Start.func1.1 /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/source.go:144 k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:233 k8s.io/apimachinery/pkg/util/wait.poll ... skipping 2 lines ... /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:545 sigs.k8s.io/controller-runtime/pkg/source.(*Kind).Start.func1 /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/source.go:132 2022-11-25T13:27:41.534801491Z INFO controller/controller.go:227 Starting workers {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job", "worker count": 1} 2022-11-25T13:27:41.534807279Z DEBUG controller-runtime.certwatcher logr@v1.2.3/logr.go:261 certificate event {"event": "\"/tmp/envtest-serving-certs-3642754696/tls.key\": REMOVE"} 2022-11-25T13:27:41.534831803Z INFO controller/controller.go:247 Shutdown signal received, waiting for all workers to finish {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job"} 2022-11-25T13:27:41.534871838Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-watching file {"error": "no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:147 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:41.534903045Z INFO controller/controller.go:249 All workers finished {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job"} 2022-11-25T13:27:41.534919778Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for caches 2022-11-25T13:27:41.534913699Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-reading certificate {"error": "open /tmp/envtest-serving-certs-3642754696/tls.crt: no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:152 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:41.535055687Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for webhooks ... skipping 46 lines ... 2022-11-25T13:27:41.517358492Z INFO controller/controller.go:185 Starting EventSource {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job", "source": "kind source: *v1.Job"} 2022-11-25T13:27:41.517445557Z INFO controller/controller.go:185 Starting EventSource {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job", "source": "kind source: *v1alpha2.Workload"} 2022-11-25T13:27:41.51745601Z INFO controller/controller.go:193 Starting Controller {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job"} [1mSTEP:[0m tearing down the test environment [38;5;243m11/25/22 13:27:41.534[0m 2022-11-25T13:27:41.534585652Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for non leader election runnables 2022-11-25T13:27:41.534689763Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for leader election runnables 2022-11-25T13:27:41.534744228Z ERROR controller-runtime.source logr@v1.2.3/logr.go:279 failed to get informer from cache {"error": "Timeout: failed waiting for *v1.Job Informer to sync"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/source.(*Kind).Start.func1.1 /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/source.go:144 k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:233 k8s.io/apimachinery/pkg/util/wait.poll ... skipping 2 lines ... /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:545 sigs.k8s.io/controller-runtime/pkg/source.(*Kind).Start.func1 /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/source.go:132 2022-11-25T13:27:41.534801491Z INFO controller/controller.go:227 Starting workers {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job", "worker count": 1} 2022-11-25T13:27:41.534807279Z DEBUG controller-runtime.certwatcher logr@v1.2.3/logr.go:261 certificate event {"event": "\"/tmp/envtest-serving-certs-3642754696/tls.key\": REMOVE"} 2022-11-25T13:27:41.534831803Z INFO controller/controller.go:247 Shutdown signal received, waiting for all workers to finish {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job"} 2022-11-25T13:27:41.534871838Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-watching file {"error": "no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:147 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:41.534903045Z INFO controller/controller.go:249 All workers finished {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job"} 2022-11-25T13:27:41.534919778Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for caches 2022-11-25T13:27:41.534913699Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-reading certificate {"error": "open /tmp/envtest-serving-certs-3642754696/tls.crt: no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:152 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:41.535055687Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for webhooks ... skipping 42 lines ... 2022-11-25T13:27:47.999014086Z DEBUG controller-runtime.webhook.webhooks admission/http.go:143 wrote response {"webhook": "/validate-batch-v1-job", "code": 403, "reason": "job.spec.suspend: Forbidden: suspend should be true when adding the queue name", "UID": "1692d4d6-8b1e-42ac-a1e7-f598d8c28398", "allowed": false} 2022-11-25T13:27:48.06529186Z INFO controller/controller.go:185 Starting EventSource {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job", "source": "kind source: *v1.Job"} 2022-11-25T13:27:48.065374292Z INFO controller/controller.go:185 Starting EventSource {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job", "source": "kind source: *v1alpha2.Workload"} 2022-11-25T13:27:48.065384389Z INFO controller/controller.go:193 Starting Controller {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job"} [1mSTEP:[0m tearing down the test environment [38;5;243m11/25/22 13:27:48.086[0m 2022-11-25T13:27:48.087289543Z DEBUG controller-runtime.certwatcher logr@v1.2.3/logr.go:261 certificate event {"event": "\"/tmp/envtest-serving-certs-2110305293/tls.key\": REMOVE"} 2022-11-25T13:27:48.087356025Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-watching file {"error": "no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:147 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:48.087384859Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-reading certificate {"error": "open /tmp/envtest-serving-certs-2110305293/tls.crt: no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:152 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:48.087405668Z DEBUG controller-runtime.certwatcher logr@v1.2.3/logr.go:261 certificate event {"event": "\"/tmp/envtest-serving-certs-2110305293/tls.crt\": REMOVE"} 2022-11-25T13:27:48.087417673Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-watching file {"error": "no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:147 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:48.087429256Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-reading certificate {"error": "open /tmp/envtest-serving-certs-2110305293/tls.crt: no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:152 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:48.087056079Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for non leader election runnables 2022-11-25T13:27:48.087582361Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for leader election runnables 2022-11-25T13:27:48.087726258Z INFO controller/controller.go:227 Starting workers {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job", "worker count": 1} 2022-11-25T13:27:48.087759984Z INFO controller/controller.go:247 Shutdown signal received, waiting for all workers to finish {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job"} 2022-11-25T13:27:48.087771359Z INFO controller/controller.go:249 All workers finished {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job"} 2022-11-25T13:27:48.087782615Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for caches 2022-11-25T13:27:48.087860451Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for webhooks 2022-11-25T13:27:48.087985634Z INFO controller-runtime.webhook logr@v1.2.3/logr.go:261 shutting down webhook server 2022-11-25T13:27:48.087690453Z ERROR controller-runtime.source logr@v1.2.3/logr.go:279 failed to get informer from cache {"error": "Timeout: failed waiting for *v1.Job Informer to sync"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/source.(*Kind).Start.func1.1 /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/source.go:144 k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:233 k8s.io/apimachinery/pkg/util/wait.poll ... skipping 51 lines ... 2022-11-25T13:27:47.999014086Z DEBUG controller-runtime.webhook.webhooks admission/http.go:143 wrote response {"webhook": "/validate-batch-v1-job", "code": 403, "reason": "job.spec.suspend: Forbidden: suspend should be true when adding the queue name", "UID": "1692d4d6-8b1e-42ac-a1e7-f598d8c28398", "allowed": false} 2022-11-25T13:27:48.06529186Z INFO controller/controller.go:185 Starting EventSource {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job", "source": "kind source: *v1.Job"} 2022-11-25T13:27:48.065374292Z INFO controller/controller.go:185 Starting EventSource {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job", "source": "kind source: *v1alpha2.Workload"} 2022-11-25T13:27:48.065384389Z INFO controller/controller.go:193 Starting Controller {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job"} [1mSTEP:[0m tearing down the test environment [38;5;243m11/25/22 13:27:48.086[0m 2022-11-25T13:27:48.087289543Z DEBUG controller-runtime.certwatcher logr@v1.2.3/logr.go:261 certificate event {"event": "\"/tmp/envtest-serving-certs-2110305293/tls.key\": REMOVE"} 2022-11-25T13:27:48.087356025Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-watching file {"error": "no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:147 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:48.087384859Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-reading certificate {"error": "open /tmp/envtest-serving-certs-2110305293/tls.crt: no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:152 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:48.087405668Z DEBUG controller-runtime.certwatcher logr@v1.2.3/logr.go:261 certificate event {"event": "\"/tmp/envtest-serving-certs-2110305293/tls.crt\": REMOVE"} 2022-11-25T13:27:48.087417673Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-watching file {"error": "no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:147 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:48.087429256Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-reading certificate {"error": "open /tmp/envtest-serving-certs-2110305293/tls.crt: no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:152 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:48.087056079Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for non leader election runnables 2022-11-25T13:27:48.087582361Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for leader election runnables 2022-11-25T13:27:48.087726258Z INFO controller/controller.go:227 Starting workers {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job", "worker count": 1} 2022-11-25T13:27:48.087759984Z INFO controller/controller.go:247 Shutdown signal received, waiting for all workers to finish {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job"} 2022-11-25T13:27:48.087771359Z INFO controller/controller.go:249 All workers finished {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job"} 2022-11-25T13:27:48.087782615Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for caches 2022-11-25T13:27:48.087860451Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for webhooks 2022-11-25T13:27:48.087985634Z INFO controller-runtime.webhook logr@v1.2.3/logr.go:261 shutting down webhook server 2022-11-25T13:27:48.087690453Z ERROR controller-runtime.source logr@v1.2.3/logr.go:279 failed to get informer from cache {"error": "Timeout: failed waiting for *v1.Job Informer to sync"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/source.(*Kind).Start.func1.1 /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/source.go:144 k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:233 k8s.io/apimachinery/pkg/util/wait.poll ... skipping 45 lines ... 2022-11-25T13:27:54.628691854Z INFO controller/controller.go:185 Starting EventSource {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job", "source": "kind source: *v1.Job"} 2022-11-25T13:27:54.628797736Z INFO controller/controller.go:185 Starting EventSource {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job", "source": "kind source: *v1alpha2.Workload"} 2022-11-25T13:27:54.628813795Z INFO controller/controller.go:193 Starting Controller {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job"} [1mSTEP:[0m tearing down the test environment [38;5;243m11/25/22 13:27:54.64[0m 2022-11-25T13:27:54.640414855Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for non leader election runnables 2022-11-25T13:27:54.640539136Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for leader election runnables 2022-11-25T13:27:54.640588853Z ERROR controller-runtime.source logr@v1.2.3/logr.go:279 failed to get informer from cache {"error": "Timeout: failed waiting for *v1.Job Informer to sync"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/source.(*Kind).Start.func1.1 /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/source.go:144 k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:233 k8s.io/apimachinery/pkg/util/wait.poll /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:580 k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:545 sigs.k8s.io/controller-runtime/pkg/source.(*Kind).Start.func1 /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/source.go:132 2022-11-25T13:27:54.640625176Z ERROR controller/controller.go:210 Could not wait for Cache to sync {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job", "error": "failed to wait for job caches to sync: cache did not sync"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1 /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/internal/controller/controller.go:210 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2 /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/internal/controller/controller.go:215 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/internal/controller/controller.go:241 sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1 /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/manager/runnable_group.go:219 2022-11-25T13:27:54.640672884Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for caches 2022-11-25T13:27:54.640642266Z DEBUG controller-runtime.certwatcher logr@v1.2.3/logr.go:261 certificate event {"event": "\"/tmp/envtest-serving-certs-1937725113/tls.key\": REMOVE"} 2022-11-25T13:27:54.64070075Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-watching file {"error": "no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:147 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:54.640733386Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-reading certificate {"error": "open /tmp/envtest-serving-certs-1937725113/tls.crt: no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:152 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:54.640684722Z ERROR logr@v1.2.3/logr.go:279 error received after stop sequence was engaged {"error": "failed to wait for job caches to sync: cache did not sync"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1 /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/manager/internal.go:541 2022-11-25T13:27:54.640750882Z DEBUG controller-runtime.certwatcher logr@v1.2.3/logr.go:261 certificate event {"event": "\"/tmp/envtest-serving-certs-1937725113/tls.crt\": REMOVE"} 2022-11-25T13:27:54.64077909Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for webhooks 2022-11-25T13:27:54.640797939Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-watching file {"error": "no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:147 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:54.640828799Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-reading certificate {"error": "open /tmp/envtest-serving-certs-1937725113/tls.crt: no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:152 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:54.640877793Z INFO controller-runtime.webhook logr@v1.2.3/logr.go:261 shutting down webhook server ... skipping 45 lines ... 2022-11-25T13:27:54.628691854Z INFO controller/controller.go:185 Starting EventSource {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job", "source": "kind source: *v1.Job"} 2022-11-25T13:27:54.628797736Z INFO controller/controller.go:185 Starting EventSource {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job", "source": "kind source: *v1alpha2.Workload"} 2022-11-25T13:27:54.628813795Z INFO controller/controller.go:193 Starting Controller {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job"} [1mSTEP:[0m tearing down the test environment [38;5;243m11/25/22 13:27:54.64[0m 2022-11-25T13:27:54.640414855Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for non leader election runnables 2022-11-25T13:27:54.640539136Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for leader election runnables 2022-11-25T13:27:54.640588853Z ERROR controller-runtime.source logr@v1.2.3/logr.go:279 failed to get informer from cache {"error": "Timeout: failed waiting for *v1.Job Informer to sync"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/source.(*Kind).Start.func1.1 /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/source.go:144 k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:233 k8s.io/apimachinery/pkg/util/wait.poll /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:580 k8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext /home/prow/go/pkg/mod/k8s.io/apimachinery@v0.24.3/pkg/util/wait/wait.go:545 sigs.k8s.io/controller-runtime/pkg/source.(*Kind).Start.func1 /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/source/source.go:132 2022-11-25T13:27:54.640625176Z ERROR controller/controller.go:210 Could not wait for Cache to sync {"controller": "job", "controllerGroup": "batch", "controllerKind": "Job", "error": "failed to wait for job caches to sync: cache did not sync"} sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1 /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/internal/controller/controller.go:210 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2 /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/internal/controller/controller.go:215 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/internal/controller/controller.go:241 sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1 /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/manager/runnable_group.go:219 2022-11-25T13:27:54.640672884Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for caches 2022-11-25T13:27:54.640642266Z DEBUG controller-runtime.certwatcher logr@v1.2.3/logr.go:261 certificate event {"event": "\"/tmp/envtest-serving-certs-1937725113/tls.key\": REMOVE"} 2022-11-25T13:27:54.64070075Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-watching file {"error": "no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:147 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:54.640733386Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-reading certificate {"error": "open /tmp/envtest-serving-certs-1937725113/tls.crt: no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:152 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:54.640684722Z ERROR logr@v1.2.3/logr.go:279 error received after stop sequence was engaged {"error": "failed to wait for job caches to sync: cache did not sync"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1 /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/manager/internal.go:541 2022-11-25T13:27:54.640750882Z DEBUG controller-runtime.certwatcher logr@v1.2.3/logr.go:261 certificate event {"event": "\"/tmp/envtest-serving-certs-1937725113/tls.crt\": REMOVE"} 2022-11-25T13:27:54.64077909Z INFO logr@v1.2.3/logr.go:261 Stopping and waiting for webhooks 2022-11-25T13:27:54.640797939Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-watching file {"error": "no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:147 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:54.640828799Z ERROR controller-runtime.certwatcher logr@v1.2.3/logr.go:279 error re-reading certificate {"error": "open /tmp/envtest-serving-certs-1937725113/tls.crt: no such file or directory"} github.com/go-logr/logr.Logger.Error /home/prow/go/pkg/mod/github.com/go-logr/logr@v1.2.3/logr.go:279 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).handleEvent /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:152 sigs.k8s.io/controller-runtime/pkg/certwatcher.(*CertWatcher).Watch /home/prow/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.12.3/pkg/certwatcher/certwatcher.go:103 2022-11-25T13:27:54.640877793Z INFO controller-runtime.webhook logr@v1.2.3/logr.go:261 shutting down webhook server ... skipping 2 lines ... [38;5;243m------------------------------[0m [0mJob Webhook [38;5;243mwhen with manageJobsWithoutQueueName disabled[0m [1mshould not suspend a Job when no queue name specified[0m [38;5;243m/home/prow/go/src/sigs.k8s.io/kueue/test/integration/controller/job/job_webhook_test.go:123[0m [1mSTEP:[0m bootstrapping test environment [38;5;243m11/25/22 13:27:55.778[0m 2022-11-25T13:27:55.778386865Z DEBUG controller-runtime.test-env logr@v1.2.3/logr.go:261 starting control plane {"component":"entrypoint","file":"k8s.io/test-infra/prow/entrypoint/run.go:168","func":"k8s.io/test-infra/prow/entrypoint.Options.ExecuteProcess","level":"error","msg":"Entrypoint received interrupt: terminated","severity":"error","time":"2022-11-25T13:27:59Z"}