This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 0 failed / 0 succeeded
Started2022-08-14 15:06
Elapsed4m38s
Revisionrelease-0.3

No Test Failures!


Error lines from build-log.txt

... skipping 777 lines ...
I0814 15:07:59.572563    8524 certwatcher.go:83] controller-runtime/certwatcher "msg"="Starting certificate watcher"  
I0814 15:08:00.409365    8524 kubeadmconfig_controller.go:223]  "msg"="Cluster infrastructure is not ready, waiting" "kind"="Machine" "kubeadmconfig"={"Namespace":"default","Name":"my-machine-config"} "name"="my-machine" "version"="109" 
•I0814 15:08:00.432442    8524 server.go:208] controller-runtime/webhook "msg"="shutting down webhook server"  


Ran 1 of 1 Specs in 13.909 seconds
SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
--- PASS: TestAPIs (13.91s)
PASS
ok  	sigs.k8s.io/cluster-api/bootstrap/kubeadm/controllers	49.538s
=== RUN   TestNewInitControlPlaneAdditionalFileEncodings
--- PASS: TestNewInitControlPlaneAdditionalFileEncodings (0.00s)
=== RUN   TestNewInitControlPlaneCommands
... skipping 316 lines ...
=== RUN   Test_clusterctlClient_GetProvidersConfig/Returns_default_providers_and_custom_providers_if_defined
--- PASS: Test_clusterctlClient_GetProvidersConfig (0.00s)
    --- PASS: Test_clusterctlClient_GetProvidersConfig/Returns_default_providers (0.00s)
    --- PASS: Test_clusterctlClient_GetProvidersConfig/Returns_default_providers_and_custom_providers_if_defined (0.00s)
=== RUN   Test_clusterctlClient_GetProviderComponents
=== RUN   Test_clusterctlClient_GetProviderComponents/Pass
=== RUN   Test_clusterctlClient_GetProviderComponents/Fail
--- PASS: Test_clusterctlClient_GetProviderComponents (0.00s)
    --- PASS: Test_clusterctlClient_GetProviderComponents/Pass (0.00s)
    --- PASS: Test_clusterctlClient_GetProviderComponents/Fail (0.00s)
=== RUN   Test_getComponentsByName_withEmptyVariables
--- PASS: Test_getComponentsByName_withEmptyVariables (0.00s)
=== RUN   Test_clusterctlClient_templateOptionsToVariables
=== RUN   Test_clusterctlClient_templateOptionsToVariables/pass_(using_KubernetesVersion_from_template_options)
=== RUN   Test_clusterctlClient_templateOptionsToVariables/pass_(using_KubernetesVersion_from_env_variables)
=== RUN   Test_clusterctlClient_templateOptionsToVariables/pass_(using_defaults_for_machine_counts)
... skipping 1388 lines ...
I0814 15:07:47.137978   10559 controller.go:155] controller-runtime/controller "msg"="Starting EventSource" "controller"="machineset" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"clusterName":"","bootstrap":{},"infrastructureRef":{}},"status":{"bootstrapReady":false,"infrastructureReady":false}}}
I0814 15:07:47.138033   10559 controller.go:155] controller-runtime/controller "msg"="Starting EventSource" "controller"="machineset" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"controlPlaneEndpoint":{"host":"","port":0}},"status":{"infrastructureReady":false,"controlPlaneInitialized":false}}}
I0814 15:07:47.138069   10559 controller.go:162] controller-runtime/controller "msg"="Starting Controller" "controller"="machineset" 
I0814 15:07:47.138250   10559 controller.go:155] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"clusterName":"","bootstrap":{},"infrastructureRef":{}},"status":{"bootstrapReady":false,"infrastructureReady":false}}}
I0814 15:07:47.138327   10559 controller.go:155] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"controlPlaneEndpoint":{"host":"","port":0}},"status":{"infrastructureReady":false,"controlPlaneInitialized":false}}}
I0814 15:07:47.138358   10559 controller.go:162] controller-runtime/controller "msg"="Starting Controller" "controller"="machinehealthcheck" 
2022/08/14 15:07:47 http: TLS handshake error from 127.0.0.1:34664: EOF
=== RUN   TestClusterReconcilePhases
=== RUN   TestClusterReconcilePhases/reconcile_infrastructure
=== RUN   TestClusterReconcilePhases/reconcile_infrastructure/returns_no_error_if_infrastructure_ref_is_nil
=== RUN   TestClusterReconcilePhases/reconcile_infrastructure/returns_error_if_unable_to_reconcile_infrastructure_ref
I0814 15:07:47.336991   10559 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "cluster"="test-cluster" "namespace"="test-namespace" "err"="cannot create a metadata client without a rest config"
I0814 15:07:47.337791   10559 controller.go:189] controller-runtime/controller "msg"="Starting workers" "controller"="cluster" "worker count"=1
... skipping 115 lines ...
    --- PASS: TestReconcileBootstrap/existing_machine,_machineset_owner_and_version_v1alpha2,_and_ownerref_updated (0.00s)
=== RUN   TestReconcileInfrastructure
=== RUN   TestReconcileInfrastructure/new_machine,_infrastructure_config_ready
I0814 15:07:47.393436   10559 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="machine-test" "namespace"="default" "err"="cannot create a metadata client without a rest config"
=== RUN   TestReconcileInfrastructure/ready_bootstrap,_infra,_and_nodeRef,_machine_is_running,_infra_object_is_deleted,_expect_failed
I0814 15:07:47.395343   10559 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="machine-test" "namespace"="default" "err"="cannot create a metadata client without a rest config"
E0814 15:07:47.395707   10559 machine_controller_phases.go:246]  "msg"="Machine infrastructure reference has been deleted after being ready, setting failure state" "error"="could not find infrastructure.cluster.x-k8s.io/v1alpha3, Kind=InfrastructureMachine \"infra-config1\" for Machine \"machine-test\" in namespace \"default\", requeuing: requeue in 1s"  
=== RUN   TestReconcileInfrastructure/infrastructure_ref_is_paused
I0814 15:07:47.396226   10559 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="machine-test" "namespace"="default" "err"="cannot create a metadata client without a rest config"
--- PASS: TestReconcileInfrastructure (0.00s)
    --- PASS: TestReconcileInfrastructure/new_machine,_infrastructure_config_ready (0.00s)
    --- PASS: TestReconcileInfrastructure/ready_bootstrap,_infra,_and_nodeRef,_machine_is_running,_infra_object_is_deleted,_expect_failed (0.00s)
    --- PASS: TestReconcileInfrastructure/infrastructure_ref_is_paused (0.00s)
=== RUN   TestWatches
I0814 15:07:47.703228   10559 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machine" "source"={}
E0814 15:07:47.710907   10559 machine_controller.go:685] controllers/Machine "msg"="Unable to retrieve machine from node" "error"="no matching Machine"  "node"="node-1"
I0814 15:07:47.717864   10559 tracker.go:55] controllers/Machine "msg"="Adding watcher on external object" "machine"="machine-created-28df6" "namespace"="test-machine-watches-gxd6x" "GroupVersionKind"="bootstrap.cluster.x-k8s.io/v1alpha3, Kind=BootstrapMachine"
I0814 15:07:47.717968   10559 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machine" "source"={"Type":{"apiVersion":"bootstrap.cluster.x-k8s.io/v1alpha3","kind":"BootstrapMachine"}}
I0814 15:07:47.852776   10559 tracker.go:55] controllers/Machine "msg"="Adding watcher on external object" "machine"="machine-created-28df6" "namespace"="test-machine-watches-gxd6x" "GroupVersionKind"="infrastructure.cluster.x-k8s.io/v1alpha3, Kind=InfrastructureMachine"
I0814 15:07:47.852937   10559 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machine" "source"={"Type":{"apiVersion":"infrastructure.cluster.x-k8s.io/v1alpha3","kind":"InfrastructureMachine"}}
I0814 15:07:47.953513   10559 machine_controller_noderef.go:86] controllers/Machine "msg"="Set Machine's NodeRef" "machine"="machine-created-28df6" "namespace"="test-machine-watches-gxd6x" "noderef"="node-1"
E0814 15:07:47.963843   10559 machine_controller.go:685] controllers/Machine "msg"="Unable to retrieve machine from node" "error"="no matching Machine"  "node"="node-1"
E0814 15:07:47.963927   10559 machine_controller.go:685] controllers/Machine "msg"="Unable to retrieve machine from node" "error"="no matching Machine"  "node"="node-1"
E0814 15:07:48.038476   10559 machine_controller_phases.go:246] controllers/Machine "msg"="Machine infrastructure reference has been deleted after being ready, setting failure state" "error"="could not find infrastructure.cluster.x-k8s.io/v1alpha3, Kind=InfrastructureMachine \"infra-config1\" for Machine \"machine-created-28df6\" in namespace \"test-machine-watches-gxd6x\", requeuing: requeue in 1s"  
E0814 15:07:48.061487   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="[could not find infrastructure.cluster.x-k8s.io/v1alpha3, Kind=InfrastructureMachine \"infra-config1\" for Machine \"machine-created-28df6\" in namespace \"test-machine-watches-gxd6x\", requeuing: requeue in 1s, no matching Node for Machine \"machine-created-28df6\" in namespace \"test-machine-watches-gxd6x\": cannot find node with matching ProviderID]" "controller"="machine" "name"="machine-created-28df6" "namespace"="test-machine-watches-gxd6x"
--- PASS: TestWatches (0.69s)
=== RUN   TestIndexMachineByNodeName
=== RUN   TestIndexMachineByNodeName/when_the_machine_has_no_NodeRef
=== RUN   TestIndexMachineByNodeName/when_the_machine_has_valid_a_NodeRef
--- PASS: TestIndexMachineByNodeName (0.00s)
    --- PASS: TestIndexMachineByNodeName/when_the_machine_has_no_NodeRef (0.00s)
... skipping 2 lines ...
=== RUN   TestMachine_Reconcile/reconcile_create
I0814 15:07:48.284375   10559 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="machine-reconcile-q9th2" "namespace"="test-machine-watches-gxd6x" "count"=1
I0814 15:07:48.284464   10559 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="machine-reconcile-q9th2" "namespace"="test-machine-watches-gxd6x" "descendants"="Worker machines: machine-created-28df6" "indirect descendants count"=0
I0814 15:07:48.306731   10559 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="machine-reconcile-q9th2" "namespace"="test-machine-watches-gxd6x" "count"=1
I0814 15:07:48.306803   10559 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="machine-reconcile-q9th2" "namespace"="test-machine-watches-gxd6x" "descendants"="Worker machines: machine-created-28df6" "indirect descendants count"=0
I0814 15:07:49.062295   10559 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="machine-reconcile-q9th2" "machine"="machine-created-28df6" "namespace"="test-machine-watches-gxd6x" "cause"="cluster is being deleted" "node"={"kind":"Node","name":"node-1","uid":"637819e8-beb7-4485-a9ad-8a869d678d82","apiVersion":"v1"}
E0814 15:07:49.185401   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"machine-created-28df6\" not found" "controller"="machine" "name"="machine-created-28df6" "namespace"="test-machine-watches-gxd6x"
E0814 15:07:50.238735   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="[retrieved empty dataSecretName from bootstrap provider for Machine \"machine-created-6b77s\" in namespace \"default\", error creating client and cache for remote cluster: error fetching REST client config for remote cluster \"default/machine-reconcile-22hfx\": failed to retrieve kubeconfig secret for Cluster default/machine-reconcile-22hfx: secrets \"machine-reconcile-22hfx-kubeconfig\" not found]" "controller"="machine" "name"="machine-created-6b77s" "namespace"="default"
I0814 15:07:51.239374   10559 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="machine-reconcile-22hfx" "machine"="machine-created-6b77s" "namespace"="default" "cause"="noderef is nil" "node"=null
I0814 15:07:51.281027   10559 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="machine-reconcile-22hfx" "machine"="machine-created-6b77s" "namespace"="default" "cause"="noderef is nil" "node"=null
I0814 15:07:51.308422   10559 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="machine-reconcile-22hfx" "machine"="machine-created-6b77s" "namespace"="default" "cause"="noderef is nil" "node"=null
E0814 15:07:51.363141   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"machine-created-6b77s\" not found" "controller"="machine" "name"="machine-created-6b77s" "namespace"="default"
--- PASS: TestMachine_Reconcile (3.28s)
    --- PASS: TestMachine_Reconcile/reconcile_create (3.28s)
=== RUN   TestMachineFinalizer
=== RUN   TestMachineFinalizer/should_add_a_machine_finalizer_to_the_machine_if_it_doesn't_have_one
=== RUN   TestMachineFinalizer/should_append_the_machine_finalizer_to_the_machine_if_it_already_has_a_finalizer
--- PASS: TestMachineFinalizer (0.00s)
... skipping 12 lines ...
--- PASS: TestMachineOwnerReference (0.02s)
    --- PASS: TestMachineOwnerReference/should_add_owner_reference_to_machine_referencing_a_cluster_with_correct_type_meta (0.00s)
    --- PASS: TestMachineOwnerReference/should_not_add_cluster_owner_reference_if_machine_is_owned_by_a_machine_set (0.00s)
    --- PASS: TestMachineOwnerReference/should_not_add_cluster_owner_reference_if_machine_has_a_controller_owner (0.00s)
=== RUN   TestReconcileRequest
=== RUN   TestReconcileRequest/machine_should_be_created
E0814 15:07:51.391913   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusters.cluster.x-k8s.io \"machine-reconcile-22hfx\" not found" "controller"="cluster" "name"="machine-reconcile-22hfx" "namespace"="default"
I0814 15:07:51.392295   10559 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="created" "namespace"="default" "err"="cannot create a metadata client without a rest config"
=== RUN   TestReconcileRequest/machine_should_be_updated
I0814 15:07:51.397108   10559 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="updated" "namespace"="default" "err"="cannot create a metadata client without a rest config"
=== RUN   TestReconcileRequest/machine_should_be_deleted
I0814 15:07:51.401970   10559 machine_controller.go:305]  "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster" "machine"="deleted" "namespace"="default" "cause"="noderef is nil" "node"=null
--- PASS: TestReconcileRequest (0.02s)
... skipping 113 lines ...
    --- PASS: TestMachineDeploymentSyncStatus/scaling_up (0.00s)
=== RUN   TestMachineHealthCheck_Reconcile
=== RUN   TestMachineHealthCheck_Reconcile/it_should_ensure_the_correct_cluster-name_label_when_no_existing_labels_exist
I0814 15:07:51.647230   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-hlnsc" "namespace"="test-mhc-zfpqw" 
=== RUN   TestMachineHealthCheck_Reconcile/it_should_ensure_the_correct_cluster-name_label_when_the_label_has_the_wrong_value
I0814 15:07:51.682053   10559 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={}
E0814 15:07:51.683103   10559 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="Cluster.cluster.x-k8s.io \"test-cluster-nz2l2\" not found"  "cluster"="test-mhc-zfpqw/test-cluster-nz2l2"
E0814 15:07:51.702196   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="[MachineHealthCheck.cluster.x-k8s.io \"test-mhc-hlnsc\" not found, machinehealthchecks.cluster.x-k8s.io \"test-mhc-hlnsc\" not found]" "controller"="machinehealthcheck" "name"="test-mhc-hlnsc" "namespace"="test-mhc-zfpqw"
=== RUN   TestMachineHealthCheck_Reconcile/it_should_ensure_the_correct_cluster-name_label_when_other_labels_are_present
=== RUN   TestMachineHealthCheck_Reconcile/it_should_ensure_an_owner_reference_is_present_when_no_existing_ones_exist
I0814 15:07:52.702491   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-hlnsc" "namespace"="test-mhc-zfpqw" 
I0814 15:07:52.702615   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-tsb6x" "namespace"="test-mhc-8f2mq" 
I0814 15:07:52.702650   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-95vth" "namespace"="test-mhc-2bbq6" 
I0814 15:07:52.702694   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-drk5j" "namespace"="test-mhc-fcd8l" 
I0814 15:07:52.744767   10559 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={}
I0814 15:07:52.764604   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-drk5j" "namespace"="test-mhc-fcd8l" 
I0814 15:07:52.815569   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-drk5j" "namespace"="test-mhc-fcd8l" 
=== RUN   TestMachineHealthCheck_Reconcile/it_should_ensure_an_owner_reference_is_present_when_modifying_existing_ones
E0814 15:07:52.822884   10559 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-fcd8l/test-cluster-6v7jz"
E0814 15:07:52.825115   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusters.cluster.x-k8s.io \"test-cluster-6v7jz\" not found" "controller"="cluster" "name"="test-cluster-6v7jz" "namespace"="test-mhc-fcd8l"
I0814 15:07:52.842652   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-vqtx9" "namespace"="test-mhc-fhtp6" 
I0814 15:07:52.877415   10559 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={}
I0814 15:07:52.999151   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-vqtx9" "namespace"="test-mhc-fhtp6" 
E0814 15:07:53.057415   10559 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-fhtp6/test-cluster-4ddsj"
I0814 15:07:53.078878   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-vqtx9" "namespace"="test-mhc-fhtp6" 
=== RUN   TestMachineHealthCheck_Reconcile/it_doesn't_mark_anything_unhealthy_when_all_Machines_are_healthy
I0814 15:07:53.108976   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm" 
inframachine created: test-mhc-machine-infra-wcvw6
I0814 15:07:53.129953   10559 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={}
machine created: test-mhc-machine-mc8lk
I0814 15:07:53.230634   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-whmwm/test-mhc-v4m9n/test-mhc-machine-mc8lk/"
E0814 15:07:53.237579   10559 machine_controller.go:685] controllers/Machine "msg"="Unable to retrieve machine from node" "error"="no matching Machine"  "node"="test-mhc-node-87qnw"
node created: test-mhc-node-87qnw
E0814 15:07:53.238235   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-87qnw, got []"  "node"="test-mhc-node-87qnw"
inframachine created: test-mhc-machine-infra-lxg67
machine created: test-mhc-machine-jdffg
I0814 15:07:53.361875   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm" 
I0814 15:07:53.404622   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm" 
I0814 15:07:53.409282   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm" 
I0814 15:07:53.411792   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm" 
... skipping 16 lines ...
I0814 15:07:53.468113   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm" 
I0814 15:07:53.469280   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm" 
I0814 15:07:53.470579   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm" 
I0814 15:07:53.471758   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm" 
I0814 15:07:53.472929   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm" 
I0814 15:07:53.474873   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm" 
I0814 15:07:53.475227   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-whmwm/test-mhc-v4m9n/test-mhc-machine-jdffg/"
I0814 15:07:53.492306   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm" 
I0814 15:07:53.492796   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-whmwm/test-mhc-v4m9n/test-mhc-machine-jdffg/"
I0814 15:07:53.494436   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm" 
I0814 15:07:53.494897   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-whmwm/test-mhc-v4m9n/test-mhc-machine-jdffg/"
I0814 15:07:53.507360   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm" 
I0814 15:07:53.508310   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-whmwm/test-mhc-v4m9n/test-mhc-machine-jdffg/"
I0814 15:07:53.515556   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm" 
I0814 15:07:53.516048   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-whmwm/test-mhc-v4m9n/test-mhc-machine-jdffg/"
E0814 15:07:53.526281   10559 machine_controller.go:685] controllers/Machine "msg"="Unable to retrieve machine from node" "error"="no matching Machine"  "node"="test-mhc-node-lfvsf"
E0814 15:07:53.526281   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-lfvsf, got []"  "node"="test-mhc-node-lfvsf"
node created: test-mhc-node-lfvsf
I0814 15:07:53.533926   10559 machine_controller_noderef.go:86] controllers/Machine "msg"="Set Machine's NodeRef" "machine"="test-mhc-machine-jdffg" "namespace"="test-mhc-whmwm" "noderef"="test-mhc-node-lfvsf"
E0814 15:07:53.540395   10559 machine_controller.go:685] controllers/Machine "msg"="Unable to retrieve machine from node" "error"="no matching Machine"  "node"="test-mhc-node-lfvsf"
E0814 15:07:53.540462   10559 machine_controller.go:685] controllers/Machine "msg"="Unable to retrieve machine from node" "error"="no matching Machine"  "node"="test-mhc-node-lfvsf"
E0814 15:07:53.540780   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-lfvsf, got []"  "node"="test-mhc-node-lfvsf"
E0814 15:07:53.540838   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-lfvsf, got []"  "node"="test-mhc-node-lfvsf"
I0814 15:07:53.553925   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm" 
I0814 15:07:53.575325   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm" 
Cleaning up nodes, machines and infra machines.
I0814 15:07:53.590702   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm" 
I0814 15:07:53.591273   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="NodeNotFound" "target"="test-mhc-whmwm/test-mhc-v4m9n/test-mhc-machine-mc8lk/"
E0814 15:07:53.628484   10559 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-whmwm/test-cluster-2qm77"
=== RUN   TestMachineHealthCheck_Reconcile/it_marks_unhealthy_machines_for_remediation_when_there_is_one_unhealthy_Machine
E0814 15:07:53.750225   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machinehealthchecks.cluster.x-k8s.io \"test-mhc-v4m9n\" not found" "controller"="machinehealthcheck" "name"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm"
inframachine created: test-mhc-machine-infra-hmw87
E0814 15:07:53.769343   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-mc8lk\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-mc8lk" "namespace"="test-mhc-whmwm"
machine created: test-mhc-machine-zg8m4
E0814 15:07:53.840131   10559 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-machine-watches-gxd6x/machine-reconcile-q9th2"
I0814 15:07:54.750578   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v4m9n" "namespace"="test-mhc-whmwm" 
I0814 15:07:54.750699   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:54.769568   10559 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={}
E0814 15:07:54.769684   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-jdffg\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-jdffg" "namespace"="test-mhc-whmwm"
I0814 15:07:54.899113   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:54.906049   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:54.907110   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:54.908867   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:54.910775   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:54.912632   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
... skipping 366 lines ...
I0814 15:07:55.758633   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:55.760470   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:55.762715   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:55.764683   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:55.766575   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:55.768688   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
E0814 15:07:55.770057   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-mc8lk\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-mc8lk" "namespace"="test-mhc-whmwm"
I0814 15:07:55.770589   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:55.772583   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:55.774447   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:55.776469   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:55.778677   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:55.780648   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
... skipping 417 lines ...
I0814 15:07:56.774340   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:56.780040   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:56.784976   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:56.787479   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:56.788884   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:56.793135   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
E0814 15:07:56.794572   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-jdffg\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-jdffg" "namespace"="test-mhc-whmwm"
I0814 15:07:56.795404   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:56.797013   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-fln8k/test-mhc-dxcxd/test-mhc-machine-zg8m4/"
E0814 15:07:56.821425   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-sfng6, got []"  "node"="test-mhc-node-sfng6"
node created: test-mhc-node-sfng6
I0814 15:07:56.823036   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:56.823428   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-fln8k/test-mhc-dxcxd/test-mhc-machine-zg8m4/"
I0814 15:07:56.848184   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
inframachine created: test-mhc-machine-infra-j446t
machine created: test-mhc-machine-5l48d
I0814 15:07:56.874799   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:56.883566   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:56.889665   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
... skipping 265 lines ...
I0814 15:07:57.778062   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:57.782195   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:57.786354   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:57.788675   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:57.790916   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:57.793153   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
E0814 15:07:57.794904   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-mc8lk\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-mc8lk" "namespace"="test-mhc-whmwm"
I0814 15:07:57.795338   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:57.798353   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:57.801725   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:57.805339   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:57.808520   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:57.812241   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
... skipping 307 lines ...
I0814 15:07:58.828227   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:58.829447   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:58.831506   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:58.833050   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:58.838320   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:58.840889   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
E0814 15:07:58.841284   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-jdffg\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-jdffg" "namespace"="test-mhc-whmwm"
I0814 15:07:58.842599   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:58.843781   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:58.844835   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:58.861548   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:58.864933   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:58.881163   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
... skipping 276 lines ...
I0814 15:07:59.851057   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:59.852177   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:59.854436   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:59.856847   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:59.859099   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:59.862052   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
E0814 15:07:59.862586   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-mc8lk\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-mc8lk" "namespace"="test-mhc-whmwm"
I0814 15:07:59.863240   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:59.863610   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-fln8k/test-mhc-dxcxd/test-mhc-machine-5l48d/"
I0814 15:07:59.878706   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:59.879198   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-fln8k/test-mhc-dxcxd/test-mhc-machine-5l48d/"
E0814 15:07:59.887772   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-9cs4w, got []"  "node"="test-mhc-node-9cs4w"
node created: test-mhc-node-9cs4w
I0814 15:07:59.896225   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
inframachine created: test-mhc-machine-infra-fcpn8
I0814 15:07:59.942714   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:07:59.944535   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
machine created: test-mhc-machine-f4527
... skipping 177 lines ...
I0814 15:08:00.856117   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:00.867562   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:00.870247   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:00.872802   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:00.875311   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:00.877921   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
E0814 15:08:00.880430   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-jdffg\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-jdffg" "namespace"="test-mhc-whmwm"
I0814 15:08:00.880983   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:00.882591   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:00.884068   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:00.885697   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:00.887510   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:00.888973   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
... skipping 266 lines ...
I0814 15:08:01.903904   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:01.908978   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:01.911914   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:01.919147   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:01.926153   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:01.928944   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
E0814 15:08:01.931000   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-mc8lk\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-mc8lk" "namespace"="test-mhc-whmwm"
I0814 15:08:01.934524   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:01.937259   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:01.940276   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:01.943202   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:01.945734   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:01.971845   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
... skipping 214 lines ...
I0814 15:08:02.936607   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:02.942853   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:02.945394   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:02.947024   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:02.949836   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:02.954233   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:02.955334   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-fln8k/test-mhc-dxcxd/test-mhc-machine-f4527/"
E0814 15:08:02.962470   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-jdffg\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-jdffg" "namespace"="test-mhc-whmwm"
I0814 15:08:02.970299   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:02.971170   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-fln8k/test-mhc-dxcxd/test-mhc-machine-f4527/"
node created: test-mhc-node-smmz8
E0814 15:08:02.975132   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-smmz8, got []"  "node"="test-mhc-node-smmz8"
I0814 15:08:02.982553   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
Cleaning up nodes, machines and infra machines.
I0814 15:08:02.983267   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Condition Ready on node is reporting status Unknown for more than 5m0s" "reason"="UnhealthyNode" "target"="test-mhc-fln8k/test-mhc-dxcxd/test-mhc-machine-f4527/test-mhc-node-smmz8"
I0814 15:08:03.007445   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:03.008054   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="NodeNotFound" "target"="test-mhc-fln8k/test-mhc-dxcxd/test-mhc-machine-f4527/"
Cleaning up nodes, machines and infra machines.
I0814 15:08:03.026638   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:03.027214   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="NodeNotFound" "target"="test-mhc-fln8k/test-mhc-dxcxd/test-mhc-machine-zg8m4/"
I0814 15:08:03.055014   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="NodeNotFound" "target"="test-mhc-fln8k/test-mhc-dxcxd/test-mhc-machine-f4527/"
I0814 15:08:03.066596   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:03.067376   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="NodeNotFound" "target"="test-mhc-fln8k/test-mhc-dxcxd/test-mhc-machine-5l48d/"
I0814 15:08:03.088851   10559 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="test-cluster-q9ndw" "namespace"="test-mhc-fln8k" "count"=2
I0814 15:08:03.088941   10559 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-q9ndw" "namespace"="test-mhc-fln8k" "descendants"="Worker machines: test-mhc-machine-zg8m4,test-mhc-machine-5l48d,test-mhc-machine-f4527" "indirect descendants count"=1
I0814 15:08:03.093160   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="NodeNotFound" "target"="test-mhc-fln8k/test-mhc-dxcxd/test-mhc-machine-f4527/"
I0814 15:08:03.093640   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="NodeNotFound" "target"="test-mhc-fln8k/test-mhc-dxcxd/test-mhc-machine-zg8m4/"
=== RUN   TestMachineHealthCheck_Reconcile/it_marks_unhealthy_machines_for_remediation_when_the_unhealthy_Machines_exceed_MaxUnhealthy
I0814 15:08:03.095770   10559 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="test-cluster-q9ndw" "namespace"="test-mhc-fln8k" "count"=2
I0814 15:08:03.095824   10559 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-q9ndw" "namespace"="test-mhc-fln8k" "descendants"="Worker machines: test-mhc-machine-zg8m4,test-mhc-machine-5l48d,test-mhc-machine-f4527" "indirect descendants count"=1
E0814 15:08:03.100505   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machinehealthchecks.cluster.x-k8s.io \"test-mhc-dxcxd\" not found" "controller"="machinehealthcheck" "name"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k"
inframachine created: test-mhc-machine-infra-xkb5l
machine created: test-mhc-machine-q79ck
I0814 15:08:03.963874   10559 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-q9ndw" "machine"="test-mhc-machine-5l48d" "namespace"="test-mhc-fln8k" "cause"="cluster is being deleted" "node"={"name":"test-mhc-node-9cs4w"}
E0814 15:08:04.034252   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-5l48d\" not found" "controller"="machine" "name"="test-mhc-machine-5l48d" "namespace"="test-mhc-fln8k"
I0814 15:08:04.100952   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-dxcxd" "namespace"="test-mhc-fln8k" 
I0814 15:08:04.101098   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:04.124674   10559 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={}
I0814 15:08:04.145403   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:04.150512   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:04.171442   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:04.212496   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:04.293810   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:04.454976   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:04.779609   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
E0814 15:08:05.034667   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-mc8lk\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-mc8lk" "namespace"="test-mhc-whmwm"
I0814 15:08:05.421034   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:06.035221   10559 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-q9ndw" "machine"="test-mhc-machine-f4527" "namespace"="test-mhc-fln8k" "cause"="cluster is being deleted" "node"={"name":"test-mhc-node-smmz8"}
E0814 15:08:06.093682   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-f4527\" not found" "controller"="machine" "name"="test-mhc-machine-f4527" "namespace"="test-mhc-fln8k"
I0814 15:08:06.702182   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
E0814 15:08:07.094148   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-jdffg\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-jdffg" "namespace"="test-mhc-whmwm"
I0814 15:08:08.095209   10559 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-q9ndw" "machine"="test-mhc-machine-zg8m4" "namespace"="test-mhc-fln8k" "cause"="cluster is being deleted" "node"={"name":"test-mhc-node-sfng6"}
I0814 15:08:08.102522   10559 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="test-cluster-q9ndw" "namespace"="test-mhc-fln8k" "count"=1
I0814 15:08:08.102693   10559 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-q9ndw" "namespace"="test-mhc-fln8k" "descendants"="Worker machines: test-mhc-machine-zg8m4" "indirect descendants count"=0
E0814 15:08:08.146337   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-zg8m4\" not found" "controller"="machine" "name"="test-mhc-machine-zg8m4" "namespace"="test-mhc-fln8k"
E0814 15:08:09.168180   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-mc8lk\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-mc8lk" "namespace"="test-mhc-whmwm"
I0814 15:08:09.168843   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
E0814 15:08:09.177723   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-l5ndx, got []"  "node"="test-mhc-node-l5ndx"
node created: test-mhc-node-l5ndx
E0814 15:08:09.178394   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-l5ndx, got []"  "node"="test-mhc-node-l5ndx"
I0814 15:08:09.192187   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:09.193264   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
inframachine created: test-mhc-machine-infra-xxqmn
machine created: test-mhc-machine-56kh5
I0814 15:08:09.225580   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:09.242387   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:09.257712   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:09.279936   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:09.321390   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:09.403713   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:09.565086   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:09.886924   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
E0814 15:08:10.168651   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-jdffg\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-jdffg" "namespace"="test-mhc-whmwm"
I0814 15:08:10.528450   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:11.184044   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:11.193691   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:11.203079   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:11.223823   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:11.235333   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:11.251984   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:11.263266   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
E0814 15:08:11.265661   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-mc8lk\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-mc8lk" "namespace"="test-mhc-whmwm"
I0814 15:08:11.287861   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
E0814 15:08:11.334126   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-kxlt5, got []"  "node"="test-mhc-node-kxlt5"
node created: test-mhc-node-kxlt5
E0814 15:08:11.334853   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-kxlt5, got []"  "node"="test-mhc-node-kxlt5"
I0814 15:08:11.345021   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
inframachine created: test-mhc-machine-infra-n8ntb
machine created: test-mhc-machine-szvpn
I0814 15:08:11.376379   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:11.390909   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:11.398498   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:11.810370   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
E0814 15:08:12.266097   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-jdffg\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-jdffg" "namespace"="test-mhc-whmwm"
E0814 15:08:13.117166   10559 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-fln8k/test-cluster-q9ndw"
I0814 15:08:13.288850   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:13.309907   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:13.318727   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:13.334111   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:13.341933   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:13.349379   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:13.356315   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
E0814 15:08:13.356384   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-mc8lk\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-mc8lk" "namespace"="test-mhc-whmwm"
I0814 15:08:13.382602   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
node created: test-mhc-node-btdvw
E0814 15:08:13.392238   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-btdvw, got []"  "node"="test-mhc-node-btdvw"
Cleaning up nodes, machines and infra machines.
I0814 15:08:13.404707   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:13.417047   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
Cleaning up nodes, machines and infra machines.
I0814 15:08:13.477302   10559 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="test-cluster-scmls" "namespace"="test-mhc-hctjh" "count"=2
I0814 15:08:13.477415   10559 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-scmls" "namespace"="test-mhc-hctjh" "descendants"="Worker machines: test-mhc-machine-q79ck,test-mhc-machine-56kh5,test-mhc-machine-szvpn" "indirect descendants count"=1
... skipping 4 lines ...
machine created: test-mhc-machine-jjkbd
I0814 15:08:13.624990   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
I0814 15:08:13.639726   10559 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={}
I0814 15:08:13.763455   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-v46t2" "namespace"="test-mhc-hctjh" 
I0814 15:08:13.763525   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
I0814 15:08:13.769580   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
E0814 15:08:14.356803   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-jdffg\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-jdffg" "namespace"="test-mhc-whmwm"
I0814 15:08:15.357549   10559 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-scmls" "machine"="test-mhc-machine-q79ck" "namespace"="test-mhc-hctjh" "cause"="cluster is being deleted" "node"={"name":"test-mhc-node-l5ndx"}
E0814 15:08:15.424402   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-q79ck\" not found" "controller"="machine" "name"="test-mhc-machine-q79ck" "namespace"="test-mhc-hctjh"
I0814 15:08:16.425024   10559 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-scmls" "machine"="test-mhc-machine-56kh5" "namespace"="test-mhc-hctjh" "cause"="cluster is being deleted" "node"={"name":"test-mhc-node-kxlt5"}
E0814 15:08:16.491278   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-56kh5\" not found" "controller"="machine" "name"="test-mhc-machine-56kh5" "namespace"="test-mhc-hctjh"
I0814 15:08:17.492011   10559 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-scmls" "machine"="test-mhc-machine-szvpn" "namespace"="test-mhc-hctjh" "cause"="cluster is being deleted" "node"={"name":"test-mhc-node-btdvw"}
E0814 15:08:17.599561   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-szvpn\" not found" "controller"="machine" "name"="test-mhc-machine-szvpn" "namespace"="test-mhc-hctjh"
E0814 15:08:18.508895   10559 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-hctjh/test-cluster-scmls"
I0814 15:08:18.610347   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
I0814 15:08:18.613862   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
E0814 15:08:18.614964   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-mc8lk\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-mc8lk" "namespace"="test-mhc-whmwm"
E0814 15:08:18.648277   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-hkjkp, got []"  "node"="test-mhc-node-hkjkp"
node created: test-mhc-node-hkjkp
I0814 15:08:18.656195   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
inframachine created: test-mhc-machine-infra-7vjp4
machine created: test-mhc-machine-bn5bp
I0814 15:08:18.681122   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
I0814 15:08:18.691172   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
E0814 15:08:19.617069   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-jdffg\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-jdffg" "namespace"="test-mhc-whmwm"
I0814 15:08:20.633436   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
I0814 15:08:20.650472   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
I0814 15:08:20.666488   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
I0814 15:08:20.679546   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
I0814 15:08:20.695099   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
I0814 15:08:20.697201   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
I0814 15:08:20.710927   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
I0814 15:08:20.738121   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
I0814 15:08:20.752155   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
I0814 15:08:20.759008   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
I0814 15:08:20.785236   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
node created: test-mhc-node-fr7sm
E0814 15:08:20.799352   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-fr7sm, got []"  "node"="test-mhc-node-fr7sm"
I0814 15:08:20.810034   10559 machine_controller_noderef.go:86] controllers/Machine "msg"="Set Machine's NodeRef" "machine"="test-mhc-machine-bn5bp" "namespace"="test-mhc-b9nnz" "noderef"="test-mhc-node-fr7sm"
I0814 15:08:20.814074   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
inframachine created: test-mhc-machine-infra-6z6jh
machine created: test-mhc-machine-gpp2t
I0814 15:08:20.972134   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
I0814 15:08:20.981640   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
Cleaning up nodes, machines and infra machines.
I0814 15:08:20.996898   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
I0814 15:08:20.997021   10559 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-n562p" "machine"="test-mhc-machine-gpp2t" "namespace"="test-mhc-b9nnz" "cause"="noderef is nil" "node"=null
I0814 15:08:21.005387   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
Cleaning up nodes, machines and infra machines.
I0814 15:08:21.021911   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
I0814 15:08:21.022605   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="NodeNotFound" "target"="test-mhc-b9nnz/test-mhc-ptx28/test-mhc-machine-jjkbd/"
E0814 15:08:21.055320   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-gpp2t\" not found" "controller"="machine" "name"="test-mhc-machine-gpp2t" "namespace"="test-mhc-b9nnz"
I0814 15:08:21.064330   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
I0814 15:08:21.065708   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="NodeNotFound" "target"="test-mhc-b9nnz/test-mhc-ptx28/test-mhc-machine-jjkbd/"
I0814 15:08:21.066207   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="NodeNotFound" "target"="test-mhc-b9nnz/test-mhc-ptx28/test-mhc-machine-bn5bp/"
I0814 15:08:21.071877   10559 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="test-cluster-n562p" "namespace"="test-mhc-b9nnz" "count"=2
I0814 15:08:21.071966   10559 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-n562p" "namespace"="test-mhc-b9nnz" "descendants"="Worker machines: test-mhc-machine-jjkbd,test-mhc-machine-bn5bp" "indirect descendants count"=0
I0814 15:08:21.079253   10559 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="test-cluster-n562p" "namespace"="test-mhc-b9nnz" "count"=2
I0814 15:08:21.079323   10559 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-n562p" "namespace"="test-mhc-b9nnz" "descendants"="Worker machines: test-mhc-machine-jjkbd,test-mhc-machine-bn5bp" "indirect descendants count"=0
=== RUN   TestMachineHealthCheck_Reconcile/when_a_Machine_has_no_Node_ref_for_longer_than_the_NodeStartupTimeout
=== RUN   TestMachineHealthCheck_Reconcile/when_a_Machine's_Node_has_gone_away
=== RUN   TestMachineHealthCheck_Reconcile/should_react_when_a_Node_transitions_to_unhealthy
E0814 15:08:21.102454   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machinehealthchecks.cluster.x-k8s.io \"test-mhc-ptx28\" not found" "controller"="machinehealthcheck" "name"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz"
inframachine created: test-mhc-machine-infra-7982k
machine created: test-mhc-machine-lr9cj
I0814 15:08:22.055920   10559 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-n562p" "machine"="test-mhc-machine-jjkbd" "namespace"="test-mhc-b9nnz" "cause"="cluster is being deleted" "node"={"name":"test-mhc-node-hkjkp"}
I0814 15:08:22.102866   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ptx28" "namespace"="test-mhc-b9nnz" 
I0814 15:08:22.102989   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
E0814 15:08:22.107158   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-jjkbd\" not found" "controller"="machine" "name"="test-mhc-machine-jjkbd" "namespace"="test-mhc-b9nnz"
I0814 15:08:22.123173   10559 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={}
I0814 15:08:22.248488   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:22.249772   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:22.253574   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:22.255619   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:22.257843   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
... skipping 365 lines ...
I0814 15:08:23.162763   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:23.164528   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:23.166350   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:23.168163   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:23.170236   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:23.172017   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
E0814 15:08:23.176130   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-bn5bp\" not found" "controller"="machine" "name"="test-mhc-machine-bn5bp" "namespace"="test-mhc-b9nnz"
I0814 15:08:23.177524   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:23.179433   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:23.181245   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:23.183094   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:23.184899   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:23.186683   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
... skipping 447 lines ...
I0814 15:08:24.194377   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:24.196261   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:24.198052   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:24.201567   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:24.204094   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:24.206018   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
E0814 15:08:24.206219   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-mc8lk\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-mc8lk" "namespace"="test-mhc-whmwm"
I0814 15:08:24.206316   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-5fcks/test-mhc-lz8fb/test-mhc-machine-lr9cj/"
I0814 15:08:24.225977   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:24.226528   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-5fcks/test-mhc-lz8fb/test-mhc-machine-lr9cj/"
E0814 15:08:24.299354   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-6x27f, got []"  "node"="test-mhc-node-6x27f"
node created: test-mhc-node-6x27f
E0814 15:08:24.299516   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-6x27f, got []"  "node"="test-mhc-node-6x27f"
I0814 15:08:24.314489   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:24.349194   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:24.360547   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:24.360939   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Condition Ready on node is reporting status Unknown for more than 5m0s" "reason"="UnhealthyNode" "target"="test-mhc-5fcks/test-mhc-lz8fb/test-mhc-machine-lr9cj/test-mhc-node-6x27f"
Cleaning up nodes, machines and infra machines.
I0814 15:08:24.393906   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:24.394338   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Condition Ready on node is reporting status Unknown for more than 5m0s" "reason"="UnhealthyNode" "target"="test-mhc-5fcks/test-mhc-lz8fb/test-mhc-machine-lr9cj/test-mhc-node-6x27f"
I0814 15:08:24.400304   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:24.400703   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="NodeNotFound" "target"="test-mhc-5fcks/test-mhc-lz8fb/test-mhc-machine-lr9cj/"
I0814 15:08:24.428469   10559 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-9ltt4" "namespace"="test-mhc-5fcks" "descendants"="Worker machines: test-mhc-machine-lr9cj" "indirect descendants count"=1
I0814 15:08:24.437735   10559 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-9ltt4" "namespace"="test-mhc-5fcks" "descendants"="Worker machines: test-mhc-machine-lr9cj" "indirect descendants count"=1
=== RUN   TestMachineHealthCheck_Reconcile/when_in_a_MachineSet,_unhealthy_machines_should_be_deleted
I0814 15:08:24.575837   10559 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="mhc-ms-tzznj" "namespace"="test-mhc-mgcll" "creating"=1 "need"=1
I0814 15:08:24.575887   10559 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 1, ( spec.replicas(1) \u003e currentMachineCount(0) )" "machineset"="mhc-ms-tzznj" "namespace"="test-mhc-mgcll" 
I0814 15:08:24.586125   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lz8fb" "namespace"="test-mhc-5fcks" 
I0814 15:08:24.590010   10559 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 1 with name \"mhc-ms-tzznj-k8rht\"" "machineset"="mhc-ms-tzznj" "namespace"="test-mhc-mgcll" 
I0814 15:08:24.664207   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-qsdnl" "namespace"="test-mhc-mgcll" 
I0814 15:08:24.693261   10559 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={}
I0814 15:08:24.819636   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-qsdnl" "namespace"="test-mhc-mgcll" 
E0814 15:08:25.206682   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-jdffg\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-jdffg" "namespace"="test-mhc-whmwm"
I0814 15:08:25.819934   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-qsdnl" "namespace"="test-mhc-mgcll" 
E0814 15:08:26.111128   10559 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-b9nnz/test-cluster-n562p"
I0814 15:08:26.207248   10559 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-9ltt4" "machine"="test-mhc-machine-lr9cj" "namespace"="test-mhc-5fcks" "cause"="cluster is being deleted" "node"={"name":"test-mhc-node-6x27f"}
E0814 15:08:26.272241   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-lr9cj\" not found" "controller"="machine" "name"="test-mhc-machine-lr9cj" "namespace"="test-mhc-5fcks"
I0814 15:08:26.821163   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-qsdnl" "namespace"="test-mhc-mgcll" 
I0814 15:08:27.282662   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-qsdnl" "namespace"="test-mhc-mgcll" 
I0814 15:08:27.283659   10559 machineset_controller.go:139] controllers/MachineSet "msg"="Reconciliation is paused for this object" "machineset"="mhc-ms-tzznj" "namespace"="test-mhc-mgcll" 
I0814 15:08:27.299359   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-qsdnl" "namespace"="test-mhc-mgcll" 
I0814 15:08:27.300183   10559 machineset_controller.go:139] controllers/MachineSet "msg"="Reconciliation is paused for this object" "machineset"="mhc-ms-tzznj" "namespace"="test-mhc-mgcll" 
I0814 15:08:27.325530   10559 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="mhc-ms-tzznj-k8rht" "namespace"="test-mhc-mgcll" 
... skipping 5 lines ...
I0814 15:08:27.357867   10559 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="mhc-ms-tzznj-k8rht" "namespace"="test-mhc-mgcll" 
I0814 15:08:27.357931   10559 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="mhc-ms-tzznj-k8rht" "namespace"="test-mhc-mgcll" 
I0814 15:08:27.823462   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-qsdnl" "namespace"="test-mhc-mgcll" 
I0814 15:08:28.350550   10559 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="mhc-ms-tzznj-k8rht" "namespace"="test-mhc-mgcll" 
I0814 15:08:28.350602   10559 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="mhc-ms-tzznj-k8rht" "namespace"="test-mhc-mgcll" 
I0814 15:08:29.000685   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-qsdnl" "namespace"="test-mhc-mgcll" 
I0814 15:08:29.001172   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1s" "reason"="NodeStartupTimeout" "target"="test-mhc-mgcll/test-mhc-qsdnl/mhc-ms-tzznj-k8rht/"
I0814 15:08:29.008229   10559 machineset_controller.go:139] controllers/MachineSet "msg"="Reconciliation is paused for this object" "machineset"="mhc-ms-tzznj" "namespace"="test-mhc-mgcll" 
I0814 15:08:29.013598   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-qsdnl" "namespace"="test-mhc-mgcll" 
I0814 15:08:29.014019   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1s" "reason"="NodeStartupTimeout" "target"="test-mhc-mgcll/test-mhc-qsdnl/mhc-ms-tzznj-k8rht/"
I0814 15:08:29.015494   10559 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="mhc-ms-tzznj-k8rht" "namespace"="test-mhc-mgcll" 
I0814 15:08:29.015548   10559 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="mhc-ms-tzznj-k8rht" "namespace"="test-mhc-mgcll" 
I0814 15:08:29.031658   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-qsdnl" "namespace"="test-mhc-mgcll" 
I0814 15:08:29.034920   10559 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="test-cluster-l2942" "namespace"="test-mhc-mgcll" "count"=1
I0814 15:08:29.035011   10559 cluster_controller.go:241] controllers/Cluster "msg"="Deleting child" "cluster"="test-cluster-l2942" "namespace"="test-mhc-mgcll" "gvk"="cluster.x-k8s.io/v1alpha3, Kind=MachineSet" "name"="mhc-ms-tzznj"
I0814 15:08:29.038019   10559 machineset_controller.go:237] controllers/MachineSet "msg"="Deleting unhealthy machine" "machineset"="mhc-ms-tzznj" "namespace"="test-mhc-mgcll" "machine"="mhc-ms-tzznj-k8rht"
I0814 15:08:29.040431   10559 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1s" "reason"="NodeStartupTimeout" "target"="test-mhc-mgcll/test-mhc-qsdnl/mhc-ms-tzznj-k8rht/"
I0814 15:08:29.046864   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-qsdnl" "namespace"="test-mhc-mgcll" 
I0814 15:08:29.058870   10559 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-l2942" "namespace"="test-mhc-mgcll" "descendants"="Machine sets: mhc-ms-tzznj;Worker machines: mhc-ms-tzznj-k8rht" "indirect descendants count"=1
I0814 15:08:29.073899   10559 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-l2942" "namespace"="test-mhc-mgcll" "descendants"="Worker machines: mhc-ms-tzznj-k8rht" "indirect descendants count"=1
=== RUN   TestMachineHealthCheck_Reconcile/when_a_machine_is_paused
=== RUN   TestMachineHealthCheck_Reconcile/When_remediationTemplate_is_set_and_node_transitions_to_unhealthy,_new_Remediation_Request_should_be_created
I0814 15:08:29.077954   10559 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="mhc-ms-tzznj-k8rht" "namespace"="test-mhc-mgcll" 
I0814 15:08:29.077993   10559 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="mhc-ms-tzznj-k8rht" "namespace"="test-mhc-mgcll" 
I0814 15:08:29.078759   10559 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-l2942" "machine"="mhc-ms-tzznj-k8rht" "namespace"="test-mhc-mgcll" "cause"="cluster is being deleted" "node"=null
I0814 15:08:29.139942   10559 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-l2942" "machine"="mhc-ms-tzznj-k8rht" "namespace"="test-mhc-mgcll" "cause"="cluster is being deleted" "node"=null
I0814 15:08:29.185249   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
E0814 15:08:29.192073   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"mhc-ms-tzznj-k8rht\" not found" "controller"="machine" "name"="mhc-ms-tzznj-k8rht" "namespace"="test-mhc-mgcll"
inframachine created: test-mhc-machine-infra-vqkrv
I0814 15:08:29.201733   10559 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={}
machine created: test-mhc-machine-fclsm
I0814 15:08:29.328619   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:29.329844   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:29.331861   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
... skipping 36 lines ...
I0814 15:08:29.446952   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:29.449110   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:29.451287   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:29.453445   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:29.455330   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:29.457468   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
E0814 15:08:29.457891   10559 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-5fcks/test-cluster-9ltt4"
I0814 15:08:29.460537   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:29.462954   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:29.466955   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:29.469847   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:29.472797   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:29.474872   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
... skipping 304 lines ...
I0814 15:08:30.200776   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:30.202388   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:30.203035   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:30.204719   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:30.206601   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:30.208536   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
E0814 15:08:30.208777   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-mc8lk\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-mc8lk" "namespace"="test-mhc-whmwm"
I0814 15:08:30.209893   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
E0814 15:08:30.236030   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-zrbdq, got []"  "node"="test-mhc-node-zrbdq"
node created: test-mhc-node-zrbdq
E0814 15:08:30.236969   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-zrbdq, got []"  "node"="test-mhc-node-zrbdq"
I0814 15:08:30.368649   10559 machinehealthcheck_controller.go:379] controllers/MachineHealthCheck "msg"="Target has failed health check, creating an external remediation request"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "remediation request name"="test-mhc-machine-fclsm" "target"="test-mhc-6zl92/test-mhc-jv5fp/test-mhc-machine-fclsm/"
I0814 15:08:30.389964   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:30.413629   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:30.416362   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:30.424675   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:30.430112   10559 machinehealthcheck_controller.go:379] controllers/MachineHealthCheck "msg"="Target has failed health check, creating an external remediation request"  "message"="Condition Ready on node is reporting status Unknown for more than 5m0s" "reason"="UnhealthyNode" "remediation request name"="test-mhc-machine-fclsm" "target"="test-mhc-6zl92/test-mhc-jv5fp/test-mhc-machine-fclsm/test-mhc-node-zrbdq"
I0814 15:08:30.460888   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
Cleaning up nodes, machines and infra machines.
I0814 15:08:30.480662   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:30.484113   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:30.487916   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-jv5fp" "namespace"="test-mhc-6zl92" 
I0814 15:08:30.500351   10559 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-5dknh" "namespace"="test-mhc-6zl92" "descendants"="Worker machines: test-mhc-machine-fclsm" "indirect descendants count"=1
... skipping 277 lines ...
I0814 15:08:31.265729   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:31.267800   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:31.269722   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:31.271713   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:31.273660   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:31.278127   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
E0814 15:08:31.278480   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-fclsm\" not found" "controller"="machine" "name"="test-mhc-machine-fclsm" "namespace"="test-mhc-6zl92"
I0814 15:08:31.280218   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:31.289637   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:31.291699   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:31.298286   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:31.300225   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:31.310054   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
... skipping 410 lines ...
I0814 15:08:32.267558   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:32.269421   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:32.271299   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:32.273214   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:32.275345   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:32.277458   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
E0814 15:08:32.278855   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-jdffg\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-jdffg" "namespace"="test-mhc-whmwm"
I0814 15:08:32.279436   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:32.281483   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:32.283786   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:32.285836   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:32.287755   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:32.289702   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
... skipping 423 lines ...
I0814 15:08:33.280900   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:33.283155   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:33.284963   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:33.288651   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:33.289641   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:33.292397   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:33.306583   10559 machinehealthcheck_controller.go:379] controllers/MachineHealthCheck "msg"="Target has failed health check, creating an external remediation request"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "remediation request name"="test-mhc-machine-xdmlr" "target"="test-mhc-96hjv/test-mhc-bzznk/test-mhc-machine-xdmlr/"
I0814 15:08:33.322279   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
E0814 15:08:33.330684   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-jrkkr, got []"  "node"="test-mhc-node-jrkkr"
E0814 15:08:33.330684   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-jrkkr, got []"  "node"="test-mhc-node-jrkkr"
node created: test-mhc-node-jrkkr
E0814 15:08:33.331750   10559 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-jrkkr, got []"  "node"="test-mhc-node-jrkkr"
I0814 15:08:33.339738   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:33.396804   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:33.405196   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:33.411718   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:33.416699   10559 machinehealthcheck_controller.go:379] controllers/MachineHealthCheck "msg"="Target has failed health check, creating an external remediation request"  "message"="Condition Ready on node is reporting status Unknown for more than 5m0s" "reason"="UnhealthyNode" "remediation request name"="test-mhc-machine-xdmlr" "target"="test-mhc-96hjv/test-mhc-bzznk/test-mhc-machine-xdmlr/test-mhc-node-jrkkr"
I0814 15:08:33.443931   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:33.448876   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:33.485822   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
Cleaning up nodes, machines and infra machines.
I0814 15:08:33.497246   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
I0814 15:08:33.508266   10559 machinehealthcheck_controller.go:379] controllers/MachineHealthCheck "msg"="Target has failed health check, creating an external remediation request"  "message"="" "reason"="NodeNotFound" "remediation request name"="test-mhc-machine-xdmlr" "target"="test-mhc-96hjv/test-mhc-bzznk/test-mhc-machine-xdmlr/"
I0814 15:08:33.546875   10559 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="test-cluster-k6w6n" "namespace"="test-mhc-96hjv" "count"=1
I0814 15:08:33.547010   10559 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-k6w6n" "namespace"="test-mhc-96hjv" "descendants"="Worker machines: test-mhc-machine-xdmlr" "indirect descendants count"=0
I0814 15:08:33.556951   10559 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-k6w6n" "machine"="test-mhc-machine-xdmlr" "namespace"="test-mhc-96hjv" "cause"="cluster is being deleted" "node"={"name":"test-mhc-node-jrkkr"}
I0814 15:08:33.563829   10559 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="test-cluster-k6w6n" "namespace"="test-mhc-96hjv" "count"=1
I0814 15:08:33.563889   10559 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-k6w6n" "namespace"="test-mhc-96hjv" "descendants"="Worker machines: test-mhc-machine-xdmlr" "indirect descendants count"=0
--- PASS: TestMachineHealthCheck_Reconcile (42.06s)
... skipping 15 lines ...
    --- SKIP: TestMachineHealthCheck_Reconcile/when_a_machine_is_paused (0.00s)
        machinehealthcheck_controller_test.go:933: skipping until made stable
    --- PASS: TestMachineHealthCheck_Reconcile/When_remediationTemplate_is_set_and_node_transitions_to_unhealthy,_new_Remediation_Request_should_be_created (1.43s)
    --- PASS: TestMachineHealthCheck_Reconcile/When_remediationTemplate_is_set_and_node_transitions_back_to_healthy,_new_Remediation_Request_should_be_deleted (3.07s)
=== RUN   TestClusterToMachineHealthCheck
=== RUN   TestClusterToMachineHealthCheck/when_the_object_passed_isn't_a_cluster
E0814 15:08:33.577759   10559 machinehealthcheck_controller.go:416]  "msg"="expected a Cluster" "error"="incorrect type"  "type"="handler.MapObject"
=== RUN   TestClusterToMachineHealthCheck/when_a_MachineHealthCheck_exists_for_the_Cluster_in_the_same_namespace
=== RUN   TestClusterToMachineHealthCheck/when_2_MachineHealthChecks_exists_for_the_Cluster_in_the_same_namespace
=== RUN   TestClusterToMachineHealthCheck/when_a_MachineHealthCheck_exists_for_another_Cluster_in_the_same_namespace
=== RUN   TestClusterToMachineHealthCheck/when_a_MachineHealthCheck_exists_for_another_Cluster_in_another_namespace
--- PASS: TestClusterToMachineHealthCheck (0.00s)
    --- PASS: TestClusterToMachineHealthCheck/when_the_object_passed_isn't_a_cluster (0.00s)
    --- PASS: TestClusterToMachineHealthCheck/when_a_MachineHealthCheck_exists_for_the_Cluster_in_the_same_namespace (0.00s)
    --- PASS: TestClusterToMachineHealthCheck/when_2_MachineHealthChecks_exists_for_the_Cluster_in_the_same_namespace (0.00s)
    --- PASS: TestClusterToMachineHealthCheck/when_a_MachineHealthCheck_exists_for_another_Cluster_in_the_same_namespace (0.00s)
    --- PASS: TestClusterToMachineHealthCheck/when_a_MachineHealthCheck_exists_for_another_Cluster_in_another_namespace (0.00s)
=== RUN   TestMachineToMachineHealthCheck
=== RUN   TestMachineToMachineHealthCheck/when_the_object_passed_isn't_a_machine
E0814 15:08:33.580345   10559 machinehealthcheck_controller.go:445]  "msg"="expected a Machine" "error"="incorrect type"  "type"="handler.MapObject"
=== RUN   TestMachineToMachineHealthCheck/when_a_MachineHealthCheck_matches_labels_for_the_Machine_in_the_same_namespace
=== RUN   TestMachineToMachineHealthCheck/when_2_MachineHealthChecks_match_labels_for_the_Machine_in_the_same_namespace
=== RUN   TestMachineToMachineHealthCheck/when_a_MachineHealthCheck_does_not_match_labels_for_the_Machine_in_the_same_namespace
=== RUN   TestMachineToMachineHealthCheck/when_a_MachineHealthCheck_matches_labels_for_the_Machine_in_another_namespace
--- PASS: TestMachineToMachineHealthCheck (0.00s)
    --- PASS: TestMachineToMachineHealthCheck/when_the_object_passed_isn't_a_machine (0.00s)
    --- PASS: TestMachineToMachineHealthCheck/when_a_MachineHealthCheck_matches_labels_for_the_Machine_in_the_same_namespace (0.00s)
    --- PASS: TestMachineToMachineHealthCheck/when_2_MachineHealthChecks_match_labels_for_the_Machine_in_the_same_namespace (0.00s)
    --- PASS: TestMachineToMachineHealthCheck/when_a_MachineHealthCheck_does_not_match_labels_for_the_Machine_in_the_same_namespace (0.00s)
    --- PASS: TestMachineToMachineHealthCheck/when_a_MachineHealthCheck_matches_labels_for_the_Machine_in_another_namespace (0.00s)
=== RUN   TestNodeToMachineHealthCheck
=== RUN   TestNodeToMachineHealthCheck/when_the_object_passed_isn't_a_Node
E0814 15:08:33.582467   10559 machinehealthcheck_controller.go:474]  "msg"="expected a Node" "error"="incorrect type"  "type"="handler.MapObject"
=== RUN   TestNodeToMachineHealthCheck/when_no_Machine_exists_for_the_Node
E0814 15:08:33.582785   10559 machinehealthcheck_controller.go:480]  "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node node1, got []"  "node"="node1"
=== RUN   TestNodeToMachineHealthCheck/when_two_Machines_exist_for_the_Node
E0814 15:08:33.583338   10559 machinehealthcheck_controller.go:480]  "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node node1, got [machine1 machine2]"  "node"="node1"
=== RUN   TestNodeToMachineHealthCheck/when_no_MachineHealthCheck_exists_for_the_Node_in_the_Machine's_namespace
=== RUN   TestNodeToMachineHealthCheck/when_a_MachineHealthCheck_exists_for_the_Node_in_the_Machine's_namespace
=== RUN   TestNodeToMachineHealthCheck/when_two_MachineHealthChecks_exist_for_the_Node_in_the_Machine's_namespace
=== RUN   TestNodeToMachineHealthCheck/when_a_MachineHealthCheck_exists_for_the_Node,_but_not_in_the_Machine's_cluster
--- PASS: TestNodeToMachineHealthCheck (0.01s)
    --- PASS: TestNodeToMachineHealthCheck/when_the_object_passed_isn't_a_Node (0.00s)
... skipping 31 lines ...
    --- PASS: TestGetMaxUnhealthy/when_maxUnhealthy_is_nil (0.00s)
    --- PASS: TestGetMaxUnhealthy/when_maxUnhealthy_is_not_an_int_or_percentage (0.00s)
    --- PASS: TestGetMaxUnhealthy/when_maxUnhealthy_is_an_int (0.00s)
    --- PASS: TestGetMaxUnhealthy/when_maxUnhealthy_is_a_40%_(of_5) (0.00s)
    --- PASS: TestGetMaxUnhealthy/when_maxUnhealthy_is_a_60%_(of_7) (0.00s)
=== RUN   TestPatchTargets
I0814 15:08:33.589071   10559 machinehealthcheck_controller.go:387]  "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="" "target"="default/mhc/machine1/"
I0814 15:08:33.589745   10559 machinehealthcheck_controller.go:387]  "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="" "target"="default/mhc/machine2/"
E0814 15:08:33.591707   10559 machinehealthcheck_controller.go:320]  "msg"="failed to patch healthy machine status for machine" "error"="machines.cluster.x-k8s.io \"machine1\" not found"  "machine"="machine1"
--- PASS: TestPatchTargets (0.00s)
=== RUN   TestGetTargetsFromMHC
=== RUN   TestGetTargetsFromMHC/with_no_matching_machines
=== RUN   TestGetTargetsFromMHC/when_a_machine's_node_is_missing
=== RUN   TestGetTargetsFromMHC/when_a_machine's_labels_do_not_match_the_selector
=== RUN   TestGetTargetsFromMHC/with_multiple_machines,_should_match_correct_nodes
... skipping 26 lines ...
--- PASS: TestMachineSetOwnerReference (0.00s)
    --- PASS: TestMachineSetOwnerReference/should_add_cluster_owner_reference_to_machine_set (0.00s)
    --- PASS: TestMachineSetOwnerReference/should_not_add_cluster_owner_reference_if_machine_is_owned_by_a_machine_deployment (0.00s)
=== RUN   TestMachineSetReconcile
=== RUN   TestMachineSetReconcile/ignore_machine_sets_marked_for_deletion
=== RUN   TestMachineSetReconcile/records_event_if_reconcile_fails
E0814 15:08:33.616504   10559 machineset_controller.go:151]  "msg"="Failed to reconcile MachineSet" "error"="failed to calculate MachineSet's Status: failed to calculate status for MachineSet default/machineset1: invalid label key \"--$-invalid\": name part must consist of alphanumeric characters, '-', '_' or '.', and must start and end with an alphanumeric character (e.g. 'MyName',  or 'my.name',  or '123-abc', regex used for validation is '([A-Za-z0-9][-A-Za-z0-9_.]*)?[A-Za-z0-9]')" "machineset"="machineset1" "namespace"="default" 
--- PASS: TestMachineSetReconcile (0.00s)
    --- PASS: TestMachineSetReconcile/ignore_machine_sets_marked_for_deletion (0.00s)
    --- PASS: TestMachineSetReconcile/records_event_if_reconcile_fails (0.00s)
=== RUN   TestMachineSetToMachines
=== RUN   TestMachineSetToMachines/should_return_empty_request_when_controller_is_set
=== RUN   TestMachineSetToMachines/should_return_nil_if_machine_has_no_owner_reference
... skipping 8 lines ...
--- PASS: TestAdoptOrphan (0.01s)
=== RUN   TestHasMatchingLabels
=== RUN   TestHasMatchingLabels/machine_set_and_machine_have_matching_labels
=== RUN   TestHasMatchingLabels/machine_set_and_machine_do_not_have_matching_labels
=== RUN   TestHasMatchingLabels/machine_set_has_empty_selector
=== RUN   TestHasMatchingLabels/machine_set_has_bad_selector
E0814 15:08:33.626104   10559 machineset_controller.go:569]  "msg"="Unable to convert selector" "error"="\"bad-operator\" is not a valid pod selector operator" "machine"="match" "machineset"="" "namespace"="" 
--- PASS: TestHasMatchingLabels (0.00s)
    --- PASS: TestHasMatchingLabels/machine_set_and_machine_have_matching_labels (0.00s)
    --- PASS: TestHasMatchingLabels/machine_set_and_machine_do_not_have_matching_labels (0.00s)
    --- PASS: TestHasMatchingLabels/machine_set_has_empty_selector (0.00s)
    --- PASS: TestHasMatchingLabels/machine_set_has_bad_selector (0.00s)
=== RUN   TestMachineToDelete
... skipping 57 lines ...
=== RUN   TestGinkgoSuite
Running Suite: Controllers Suite
================================
Random Seed: 1660489654
Will run 16 of 16 specs

E0814 15:08:33.640960   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-xdmlr\" not found" "controller"="machine" "name"="test-mhc-machine-xdmlr" "namespace"="test-mhc-96hjv"
E0814 15:08:33.660446   10559 machinehealthcheck_controller.go:167] controllers/MachineHealthCheck "msg"="Failed to reconcile MachineHealthCheck" "error"="failed to patch unhealthy machine status for machine: test-mhc-96hjv/test-mhc-machine-xdmlr: [Machine.cluster.x-k8s.io \"test-mhc-machine-xdmlr\" not found, machines.cluster.x-k8s.io \"test-mhc-machine-xdmlr\" not found]" "cluster"="test-cluster-k6w6n" 
E0814 15:08:33.663206   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="[failed to patch unhealthy machine status for machine: test-mhc-96hjv/test-mhc-machine-xdmlr: [Machine.cluster.x-k8s.io \"test-mhc-machine-xdmlr\" not found, machines.cluster.x-k8s.io \"test-mhc-machine-xdmlr\" not found], machinehealthchecks.cluster.x-k8s.io \"test-mhc-bzznk\" not found]" "controller"="machinehealthcheck" "name"="test-mhc-bzznk" "namespace"="test-mhc-96hjv"
I0814 15:08:33.758493   10559 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="ms-m2wbw" "namespace"="ms-test" "creating"=2 "need"=2
I0814 15:08:33.758550   10559 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 2, ( spec.replicas(2) \u003e currentMachineCount(0) )" "machineset"="ms-m2wbw" "namespace"="ms-test" 
I0814 15:08:33.781782   10559 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 2 with name \"ms-m2wbw-hctr9\"" "machineset"="ms-m2wbw" "namespace"="ms-test" 
I0814 15:08:33.781875   10559 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 2 of 2, ( spec.replicas(2) \u003e currentMachineCount(0) )" "machineset"="ms-m2wbw" "namespace"="ms-test" 
I0814 15:08:33.806196   10559 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 2 of 2 with name \"ms-m2wbw-4kxbr\"" "machineset"="ms-m2wbw" "namespace"="ms-test" 
E0814 15:08:34.092718   10559 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-mgcll/test-cluster-l2942"
I0814 15:08:34.663879   10559 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-bzznk" "namespace"="test-mhc-96hjv" 
E0814 15:08:34.687848   10559 machine_controller_noderef.go:73] controllers/Machine "msg"="Failed to retrieve Node by ProviderID" "error"="the cache is not started, can not read objects" "machine"="ms-m2wbw-hctr9" "namespace"="ms-test" 
E0814 15:08:34.723353   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="the cache is not started, can not read objects" "controller"="machine" "name"="ms-m2wbw-hctr9" "namespace"="ms-test"
E0814 15:08:35.518638   10559 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-6zl92/test-cluster-5dknh"
E0814 15:08:38.575319   10559 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-96hjv/test-cluster-k6w6n"
E0814 15:08:40.449256   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-mc8lk\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-mc8lk" "namespace"="test-mhc-whmwm"
E0814 15:08:42.519289   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-jdffg\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-jdffg" "namespace"="test-mhc-whmwm"
E0814 15:08:43.806685   10559 machineset_controller.go:476] controllers/MachineSet "msg"="Failed waiting for machine object to be created" "error"="timed out waiting for the condition"  
E0814 15:08:43.810858   10559 machineset_controller.go:151] controllers/MachineSet "msg"="Failed to reconcile MachineSet" "error"="failed to sync MachineSet replicas: failed waiting for machine object to be created: timed out waiting for the condition" "machineset"="ms-m2wbw" "namespace"="ms-test" 
E0814 15:08:43.810956   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to sync MachineSet replicas: failed waiting for machine object to be created: timed out waiting for the condition" "controller"="machineset" "name"="ms-m2wbw" "namespace"="ms-test"
I0814 15:08:44.818743   10559 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="ms-m2wbw" "namespace"="ms-test" "creating"=1 "need"=2
I0814 15:08:44.818784   10559 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 1, ( spec.replicas(2) \u003e currentMachineCount(1) )" "machineset"="ms-m2wbw" "namespace"="ms-test" 
I0814 15:08:44.834450   10559 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 1 with name \"ms-m2wbw-clj8v\"" "machineset"="ms-m2wbw" "namespace"="ms-test" 
I0814 15:08:44.856082   10559 machine_controller_phases.go:219] controllers/Machine "msg"="Bootstrap provider is not ready, requeuing" "machine"="ms-m2wbw-clj8v" "namespace"="ms-test" 
I0814 15:08:44.862049   10559 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="ms-m2wbw-clj8v" "namespace"="ms-test" 
I0814 15:08:44.862102   10559 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="ms-m2wbw-clj8v" "namespace"="ms-test" 
... skipping 33 lines ...
I0814 15:08:45.346807   10559 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="machine-test" "namespace"="default" "err"="cannot create a metadata client without a rest config"
•I0814 15:08:45.348332   10559 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="machine-test" "namespace"="default" "err"="cannot create a metadata client without a rest config"
I0814 15:08:45.348999   10559 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="machine-test" "namespace"="default" "err"="cannot create a metadata client without a rest config"
I0814 15:08:45.349703   10559 machine_controller_phases.go:278]  "msg"="Infrastructure provider is not ready, requeuing" "machine"="machine-test" "namespace"="default" 
I0814 15:08:45.349734   10559 machine_controller_noderef.go:45]  "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="machine-test" "namespace"="default" 
•I0814 15:08:45.350246   10559 machine_controller.go:327]  "msg"="Draining node" "cluster"="test-cluster" "machine"="machine-test" "namespace"="default" "node"="machine-test-node"
E0814 15:08:45.351453   10559 machine_controller.go:494]  "msg"="Error creating a remote client while deleting Machine, won't retry" "error"="failed to create REST configuration for Cluster default/test-cluster: invalid configuration: no configuration has been provided" "cluster"="test-cluster" "machine"="machine-test" "namespace"="default" "node"="machine-test-node" 
••E0814 15:08:45.480262   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusters.cluster.x-k8s.io \"test1-5nvpj\" not found" "controller"="cluster" "name"="test1-5nvpj" "namespace"="default"
•I0814 15:08:46.602497   10559 conversion.go:64] controllers/Cluster "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "cluster"="test2-vk2x4" "namespace"="default" "err"="you requested PartialObjectMetadata, but the requested object is a list (*apiextensions.CustomResourceDefinitionList)"
I0814 15:08:46.718145   10559 conversion.go:64] controllers/Cluster "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "cluster"="test2-vk2x4" "namespace"="default" "err"="you requested PartialObjectMetadata, but the requested object is a list (*apiextensions.CustomResourceDefinitionList)"
E0814 15:08:46.721946   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to find a CustomResourceDefinition for /, Kind= with contract \"cluster.x-k8s.io/v1alpha3\"" "controller"="cluster" "name"="test2-vk2x4" "namespace"="default"
E0814 15:08:47.736660   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test-too\" for Cluster default/test2-vk2x4: failed to retrieve  external object \"default\"/\"test-too\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test2-vk2x4" "namespace"="default"
•E0814 15:08:48.751210   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusters.cluster.x-k8s.io \"test3-ghmhj\" not found" "controller"="cluster" "name"="test3-ghmhj" "namespace"="default"
E0814 15:08:49.751975   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test-too\" for Cluster default/test2-vk2x4: failed to retrieve  external object \"default\"/\"test-too\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test2-vk2x4" "namespace"="default"
E0814 15:08:50.763483   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test-too\" for Cluster default/test2-vk2x4: failed to retrieve  external object \"default\"/\"test-too\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test2-vk2x4" "namespace"="default"
•I0814 15:08:51.764164   10559 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster" "namespace"="ms-test" "descendants"="Worker machines: ms-m2wbw-hctr9,ms-m2wbw-clj8v" "indirect descendants count"=2
E0814 15:08:51.769077   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test\" for Cluster default/test4-ltm7w: failed to retrieve  external object \"default\"/\"test\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test4-ltm7w" "namespace"="default"
E0814 15:08:52.769852   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test-too\" for Cluster default/test2-vk2x4: failed to retrieve  external object \"default\"/\"test-too\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test2-vk2x4" "namespace"="default"
E0814 15:08:53.780275   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test\" for Cluster default/test4-ltm7w: failed to retrieve  external object \"default\"/\"test\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test4-ltm7w" "namespace"="default"
•E0814 15:08:54.781141   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test-too\" for Cluster default/test2-vk2x4: failed to retrieve  external object \"default\"/\"test-too\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test2-vk2x4" "namespace"="default"
E0814 15:08:55.782101   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test\" for Cluster default/test4-ltm7w: failed to retrieve  external object \"default\"/\"test\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test4-ltm7w" "namespace"="default"
E0814 15:08:56.791881   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test-too\" for Cluster default/test2-vk2x4: failed to retrieve  external object \"default\"/\"test-too\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test2-vk2x4" "namespace"="default"
I0814 15:08:56.883951   10559 conversion.go:64] controllers/Machine "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="test6-gdxsz" "namespace"="default" "err"="you requested PartialObjectMetadata, but the requested object is a list (*apiextensions.CustomResourceDefinitionList)"
E0814 15:08:56.895451   10559 machine_controller_noderef.go:73] controllers/Machine "msg"="Failed to retrieve Node by ProviderID" "error"="the cache is not started, can not read objects" "machine"="test6-gdxsz" "namespace"="default" 
E0814 15:08:56.915939   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="[failed to find a CustomResourceDefinition for /, Kind= with contract \"cluster.x-k8s.io/v1alpha3\", the cache is not started, can not read objects]" "controller"="machine" "name"="test6-gdxsz" "namespace"="default"
E0814 15:08:57.792735   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test\" for Cluster default/test4-ltm7w: failed to retrieve  external object \"default\"/\"test\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test4-ltm7w" "namespace"="default"
I0814 15:08:57.933664   10559 conversion.go:64] controllers/Machine "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="test6-gdxsz" "namespace"="default" "err"="you requested PartialObjectMetadata, but the requested object is a list (*apiextensions.CustomResourceDefinitionList)"
I0814 15:08:57.933886   10559 machine_controller_noderef.go:86] controllers/Machine "msg"="Set Machine's NodeRef" "machine"="test6-gdxsz" "namespace"="default" "noderef"="id-node-1"
E0814 15:08:57.947154   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to find a CustomResourceDefinition for /, Kind= with contract \"cluster.x-k8s.io/v1alpha3\"" "controller"="machine" "name"="test6-gdxsz" "namespace"="default"
I0814 15:08:58.793373   10559 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster" "namespace"="ms-test" "descendants"="Worker machines: ms-m2wbw-hctr9,ms-m2wbw-clj8v" "indirect descendants count"=2
E0814 15:08:58.798730   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test-too\" for Cluster default/test2-vk2x4: failed to retrieve  external object \"default\"/\"test-too\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test2-vk2x4" "namespace"="default"

------------------------------
• [SLOW TEST:5.040 seconds]
Cluster Reconciler
/home/prow/go/src/sigs.k8s.io/cluster-api/controllers/cluster_controller_test.go:45
  Should successfully set Status.ControlPlaneInitialized on the cluster object if controlplane is ready
  /home/prow/go/src/sigs.k8s.io/cluster-api/controllers/cluster_controller_test.go:248
------------------------------
I0814 15:08:58.940929   10559 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="md-xr89b-6657c7fddb" "namespace"="md-test" "creating"=2 "need"=2
I0814 15:08:58.940985   10559 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 2, ( spec.replicas(2) \u003e currentMachineCount(0) )" "machineset"="md-xr89b-6657c7fddb" "namespace"="md-test" 
I0814 15:08:58.947549   10559 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test6-ssbzl" "machine"="test6-gdxsz" "namespace"="default" "cause"="cluster is being deleted" "node"={"kind":"Node","name":"id-node-1","uid":"89e2f9cb-885c-4927-87b0-4f13e36a72f5","apiVersion":"v1"}
I0814 15:08:58.951737   10559 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 2 with name \"md-xr89b-6657c7fddb-zl8vk\"" "machineset"="md-xr89b-6657c7fddb" "namespace"="md-test" 
I0814 15:08:58.951793   10559 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 2 of 2, ( spec.replicas(2) \u003e currentMachineCount(0) )" "machineset"="md-xr89b-6657c7fddb" "namespace"="md-test" 
E0814 15:08:58.969727   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get /, Kind= \"\" for Machine \"test6-gdxsz\" in namespace \"default\": failed to retrieve  external object \"default\"/\"\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="machine" "name"="test6-gdxsz" "namespace"="default"
I0814 15:08:58.971418   10559 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 2 of 2 with name \"md-xr89b-6657c7fddb-6485f\"" "machineset"="md-xr89b-6657c7fddb" "namespace"="md-test" 
I0814 15:08:59.017804   10559 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="md-xr89b-6657c7fddb" "namespace"="md-test" "creating"=2 "need"=2
I0814 15:08:59.017849   10559 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 2, ( spec.replicas(2) \u003e currentMachineCount(0) )" "machineset"="md-xr89b-6657c7fddb" "namespace"="md-test" 
I0814 15:08:59.027478   10559 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 2 with name \"md-xr89b-6657c7fddb-d5br2\"" "machineset"="md-xr89b-6657c7fddb" "namespace"="md-test" 
I0814 15:08:59.027520   10559 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 2 of 2, ( spec.replicas(2) \u003e currentMachineCount(0) )" "machineset"="md-xr89b-6657c7fddb" "namespace"="md-test" 
I0814 15:08:59.037512   10559 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 2 of 2 with name \"md-xr89b-6657c7fddb-b8n7x\"" "machineset"="md-xr89b-6657c7fddb" "namespace"="md-test" 
I0814 15:08:59.147063   10559 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="md-xr89b-6657c7fddb" "namespace"="md-test" "creating"=1 "need"=3
I0814 15:08:59.147340   10559 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 1, ( spec.replicas(3) \u003e currentMachineCount(2) )" "machineset"="md-xr89b-6657c7fddb" "namespace"="md-test" 
I0814 15:08:59.159665   10559 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 1 with name \"md-xr89b-6657c7fddb-bwm4w\"" "machineset"="md-xr89b-6657c7fddb" "namespace"="md-test" 
I0814 15:08:59.269296   10559 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="md-xr89b-cdfc6fd6c" "namespace"="md-test" "creating"=1 "need"=1
I0814 15:08:59.269456   10559 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 1, ( spec.replicas(1) \u003e currentMachineCount(0) )" "machineset"="md-xr89b-cdfc6fd6c" "namespace"="md-test" 
I0814 15:08:59.282747   10559 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 1 with name \"md-xr89b-cdfc6fd6c-bd899\"" "machineset"="md-xr89b-cdfc6fd6c" "namespace"="md-test" 
E0814 15:08:59.461447   10559 machineset_controller.go:625] controllers/MachineSet "msg"="Unable to retrieve Node status" "error"="error retrieving node md-xr89b-cdfc6fd6c-bd899-j62x8 for machine md-test/md-xr89b-cdfc6fd6c-bd899: the cache is not started, can not read objects" "machineset"="md-xr89b-cdfc6fd6c" "namespace"="md-test" 
E0814 15:08:59.799510   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test\" for Cluster default/test4-ltm7w: failed to retrieve  external object \"default\"/\"test\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test4-ltm7w" "namespace"="default"
I0814 15:08:59.990076   10559 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test6-ssbzl" "machine"="test6-gdxsz" "namespace"="default" "cause"="cluster is being deleted" "node"={"kind":"Node","name":"id-node-1","uid":"89e2f9cb-885c-4927-87b0-4f13e36a72f5","apiVersion":"v1"}
E0814 15:08:59.990725   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get /, Kind= \"\" for Machine \"test6-gdxsz\" in namespace \"default\": failed to retrieve  external object \"default\"/\"\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="machine" "name"="test6-gdxsz" "namespace"="default"
I0814 15:09:00.800026   10559 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="test6-ssbzl" "namespace"="default" "count"=1
I0814 15:09:00.800112   10559 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test6-ssbzl" "namespace"="default" "descendants"="Control plane machines: test6-gdxsz" "indirect descendants count"=0
E0814 15:09:00.813997   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test-too\" for Cluster default/test2-vk2x4: failed to retrieve  external object \"default\"/\"test-too\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test2-vk2x4" "namespace"="default"
I0814 15:09:01.068965   10559 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="md-xr89b-6657c7fddb-zl8vk" "namespace"="md-test" 
I0814 15:09:01.069009   10559 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="md-xr89b-6657c7fddb-zl8vk" "namespace"="md-test" 
I0814 15:09:01.079717   10559 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test6-ssbzl" "machine"="test6-gdxsz" "namespace"="default" "cause"="cluster is being deleted" "node"={"kind":"Node","name":"id-node-1","uid":"89e2f9cb-885c-4927-87b0-4f13e36a72f5","apiVersion":"v1"}
E0814 15:09:01.080300   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get /, Kind= \"\" for Machine \"test6-gdxsz\" in namespace \"default\": failed to retrieve  external object \"default\"/\"\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="machine" "name"="test6-gdxsz" "namespace"="default"
I0814 15:09:01.091604   10559 machineset_controller.go:388] controllers/MachineSet "msg"="Too many replicas" "machineset"="md-xr89b-6657c7fddb" "namespace"="md-test" "deleting"=1 "need"=2
I0814 15:09:01.091637   10559 machineset_controller.go:394] controllers/MachineSet "msg"="Found delete policy" "machineset"="md-xr89b-6657c7fddb" "namespace"="md-test" "delete-policy"="Random"
I0814 15:09:01.096944   10559 machineset_controller.go:405] controllers/MachineSet "msg"="Deleted machine" "machineset"="md-xr89b-6657c7fddb" "namespace"="md-test" "machine"="md-xr89b-6657c7fddb-d5br2"
I0814 15:09:01.207771   10559 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="md-xr89b-cdfc6fd6c" "namespace"="md-test" "creating"=1 "need"=2
I0814 15:09:01.207819   10559 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 1, ( spec.replicas(2) \u003e currentMachineCount(1) )" "machineset"="md-xr89b-cdfc6fd6c" "namespace"="md-test" 
I0814 15:09:01.219259   10559 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 1 with name \"md-xr89b-cdfc6fd6c-2vpsj\"" "machineset"="md-xr89b-cdfc6fd6c" "namespace"="md-test" 
... skipping 6 lines ...
I0814 15:09:01.644895   10559 machineset_controller.go:388] controllers/MachineSet "msg"="Too many replicas" "machineset"="md-xr89b-6657c7fddb" "namespace"="md-test" "deleting"=1 "need"=0
I0814 15:09:01.644933   10559 machineset_controller.go:394] controllers/MachineSet "msg"="Found delete policy" "machineset"="md-xr89b-6657c7fddb" "namespace"="md-test" "delete-policy"="Random"
I0814 15:09:01.649525   10559 machineset_controller.go:405] controllers/MachineSet "msg"="Deleted machine" "machineset"="md-xr89b-6657c7fddb" "namespace"="md-test" "machine"="md-xr89b-6657c7fddb-bwm4w"
I0814 15:09:01.775221   10559 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="md-xr89b-74d45c49c5" "namespace"="md-test" "creating"=1 "need"=1
I0814 15:09:01.775310   10559 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 1, ( spec.replicas(1) \u003e currentMachineCount(0) )" "machineset"="md-xr89b-74d45c49c5" "namespace"="md-test" 
I0814 15:09:01.788783   10559 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 1 with name \"md-xr89b-74d45c49c5-9k4lw\"" "machineset"="md-xr89b-74d45c49c5" "namespace"="md-test" 
E0814 15:09:01.814619   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test\" for Cluster default/test4-ltm7w: failed to retrieve  external object \"default\"/\"test\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test4-ltm7w" "namespace"="default"
I0814 15:09:01.924675   10559 machineset_controller.go:388] controllers/MachineSet "msg"="Too many replicas" "machineset"="md-xr89b-cdfc6fd6c" "namespace"="md-test" "deleting"=1 "need"=2
I0814 15:09:01.924722   10559 machineset_controller.go:394] controllers/MachineSet "msg"="Found delete policy" "machineset"="md-xr89b-cdfc6fd6c" "namespace"="md-test" "delete-policy"="Random"
I0814 15:09:01.929231   10559 machineset_controller.go:405] controllers/MachineSet "msg"="Deleted machine" "machineset"="md-xr89b-cdfc6fd6c" "namespace"="md-test" "machine"="md-xr89b-cdfc6fd6c-2vpsj"
I0814 15:09:02.039776   10559 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="md-xr89b-74d45c49c5" "namespace"="md-test" "creating"=1 "need"=2
I0814 15:09:02.039824   10559 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 1, ( spec.replicas(2) \u003e currentMachineCount(1) )" "machineset"="md-xr89b-74d45c49c5" "namespace"="md-test" 
I0814 15:09:02.050216   10559 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 1 with name \"md-xr89b-74d45c49c5-9ztwh\"" "machineset"="md-xr89b-74d45c49c5" "namespace"="md-test" 
E0814 15:09:02.080656   10559 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-2qm77\" for machine \"test-mhc-machine-mc8lk\" in namespace \"test-mhc-whmwm\": Cluster.cluster.x-k8s.io \"test-cluster-2qm77\" not found" "controller"="machine" "name"="test-mhc-machine-mc8lk" "namespace"="test-mhc-whmwm"
I0814 15:09:02.250401   10559 machineset_controller.go:388] controllers/MachineSet "msg"="Too many replicas" "machineset"="md-xr89b-cdfc6fd6c" "namespace"="md-test" "deleting"=1 "need"=1
I0814 15:09:02.250464   10559 machineset_controller.go:394] controllers/MachineSet "msg"="Found delete policy" "machineset"="md-xr89b-cdfc6fd6c" "namespace"="md-test" "delete-policy"="Random"
I0814 15:09:02.254906   10559 machineset_controller.go:405] controllers/MachineSet "msg"="Deleted machine" "machineset"="md-xr89b-cdfc6fd6c" "namespace"="md-test" "machine"="md-xr89b-cdfc6fd6c-bd899"
I0814 15:09:02.279619   10559 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="md-xr89b-74d45c49c5" "namespace"="md-test" "creating"=1 "need"=3
I0814 15:09:02.279662   10559 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 1, ( spec.replicas(3) \u003e currentMachineCount(2) )" "machineset"="md-xr89b-74d45c49c5" "namespace"="md-test" 
I0814 15:09:02.290563   10559 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 1 with name \"md-xr89b-74d45c49c5-w8kbg\"" "machineset"="md-xr89b-74d45c49c5" "namespace"="md-test" 
I0814 15:09:02.435107   10559 machineset_controller.go:388] controllers/MachineSet "msg"="Too many replicas" "machineset"="md-xr89b-cdfc6fd6c" "namespace"="md-test" "deleting"=1 "need"=0
I0814 15:09:02.435155   10559 machineset_controller.go:394] controllers/MachineSet "msg"="Found delete policy" "machineset"="md-xr89b-cdfc6fd6c" "namespace"="md-test" "delete-policy"="Random"
I0814 15:09:02.440935   10559 machineset_controller.go:405] controllers/MachineSet "msg"="Deleted machine" "machineset"="md-xr89b-cdfc6fd6c" "namespace"="md-test" "machine"="md-xr89b-cdfc6fd6c-56j9g"
•

Ran 16 of 16 Specs in 28.890 seconds
SUCCESS! -- 16 Passed | 0 Failed | 0 Pending | 0 Skipped
--- PASS: TestGinkgoSuite (28.89s)
PASS
Tearing down test suite
I0814 15:09:02.517608   10559 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="machinedeployment" 
I0814 15:09:02.517677   10559 server.go:208] controller-runtime/webhook "msg"="shutting down webhook server"  
I0814 15:09:02.517694   10559 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="machinehealthcheck" 
I0814 15:09:02.517791   10559 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="machineset" 
I0814 15:09:02.517822   10559 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="machine" 
I0814 15:09:02.517861   10559 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="cluster" 
I0814 15:09:02.517885   10559 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="cluster" 
E0814 15:09:02.552780   10559 reflector.go:309] pkg/mod/k8s.io/client-go@v0.17.9/tools/cache/reflector.go:105: Failed to watch *v1.Node: Get http://127.0.0.1:41787/api/v1/nodes?allowWatchBookmarks=true&resourceVersion=1289&timeout=10s&timeoutSeconds=354&watch=true: dial tcp 127.0.0.1:41787: connect: connection refused
E0814 15:09:02.552787   10559 reflector.go:309] pkg/mod/k8s.io/client-go@v0.17.9/tools/cache/reflector.go:105: Failed to watch *v1.Node: Get http://127.0.0.1:41787/api/v1/nodes?allowWatchBookmarks=true&resourceVersion=1289&timeout=10s&timeoutSeconds=540&watch=true: dial tcp 127.0.0.1:41787: connect: connection refused
E0814 15:09:02.552833   10559 reflector.go:309] pkg/mod/k8s.io/client-go@v0.17.9/tools/cache/reflector.go:105: Failed to watch *v1.Node: Get http://127.0.0.1:41787/api/v1/nodes?allowWatchBookmarks=true&resourceVersion=1289&timeout=10s&timeoutSeconds=519&watch=true: dial tcp 127.0.0.1:41787: connect: connection refused
ok  	sigs.k8s.io/cluster-api/controllers	88.325s
=== RUN   TestGetResourceFound
--- PASS: TestGetResourceFound (0.00s)
=== RUN   TestGetResourceNotFound
--- PASS: TestGetResourceNotFound (0.00s)
=== RUN   TestCloneTemplateResourceNotFound
... skipping 265 lines ...
•I0814 15:07:49.031430   10994 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="cluster" 
I0814 15:07:49.047621   10994 controller.go:155] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinedeployment" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"clusterName":"","selector":{},"template":{"metadata":{},"spec":{"clusterName":"","bootstrap":{},"infrastructureRef":{}}}},"status":{}}}
I0814 15:07:49.249449   10994 controller.go:162] controller-runtime/controller "msg"="Starting Controller" "controller"="machinedeployment" 
I0814 15:07:49.249547   10994 controller.go:189] controller-runtime/controller "msg"="Starting workers" "controller"="machinedeployment" "worker count"=1
I0814 15:07:49.249635   10994 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinedeployment" "source"={}
•I0814 15:07:49.804208   10994 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="machinedeployment" 
E0814 15:07:51.857595   10994 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="cluster-cache-test-qsmvs/test-cluster"
•E0814 15:07:52.332237   10994 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="the server could not find the requested resource"  "cluster"="cluster-cache-test-klf8n/test-cluster"
•E0814 15:07:52.886175   10994 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="Get http://127.0.0.1:39365/?timeout=50ms: dial tcp 127.0.0.1:39365: connect: connection refused"  "cluster"="cluster-cache-test-vrsw7/test-cluster"
•E0814 15:07:53.100021   10994 certwatcher.go:143] controller-runtime/certwatcher "msg"="error re-watching file" "error"="no such file or directory"  
E0814 15:07:53.100106   10994 certwatcher.go:148] controller-runtime/certwatcher "msg"="error re-reading certificate" "error"="open /tmp/envtest-serving-certs-732456547/tls.crt: no such file or directory"  
I0814 15:07:53.100107   10994 server.go:208] controller-runtime/webhook "msg"="shutting down webhook server"  
E0814 15:07:53.162065   10994 reflector.go:309] pkg/mod/k8s.io/client-go@v0.17.9/tools/cache/reflector.go:105: Failed to watch *v1alpha3.Cluster: Get http://127.0.0.1:40309/apis/cluster.x-k8s.io/v1alpha3/clusters?allowWatchBookmarks=true&resourceVersion=146&timeout=10s&timeoutSeconds=478&watch=true: dial tcp 127.0.0.1:40309: connect: connection refused


Ran 5 of 5 Specs in 17.150 seconds
SUCCESS! -- 5 Passed | 0 Failed | 0 Pending | 0 Skipped
--- PASS: TestGinkgoSuite (17.15s)
PASS
ok  	sigs.k8s.io/cluster-api/controllers/remote	17.370s
?   	sigs.k8s.io/cluster-api/controllers/remote/fake	[no test files]
?   	sigs.k8s.io/cluster-api/controlplane/kubeadm	[no test files]
=== RUN   TestKubeadmControlPlaneDefault
... skipping 208 lines ...
=== RUN   TestReconcileNoClusterOwnerRef
I0814 15:08:04.110174   11711 controller.go:130]  "msg"="Cluster Controller has not yet set OwnerRef" "kubeadmControlPlane"="foo" "namespace"="test" 
--- PASS: TestReconcileNoClusterOwnerRef (0.00s)
=== RUN   TestReconcileNoKCP
--- PASS: TestReconcileNoKCP (0.00s)
=== RUN   TestReconcileNoCluster
E0814 15:08:04.111600   11711 controller.go:126]  "msg"="Failed to retrieve owner Cluster from the API Server" "error"="clusters.cluster.x-k8s.io \"foo\" not found" "kubeadmControlPlane"="foo" "namespace"="test" 
--- PASS: TestReconcileNoCluster (0.00s)
=== RUN   TestReconcilePaused
I0814 15:08:04.112298   11711 controller.go:136]  "msg"="Reconciliation is paused for this object" "cluster"="foo" "kubeadmControlPlane"="foo" "namespace"="test" 
I0814 15:08:04.112480   11711 controller.go:136]  "msg"="Reconciliation is paused for this object" "cluster"="foo" "kubeadmControlPlane"="foo" "namespace"="test" 
--- PASS: TestReconcilePaused (0.00s)
=== RUN   TestReconcileClusterNoEndpoints
... skipping 192 lines ...
    --- PASS: TestSelectMachineForScaleDown/when_there_is_an_up_to_date_machine_with_delete_annotation,_while_there_are_any_outdated_machines_without_annotatio_that_still_exist,_it_returns_oldest_marked_machine_first (0.00s)
=== RUN   TestPreflightChecks
=== RUN   TestPreflightChecks/control_plane_without_machines_(not_initialized)_should_pass
=== RUN   TestPreflightChecks/control_plane_with_a_deleting_machine_should_requeue
I0814 15:08:21.551874   11711 scale.go:173]  "msg"="Waiting for machines to be deleted" "cluster"="" "kubeadmControlPlane"="" "namespace"="" "Machines"=""
=== RUN   TestPreflightChecks/control_plane_with_an_unhealthy_machine_condition_should_requeue
I0814 15:08:21.552035   11711 scale.go:212]  "msg"="Waiting for control plane to pass preflight checks" "cluster"="" "kubeadmControlPlane"="" "namespace"="" "failures"="machine  reports APIServerPodHealthy condition is false (Error, )"
=== RUN   TestPreflightChecks/control_plane_with_an_healthy_machine_and_an_healthy_kcp_condition_should_pass
--- PASS: TestPreflightChecks (0.00s)
    --- PASS: TestPreflightChecks/control_plane_without_machines_(not_initialized)_should_pass (0.00s)
    --- PASS: TestPreflightChecks/control_plane_with_a_deleting_machine_should_requeue (0.00s)
    --- PASS: TestPreflightChecks/control_plane_with_an_unhealthy_machine_condition_should_requeue (0.00s)
    --- PASS: TestPreflightChecks/control_plane_with_an_healthy_machine_and_an_healthy_kcp_condition_should_pass (0.00s)
... skipping 18 lines ...
=== RUN   TestAPIs
Running Suite: Controller Suite
===============================
Random Seed: 1660489668
Will run 1 of 1 specs

E0814 15:08:21.591977   11711 controller.go:126]  "msg"="Failed to retrieve owner Cluster from the API Server" "error"="Cluster.cluster.x-k8s.io \"kcp-foo-zatue8\" not found" "kubeadmControlPlane"="kcp-foo-zatue8" "namespace"="test" 
•

Ran 1 of 1 Specs in 0.036 seconds
SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
--- PASS: TestAPIs (0.04s)
=== RUN   TestKubeadmControlPlaneReconciler_upgradeControlPlane
I0814 15:08:21.594076   11711 controller.go:246]  "msg"="Reconcile KubeadmControlPlane" "cluster"="kcp-foo-38f0uw" "kubeadmControlPlane"="kcp-foo-38f0uw" "namespace"="test" 
I0814 15:08:23.331936   11711 controller.go:331]  "msg"="Rolling out Control Plane machines" "cluster"="kcp-foo-38f0uw" "kubeadmControlPlane"="kcp-foo-38f0uw" "namespace"="test" "needRollout"=["kcp-foo-38f0uw-klhxl"]
I0814 15:08:23.332248   11711 scale.go:212]  "msg"="Waiting for control plane to pass preflight checks" "cluster"="kcp-foo-38f0uw" "kubeadmControlPlane"="kcp-foo-38f0uw" "namespace"="test" "failures"="[machine kcp-foo-38f0uw-d69jb does not have APIServerPodHealthy condition, machine kcp-foo-38f0uw-d69jb does not have ControllerManagerPodHealthy condition, machine kcp-foo-38f0uw-d69jb does not have SchedulerPodHealthy condition, machine kcp-foo-38f0uw-d69jb does not have EtcdPodHealthy condition, machine kcp-foo-38f0uw-d69jb does not have EtcdMemberHealthy condition]"
--- PASS: TestKubeadmControlPlaneReconciler_upgradeControlPlane (1.74s)
... skipping 60 lines ...
==================================
Random Seed: 1660489667
Will run 7 of 7 specs

•••••••
Ran 7 of 7 Specs in 0.000 seconds
SUCCESS! -- 7 Passed | 0 Failed | 0 Pending | 0 Skipped
--- PASS: TestControlPlane (0.00s)
=== RUN   TestHasUnhealthyMachine
--- PASS: TestHasUnhealthyMachine (0.00s)
=== RUN   TestNewFailureDomainPicker
=== RUN   TestNewFailureDomainPicker/simple
=== RUN   TestNewFailureDomainPicker/no_machines
... skipping 111 lines ...
=======================================
Random Seed: 1660489667
Will run 7 of 7 specs

•••••••
Ran 7 of 7 Specs in 0.000 seconds
SUCCESS! -- 7 Passed | 0 Failed | 0 Pending | 0 Skipped
--- PASS: TestMachineCollection (0.00s)
=== RUN   TestUpdateEtcdConditions
=== RUN   TestUpdateEtcdConditions/if_list_nodes_return_an_error_should_report_all_the_conditions_Unknown
=== RUN   TestUpdateEtcdConditions/node_without_machine_should_be_ignored_if_there_are_provisioning_machines
=== RUN   TestUpdateEtcdConditions/node_without_machine_should_report_a_problem_at_KCP_level_if_there_are_no_provisioning_machines
=== RUN   TestUpdateEtcdConditions/failure_creating_the_etcd_client_should_report_unknown_condition
... skipping 297 lines ...
    --- PASS: TestUpdateKubeProxyImageInfo/returns_error_if_image_repository_is_invalid (0.00s)
    --- PASS: TestUpdateKubeProxyImageInfo/does_not_update_image_repository_when_no_kube-proxy_update_is_requested (0.00s)
=== RUN   TestRemoveMachineFromKubeadmConfigMap
=== RUN   TestRemoveMachineFromKubeadmConfigMap/does_not_panic_if_machine_is_nil
=== RUN   TestRemoveMachineFromKubeadmConfigMap/does_not_panic_if_machine_noderef_is_nil
=== RUN   TestRemoveMachineFromKubeadmConfigMap/returns_error_if_unable_to_find_kubeadm-config_for_Kubernetes_version_<_1.22.0
E0814 15:08:04.330598   11628 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
E0814 15:08:12.653725   11628 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
E0814 15:08:21.641726   11628 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
E0814 15:08:32.771992   11628 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
E0814 15:08:49.245267   11628 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
E0814 15:09:02.253779   11628 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
E0814 15:09:19.901332   11628 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
E0814 15:09:40.824676   11628 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
E0814 15:10:11.841341   11628 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
E0814 15:10:56.998595   11628 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
=== RUN   TestRemoveMachineFromKubeadmConfigMap/returns_error_if_unable_to_remove_api_endpoint_for_Kubernetes_version_<_1.22.0
=== RUN   TestRemoveMachineFromKubeadmConfigMap/removes_the_machine_node_ref_from_kubeadm_config_for_Kubernetes_version_<_1.22.0
=== RUN   TestRemoveMachineFromKubeadmConfigMap/no_op_for_Kubernetes_version_>=_1.22.0
--- PASS: TestRemoveMachineFromKubeadmConfigMap (172.67s)
    --- PASS: TestRemoveMachineFromKubeadmConfigMap/does_not_panic_if_machine_is_nil (0.00s)
    --- PASS: TestRemoveMachineFromKubeadmConfigMap/does_not_panic_if_machine_noderef_is_nil (0.00s)
... skipping 83 lines ...
    --- PASS: TestIsKubernetesVersionSupported/workload_cluster_and_version_<_v1.22.0 (0.00s)
    --- PASS: TestIsKubernetesVersionSupported/workload_cluster_and_version_>=_v1.22.0 (0.00s)
    --- PASS: TestIsKubernetesVersionSupported/management_cluster_and_version_<_v1.22.0 (0.00s)
    --- PASS: TestIsKubernetesVersionSupported/management_cluster_and_version_>=_v1.22.0 (0.00s)
    --- PASS: TestIsKubernetesVersionSupported/management_cluster_and_version_>=_v1.23.0 (0.00s)
PASS
E0814 15:10:57.007949   11628 certwatcher.go:143] controller-runtime/certwatcher "msg"="error re-watching file" "error"="no such file or directory"  
E0814 15:10:57.007988   11628 certwatcher.go:148] controller-runtime/certwatcher "msg"="error re-reading certificate" "error"="open /tmp/envtest-serving-certs-891313711/tls.crt: no such file or directory"  
E0814 15:10:57.008007   11628 certwatcher.go:143] controller-runtime/certwatcher "msg"="error re-watching file" "error"="no such file or directory"  
E0814 15:10:57.008024   11628 certwatcher.go:148] controller-runtime/certwatcher "msg"="error re-reading certificate" "error"="open /tmp/envtest-serving-certs-891313711/tls.crt: no such file or directory"  
I0814 15:10:57.008418   11628 server.go:208] controller-runtime/webhook "msg"="shutting down webhook server"  
ok  	sigs.k8s.io/cluster-api/controlplane/kubeadm/internal	190.212s
=== RUN   TestEtcdMembers_WithErrors
--- PASS: TestEtcdMembers_WithErrors (0.00s)
=== RUN   TestEtcdMembers_WithSuccess
--- PASS: TestEtcdMembers_WithSuccess (0.00s)
... skipping 288 lines ...
I0814 15:08:11.514066   11952 controller.go:162] controller-runtime/controller "msg"="Starting Controller" "controller"="clusterresourcesetbinding" 
I0814 15:08:11.611606   11952 controller.go:155] controller-runtime/controller "msg"="Starting EventSource" "controller"="clusterresourceset" "source"={"Type":{"kind":"Secret","apiVersion":"v1","metadata":{"creationTimestamp":null}}}
I0814 15:08:11.615018   11952 controller.go:189] controller-runtime/controller "msg"="Starting workers" "controller"="clusterresourcesetbinding" "worker count"=1
I0814 15:08:11.712474   11952 controller.go:162] controller-runtime/controller "msg"="Starting Controller" "controller"="clusterresourceset" 
I0814 15:08:11.712563   11952 controller.go:189] controller-runtime/controller "msg"="Starting workers" "controller"="clusterresourceset" "worker count"=1
I0814 15:08:11.844672   11952 clusterresourcesetbinding_controller.go:84]  "msg"="deleting ClusterResourceSetBinding because the owner Cluster no longer exists" "clusterresourcesetbinding"={"Namespace":"default","Name":"cluster-waodly"} 
E0814 15:08:11.887737   11952 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusterresourcesets.addons.cluster.x-k8s.io \"test-clusterresourceset\" not found" "controller"="clusterresourceset" "name"="test-clusterresourceset" "namespace"="default"
•I0814 15:08:12.971002   11952 clusterresourcesetbinding_controller.go:84]  "msg"="deleting ClusterResourceSetBinding because the owner Cluster no longer exists" "clusterresourcesetbinding"={"Namespace":"default","Name":"cluster-46izc6"} 
E0814 15:08:13.018372   11952 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusterresourcesets.addons.cluster.x-k8s.io \"test-clusterresourceset\" not found" "controller"="clusterresourceset" "name"="test-clusterresourceset" "namespace"="default"
•E0814 15:08:14.131807   11952 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get data field from the resource" "controller"="clusterresourceset" "name"="test-clusterresourceset" "namespace"="default"
E0814 15:08:15.152713   11952 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusterresourcesets.addons.cluster.x-k8s.io \"test-clusterresourceset\" not found" "controller"="clusterresourceset" "name"="test-clusterresourceset" "namespace"="default"
•E0814 15:08:16.294337   11952 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusterresourcesets.addons.cluster.x-k8s.io \"test-clusterresourceset\" not found" "controller"="clusterresourceset" "name"="test-clusterresourceset" "namespace"="default"
E0814 15:08:17.326724   11952 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusterresourcesets.addons.cluster.x-k8s.io \"test-clusterresourceset2\" not found" "controller"="clusterresourceset" "name"="test-clusterresourceset2" "namespace"="default"
••E0814 15:08:18.343405   11952 certwatcher.go:143] controller-runtime/certwatcher "msg"="error re-watching file" "error"="no such file or directory"  
E0814 15:08:18.343433   11952 certwatcher.go:148] controller-runtime/certwatcher "msg"="error re-reading certificate" "error"="open /tmp/envtest-serving-certs-119840842/tls.crt: no such file or directory"  
E0814 15:08:18.343447   11952 certwatcher.go:143] controller-runtime/certwatcher "msg"="error re-watching file" "error"="no such file or directory"  
E0814 15:08:18.343460   11952 certwatcher.go:148] controller-runtime/certwatcher "msg"="error re-reading certificate" "error"="open /tmp/envtest-serving-certs-119840842/tls.crt: no such file or directory"  
E0814 15:08:18.343498   11952 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusterresourcesets.addons.cluster.x-k8s.io \"test-clusterresourceset\" not found" "controller"="clusterresourceset" "name"="test-clusterresourceset" "namespace"="default"
I0814 15:08:18.343658   11952 server.go:208] controller-runtime/webhook "msg"="shutting down webhook server"  
I0814 15:08:18.343682   11952 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="clusterresourceset" 
I0814 15:08:18.343713   11952 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="clusterresourcesetbinding" 


Ran 5 of 5 Specs in 20.747 seconds
SUCCESS! -- 5 Passed | 0 Failed | 0 Pending | 0 Skipped
--- PASS: TestAPIs (20.75s)
PASS
ok  	sigs.k8s.io/cluster-api/exp/addons/controllers	20.924s
?   	sigs.k8s.io/cluster-api/exp/addons/controllers/predicates	[no test files]
=== RUN   TestMachinePoolDefault
=== RUN   TestMachinePoolDefault/for_MachinePool
... skipping 61 lines ...
    --- PASS: TestReconcileMachinePoolBootstrap/new_machinepool,_no_bootstrap_config_or_data (0.00s)
    --- PASS: TestReconcileMachinePoolBootstrap/existing_machinepool,_bootstrap_data_should_not_change (0.00s)
    --- PASS: TestReconcileMachinePoolBootstrap/existing_machinepool,_bootstrap_provider_is_to_not_ready (0.00s)
=== RUN   TestReconcileMachinePoolInfrastructure
=== RUN   TestReconcileMachinePoolInfrastructure/new_machinepool,_infrastructure_config_ready
=== RUN   TestReconcileMachinePoolInfrastructure/ready_bootstrap,_infra,_and_nodeRef,_machinepool_is_running,_infra_object_is_deleted,_expect_failed
E0814 15:08:03.560084   12149 machinepool_controller_phases.go:237]  "msg"="MachinePool infrastructure reference has been deleted after being ready, setting failure state" "error"="could not find infrastructure.cluster.x-k8s.io/v1alpha3, Kind=InfrastructureConfig \"infra-config1\" for MachinePool \"machinepool-test\" in namespace \"default\", requeuing: failed to retrieve InfrastructureConfig external object \"default\"/\"infra-config1\": infrastructureconfigs.infrastructure.cluster.x-k8s.io \"infra-config1\" not found" "cluster"="test-cluster" "machinepool"="machinepool-test" "namespace"="default" 
=== RUN   TestReconcileMachinePoolInfrastructure/infrastructure_ref_is_paused
--- PASS: TestReconcileMachinePoolInfrastructure (0.00s)
    --- PASS: TestReconcileMachinePoolInfrastructure/new_machinepool,_infrastructure_config_ready (0.00s)
    --- PASS: TestReconcileMachinePoolInfrastructure/ready_bootstrap,_infra,_and_nodeRef,_machinepool_is_running,_infra_object_is_deleted,_expect_failed (0.00s)
    --- PASS: TestReconcileMachinePoolInfrastructure/infrastructure_ref_is_paused (0.00s)
=== RUN   TestMachinePoolFinalizer
... skipping 92 lines ...
•I0814 15:08:16.468034   12149 machinepool_controller_noderef.go:90]  "msg"="Cannot assign NodeRefs to MachinePool, no matching Nodes"  
•I0814 15:08:16.519103   12149 machinepool_controller_noderef.go:90]  "msg"="Cannot assign NodeRefs to MachinePool, no matching Nodes"  
•I0814 15:08:16.521426   12149 machinepool_controller_phases.go:268]  "msg"="Infrastructure provider is not ready, requeuing" "cluster"="test-cluster" "machinepool"="machinepool-test" "namespace"="default" 
•I0814 15:08:16.564223   12149 machinepool_controller_noderef.go:90]  "msg"="Cannot assign NodeRefs to MachinePool, no matching Nodes"  
•I0814 15:08:16.591208   12149 machinepool_controller_noderef.go:90]  "msg"="Cannot assign NodeRefs to MachinePool, no matching Nodes"  
•I0814 15:08:16.592306   12149 controller.go:155] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinepool" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"controlPlaneEndpoint":{"host":"","port":0}},"status":{"infrastructureReady":false,"controlPlaneInitialized":false}}}
•E0814 15:08:16.602417   12149 certwatcher.go:143] controller-runtime/certwatcher "msg"="error re-watching file" "error"="no such file or directory"  
E0814 15:08:16.602464   12149 certwatcher.go:148] controller-runtime/certwatcher "msg"="error re-reading certificate" "error"="open /tmp/envtest-serving-certs-581225032/tls.crt: no such file or directory"  
E0814 15:08:16.602484   12149 certwatcher.go:143] controller-runtime/certwatcher "msg"="error re-watching file" "error"="no such file or directory"  
E0814 15:08:16.602503   12149 certwatcher.go:148] controller-runtime/certwatcher "msg"="error re-reading certificate" "error"="open /tmp/envtest-serving-certs-581225032/tls.crt: no such file or directory"  
I0814 15:08:16.602818   12149 server.go:208] controller-runtime/webhook "msg"="shutting down webhook server"  


Ran 9 of 9 Specs in 13.068 seconds
SUCCESS! -- 9 Passed | 0 Failed | 0 Pending | 0 Skipped
--- PASS: TestAPIs (13.07s)
PASS
ok  	sigs.k8s.io/cluster-api/exp/controllers	13.310s
?   	sigs.k8s.io/cluster-api/exp/util	[no test files]
?   	sigs.k8s.io/cluster-api/feature	[no test files]
?   	sigs.k8s.io/cluster-api/hack/boilerplate/test	[no test files]
... skipping 266 lines ...
--- PASS: TestGetFirstReasonAndMessage (0.00s)
=== RUN   TestNewConditionsGroup
--- PASS: TestNewConditionsGroup (0.00s)
=== RUN   TestMergeRespectPriority
=== RUN   TestMergeRespectPriority/aggregate_nil_list_return_nil
=== RUN   TestMergeRespectPriority/aggregate_empty_list_return_nil
=== RUN   TestMergeRespectPriority/When_there_is_false/error_it_returns_false/error
=== RUN   TestMergeRespectPriority/When_there_is_false/warning_and_no_false/error,_it_returns_false/warning
=== RUN   TestMergeRespectPriority/When_there_is_false/info_and_no_false/error_or_false/warning,_it_returns_false/info
=== RUN   TestMergeRespectPriority/When_there_is_true_and_no_false/*,_it_returns_info
=== RUN   TestMergeRespectPriority/When_there_is_unknown_and_no_true_or_false/*,_it_returns_unknown
=== RUN   TestMergeRespectPriority/nil_conditions_are_ignored
--- PASS: TestMergeRespectPriority (0.00s)
    --- PASS: TestMergeRespectPriority/aggregate_nil_list_return_nil (0.00s)
    --- PASS: TestMergeRespectPriority/aggregate_empty_list_return_nil (0.00s)
    --- PASS: TestMergeRespectPriority/When_there_is_false/error_it_returns_false/error (0.00s)
    --- PASS: TestMergeRespectPriority/When_there_is_false/warning_and_no_false/error,_it_returns_false/warning (0.00s)
    --- PASS: TestMergeRespectPriority/When_there_is_false/info_and_no_false/error_or_false/warning,_it_returns_false/info (0.00s)
    --- PASS: TestMergeRespectPriority/When_there_is_true_and_no_false/*,_it_returns_info (0.00s)
    --- PASS: TestMergeRespectPriority/When_there_is_unknown_and_no_true_or_false/*,_it_returns_unknown (0.00s)
    --- PASS: TestMergeRespectPriority/nil_conditions_are_ignored (0.00s)
=== RUN   TestNewPatch
=== RUN   TestNewPatch/No_changes_return_empty_patch
... skipping 210 lines ...
/home/prow/go/src/sigs.k8s.io/cluster-api/util/patch/patch_test.go:39
  Should patch a clusterv1.Cluster
  /home/prow/go/src/sigs.k8s.io/cluster-api/util/patch/patch_test.go:411
    updating both spec, status, and adding a condition [It]
    /home/prow/go/src/sigs.k8s.io/cluster-api/util/patch/patch_test.go:550

    Expected success, but got an error:
        <errors.aggregate | len:1, cap:1>: [
            {
                ErrStatus: {
                    TypeMeta: {Kind: "", APIVersion: ""},
                    ListMeta: {
                        SelfLink: "",
... skipping 29 lines ...
•I0814 15:08:43.315526   15090 server.go:208] controller-runtime/webhook "msg"="shutting down webhook server"  



Summarizing 1 Failure:

[Fail] Patch Helper Should patch a clusterv1.Cluster [It] updating both spec, status, and adding a condition 
/home/prow/go/src/sigs.k8s.io/cluster-api/util/patch/patch_test.go:580

Ran 14 of 14 Specs in 8.030 seconds
FAIL! -- 13 Passed | 1 Failed | 0 Pending | 0 Skipped
--- FAIL: TestPatch (8.03s)
=== RUN   TestToUnstructured
=== RUN   TestToUnstructured/with_a_typed_object
=== RUN   TestToUnstructured/with_an_unstructured_object
--- PASS: TestToUnstructured (0.00s)
    --- PASS: TestToUnstructured/with_a_typed_object (0.00s)
    --- PASS: TestToUnstructured/with_an_unstructured_object (0.00s)
... skipping 2 lines ...
=== RUN   TestUnsafeFocusedUnstructured/focus=status_w/_condition-setter_object,_should_only_return_status_(without_conditions)_and_common_fields
=== RUN   TestUnsafeFocusedUnstructured/focus=status_w/o_condition-setter_object,_should_only_return_status_and_common_fields
--- PASS: TestUnsafeFocusedUnstructured (0.00s)
    --- PASS: TestUnsafeFocusedUnstructured/focus=spec,_should_only_return_spec_and_common_fields (0.00s)
    --- PASS: TestUnsafeFocusedUnstructured/focus=status_w/_condition-setter_object,_should_only_return_status_(without_conditions)_and_common_fields (0.00s)
    --- PASS: TestUnsafeFocusedUnstructured/focus=status_w/o_condition-setter_object,_should_only_return_status_and_common_fields (0.00s)
FAIL
FAIL	sigs.k8s.io/cluster-api/util/patch	8.076s
?   	sigs.k8s.io/cluster-api/util/predicates	[no test files]
?   	sigs.k8s.io/cluster-api/util/record	[no test files]
=== RUN   TestSortForCreate
--- PASS: TestSortForCreate (0.00s)
PASS
ok  	sigs.k8s.io/cluster-api/util/resource	0.015s
... skipping 88 lines ...
    --- PASS: TestToUnstructured/returns_error_for_invalid_yaml#01 (0.00s)
    --- PASS: TestToUnstructured/returns_error_for_invalid_yaml#02 (0.00s)
=== RUN   TestFromUnstructured
--- PASS: TestFromUnstructured (0.00s)
PASS
ok  	sigs.k8s.io/cluster-api/util/yaml	0.041s
FAIL
make: *** [Makefile:116: test] Error 1