This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 0 failed / 0 succeeded
Started2022-08-16 15:07
Elapsed4m30s
Revisionrelease-0.3

No Test Failures!


Error lines from build-log.txt

... skipping 773 lines ...
I0816 15:08:51.997238    8547 server.go:121] controller-runtime/webhook "msg"="registering webhook"  "path"="/validate-addons-cluster-x-k8s-io-v1alpha3-clusterresourceset"
I0816 15:08:51.997461    8547 server.go:141] controller-runtime/webhook/webhooks "msg"="starting webhook server"  
I0816 15:08:51.999340    8547 certwatcher.go:127] controller-runtime/certwatcher "msg"="Updated current TLS certificate"  
I0816 15:08:51.999519    8547 certwatcher.go:83] controller-runtime/certwatcher "msg"="Starting certificate watcher"  
I0816 15:08:51.999547    8547 server.go:199] controller-runtime/webhook "msg"="serving webhook server"  "host"="" "port"=39543
I0816 15:08:52.736537    8547 kubeadmconfig_controller.go:223]  "msg"="Cluster infrastructure is not ready, waiting" "kind"="Machine" "kubeadmconfig"={"Namespace":"default","Name":"my-machine-config"} "name"="my-machine" "version"="109" 
•E0816 15:08:52.752835    8547 certwatcher.go:143] controller-runtime/certwatcher "msg"="error re-watching file" "error"="no such file or directory"  
E0816 15:08:52.752901    8547 certwatcher.go:148] controller-runtime/certwatcher "msg"="error re-reading certificate" "error"="open /tmp/envtest-serving-certs-582286464/tls.crt: no such file or directory"  
E0816 15:08:52.752924    8547 certwatcher.go:143] controller-runtime/certwatcher "msg"="error re-watching file" "error"="no such file or directory"  
E0816 15:08:52.752943    8547 certwatcher.go:148] controller-runtime/certwatcher "msg"="error re-reading certificate" "error"="open /tmp/envtest-serving-certs-582286464/tls.crt: no such file or directory"  
I0816 15:08:52.753044    8547 server.go:208] controller-runtime/webhook "msg"="shutting down webhook server"  


Ran 1 of 1 Specs in 13.005 seconds
SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
--- PASS: TestAPIs (13.00s)
PASS
ok  	sigs.k8s.io/cluster-api/bootstrap/kubeadm/controllers	50.247s
=== RUN   TestNewInitControlPlaneAdditionalFileEncodings
--- PASS: TestNewInitControlPlaneAdditionalFileEncodings (0.00s)
=== RUN   TestNewInitControlPlaneCommands
... skipping 316 lines ...
=== RUN   Test_clusterctlClient_GetProvidersConfig/Returns_default_providers_and_custom_providers_if_defined
--- PASS: Test_clusterctlClient_GetProvidersConfig (0.00s)
    --- PASS: Test_clusterctlClient_GetProvidersConfig/Returns_default_providers (0.00s)
    --- PASS: Test_clusterctlClient_GetProvidersConfig/Returns_default_providers_and_custom_providers_if_defined (0.00s)
=== RUN   Test_clusterctlClient_GetProviderComponents
=== RUN   Test_clusterctlClient_GetProviderComponents/Pass
=== RUN   Test_clusterctlClient_GetProviderComponents/Fail
--- PASS: Test_clusterctlClient_GetProviderComponents (0.00s)
    --- PASS: Test_clusterctlClient_GetProviderComponents/Pass (0.00s)
    --- PASS: Test_clusterctlClient_GetProviderComponents/Fail (0.00s)
=== RUN   Test_getComponentsByName_withEmptyVariables
--- PASS: Test_getComponentsByName_withEmptyVariables (0.00s)
=== RUN   Test_clusterctlClient_templateOptionsToVariables
=== RUN   Test_clusterctlClient_templateOptionsToVariables/pass_(using_KubernetesVersion_from_template_options)
=== RUN   Test_clusterctlClient_templateOptionsToVariables/pass_(using_KubernetesVersion_from_env_variables)
=== RUN   Test_clusterctlClient_templateOptionsToVariables/pass_(using_defaults_for_machine_counts)
... skipping 1401 lines ...
I0816 15:08:35.012624   10483 controller.go:189] controller-runtime/controller "msg"="Starting workers" "controller"="cluster" "worker count"=1
I0816 15:08:35.012653   10483 controller.go:162] controller-runtime/controller "msg"="Starting Controller" "controller"="machine" 
I0816 15:08:35.012692   10483 controller.go:189] controller-runtime/controller "msg"="Starting workers" "controller"="machine" "worker count"=1
=== RUN   TestClusterReconcilePhases
=== RUN   TestClusterReconcilePhases/reconcile_infrastructure
=== RUN   TestClusterReconcilePhases/reconcile_infrastructure/returns_no_error_if_infrastructure_ref_is_nil
2022/08/16 15:08:35 http: TLS handshake error from 127.0.0.1:34398: EOF
=== RUN   TestClusterReconcilePhases/reconcile_infrastructure/returns_error_if_unable_to_reconcile_infrastructure_ref
I0816 15:08:35.315408   10483 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "cluster"="test-cluster" "namespace"="test-namespace" "err"="cannot create a metadata client without a rest config"
I0816 15:08:35.330542   10483 cluster_controller_phases.go:76]  "msg"="Could not find external object for cluster, requeuing" "cluster"="test-cluster" "namespace"="test-namespace" "refGroupVersionKind"={"Group":"infrastructure.cluster.x-k8s.io","Version":"v1alpha3","Kind":"InfrastructureMachine"} "refName"="test"
=== RUN   TestClusterReconcilePhases/reconcile_infrastructure/returns_no_error_if_infra_config_is_marked_for_deletion
I0816 15:08:35.331249   10483 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "cluster"="test-cluster" "namespace"="test-namespace" "err"="cannot create a metadata client without a rest config"
=== RUN   TestClusterReconcilePhases/reconcile_infrastructure/returns_no_error_if_infrastructure_is_marked_ready_on_cluster
... skipping 102 lines ...
    --- PASS: TestReconcileBootstrap/existing_machine,_machineset_owner_and_version_v1alpha2,_and_ownerref_updated (0.01s)
=== RUN   TestReconcileInfrastructure
=== RUN   TestReconcileInfrastructure/new_machine,_infrastructure_config_ready
I0816 15:08:35.392976   10483 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="machine-test" "namespace"="default" "err"="cannot create a metadata client without a rest config"
=== RUN   TestReconcileInfrastructure/ready_bootstrap,_infra,_and_nodeRef,_machine_is_running,_infra_object_is_deleted,_expect_failed
I0816 15:08:35.396730   10483 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="machine-test" "namespace"="default" "err"="cannot create a metadata client without a rest config"
E0816 15:08:35.397185   10483 machine_controller_phases.go:246]  "msg"="Machine infrastructure reference has been deleted after being ready, setting failure state" "error"="could not find infrastructure.cluster.x-k8s.io/v1alpha3, Kind=InfrastructureMachine \"infra-config1\" for Machine \"machine-test\" in namespace \"default\", requeuing: requeue in 1s"  
=== RUN   TestReconcileInfrastructure/infrastructure_ref_is_paused
I0816 15:08:35.397686   10483 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="machine-test" "namespace"="default" "err"="cannot create a metadata client without a rest config"
--- PASS: TestReconcileInfrastructure (0.01s)
    --- PASS: TestReconcileInfrastructure/new_machine,_infrastructure_config_ready (0.00s)
    --- PASS: TestReconcileInfrastructure/ready_bootstrap,_infra,_and_nodeRef,_machine_is_running,_infra_object_is_deleted,_expect_failed (0.00s)
    --- PASS: TestReconcileInfrastructure/infrastructure_ref_is_paused (0.00s)
=== RUN   TestWatches
I0816 15:08:35.683771   10483 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machine" "source"={}
E0816 15:08:35.784665   10483 machine_controller.go:685] controllers/Machine "msg"="Unable to retrieve machine from node" "error"="no matching Machine"  "node"="node-1"
I0816 15:08:35.793424   10483 tracker.go:55] controllers/Machine "msg"="Adding watcher on external object" "machine"="machine-created-9lz5f" "namespace"="test-machine-watches-m56lq" "GroupVersionKind"="bootstrap.cluster.x-k8s.io/v1alpha3, Kind=BootstrapMachine"
I0816 15:08:35.793518   10483 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machine" "source"={"Type":{"apiVersion":"bootstrap.cluster.x-k8s.io/v1alpha3","kind":"BootstrapMachine"}}
I0816 15:08:35.920301   10483 tracker.go:55] controllers/Machine "msg"="Adding watcher on external object" "machine"="machine-created-9lz5f" "namespace"="test-machine-watches-m56lq" "GroupVersionKind"="infrastructure.cluster.x-k8s.io/v1alpha3, Kind=InfrastructureMachine"
I0816 15:08:35.920403   10483 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machine" "source"={"Type":{"apiVersion":"infrastructure.cluster.x-k8s.io/v1alpha3","kind":"InfrastructureMachine"}}
I0816 15:08:36.020892   10483 machine_controller_noderef.go:86] controllers/Machine "msg"="Set Machine's NodeRef" "machine"="machine-created-9lz5f" "namespace"="test-machine-watches-m56lq" "noderef"="node-1"
E0816 15:08:36.035860   10483 machine_controller.go:685] controllers/Machine "msg"="Unable to retrieve machine from node" "error"="no matching Machine"  "node"="node-1"
E0816 15:08:36.035912   10483 machine_controller.go:685] controllers/Machine "msg"="Unable to retrieve machine from node" "error"="no matching Machine"  "node"="node-1"
I0816 15:08:36.073928   10483 machine_controller_noderef.go:86] controllers/Machine "msg"="Set Machine's NodeRef" "machine"="machine-created-9lz5f" "namespace"="test-machine-watches-m56lq" "noderef"="node-1"
E0816 15:08:36.101059   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"machine-created-9lz5f\" in namespace \"test-machine-watches-m56lq\": cannot find node with matching ProviderID" "controller"="machine" "name"="machine-created-9lz5f" "namespace"="test-machine-watches-m56lq"
E0816 15:08:37.107890   10483 machine_controller_phases.go:246] controllers/Machine "msg"="Machine infrastructure reference has been deleted after being ready, setting failure state" "error"="could not find infrastructure.cluster.x-k8s.io/v1alpha3, Kind=InfrastructureMachine \"infra-config1\" for Machine \"machine-created-9lz5f\" in namespace \"test-machine-watches-m56lq\", requeuing: requeue in 1s"  
E0816 15:08:37.117891   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="[could not find infrastructure.cluster.x-k8s.io/v1alpha3, Kind=InfrastructureMachine \"infra-config1\" for Machine \"machine-created-9lz5f\" in namespace \"test-machine-watches-m56lq\", requeuing: requeue in 1s, no matching Node for Machine \"machine-created-9lz5f\" in namespace \"test-machine-watches-m56lq\": cannot find node with matching ProviderID]" "controller"="machine" "name"="machine-created-9lz5f" "namespace"="test-machine-watches-m56lq"
--- PASS: TestWatches (1.76s)
=== RUN   TestIndexMachineByNodeName
=== RUN   TestIndexMachineByNodeName/when_the_machine_has_no_NodeRef
=== RUN   TestIndexMachineByNodeName/when_the_machine_has_valid_a_NodeRef
--- PASS: TestIndexMachineByNodeName (0.00s)
    --- PASS: TestIndexMachineByNodeName/when_the_machine_has_no_NodeRef (0.00s)
... skipping 2 lines ...
=== RUN   TestMachine_Reconcile/reconcile_create
I0816 15:08:37.354711   10483 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="machine-reconcile-x4mwn" "namespace"="test-machine-watches-m56lq" "count"=1
I0816 15:08:37.354784   10483 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="machine-reconcile-x4mwn" "namespace"="test-machine-watches-m56lq" "descendants"="Worker machines: machine-created-9lz5f" "indirect descendants count"=0
I0816 15:08:37.373200   10483 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="machine-reconcile-x4mwn" "namespace"="test-machine-watches-m56lq" "count"=1
I0816 15:08:37.373275   10483 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="machine-reconcile-x4mwn" "namespace"="test-machine-watches-m56lq" "descendants"="Worker machines: machine-created-9lz5f" "indirect descendants count"=0
I0816 15:08:38.118486   10483 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="machine-reconcile-x4mwn" "machine"="machine-created-9lz5f" "namespace"="test-machine-watches-m56lq" "cause"="cluster is being deleted" "node"={"kind":"Node","name":"node-1","uid":"009e549d-e840-46fa-9d53-2045c7c87baa","apiVersion":"v1"}
E0816 15:08:38.170677   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"machine-created-9lz5f\" not found" "controller"="machine" "name"="machine-created-9lz5f" "namespace"="test-machine-watches-m56lq"
E0816 15:08:39.226194   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="[retrieved empty dataSecretName from bootstrap provider for Machine \"machine-created-hg7mv\" in namespace \"default\", error creating client and cache for remote cluster: error fetching REST client config for remote cluster \"default/machine-reconcile-psjfs\": failed to retrieve kubeconfig secret for Cluster default/machine-reconcile-psjfs: secrets \"machine-reconcile-psjfs-kubeconfig\" not found]" "controller"="machine" "name"="machine-created-hg7mv" "namespace"="default"
I0816 15:08:40.226820   10483 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="machine-reconcile-psjfs" "machine"="machine-created-hg7mv" "namespace"="default" "cause"="noderef is nil" "node"=null
I0816 15:08:40.294516   10483 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="machine-reconcile-psjfs" "machine"="machine-created-hg7mv" "namespace"="default" "cause"="noderef is nil" "node"=null
I0816 15:08:40.320573   10483 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="machine-reconcile-psjfs" "machine"="machine-created-hg7mv" "namespace"="default" "cause"="noderef is nil" "node"=null
E0816 15:08:40.363747   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"machine-created-hg7mv\" not found" "controller"="machine" "name"="machine-created-hg7mv" "namespace"="default"
--- PASS: TestMachine_Reconcile (3.23s)
    --- PASS: TestMachine_Reconcile/reconcile_create (3.23s)
=== RUN   TestMachineFinalizer
=== RUN   TestMachineFinalizer/should_add_a_machine_finalizer_to_the_machine_if_it_doesn't_have_one
=== RUN   TestMachineFinalizer/should_append_the_machine_finalizer_to_the_machine_if_it_already_has_a_finalizer
--- PASS: TestMachineFinalizer (0.00s)
... skipping 7 lines ...
I0816 15:08:40.395700   10483 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="machine3" "namespace"="default" "err"="cannot create a metadata client without a rest config"
I0816 15:08:40.395888   10483 machine_controller_noderef.go:45]  "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="machine3" "namespace"="default" 
=== RUN   TestMachineOwnerReference/should_not_add_cluster_owner_reference_if_machine_has_a_controller_owner
I0816 15:08:40.398877   10483 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="machine4" "namespace"="default" "err"="cannot create a metadata client without a rest config"
I0816 15:08:40.399049   10483 machine_controller_noderef.go:45]  "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="machine4" "namespace"="default" 
--- PASS: TestMachineOwnerReference (0.01s)
E0816 15:08:40.405349   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusters.cluster.x-k8s.io \"machine-reconcile-psjfs\" not found" "controller"="cluster" "name"="machine-reconcile-psjfs" "namespace"="default"
    --- PASS: TestMachineOwnerReference/should_add_owner_reference_to_machine_referencing_a_cluster_with_correct_type_meta (0.00s)
    --- PASS: TestMachineOwnerReference/should_not_add_cluster_owner_reference_if_machine_is_owned_by_a_machine_set (0.00s)
    --- PASS: TestMachineOwnerReference/should_not_add_cluster_owner_reference_if_machine_has_a_controller_owner (0.00s)
=== RUN   TestReconcileRequest
=== RUN   TestReconcileRequest/machine_should_be_created
I0816 15:08:40.406043   10483 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="created" "namespace"="default" "err"="cannot create a metadata client without a rest config"
... skipping 118 lines ...
    --- PASS: TestMachineDeploymentSyncStatus/machine_set_failed (0.00s)
=== RUN   TestMachineHealthCheck_Reconcile
=== RUN   TestMachineHealthCheck_Reconcile/it_should_ensure_the_correct_cluster-name_label_when_no_existing_labels_exist
I0816 15:08:40.707169   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-tz4nn" "namespace"="test-mhc-4grrx" 
=== RUN   TestMachineHealthCheck_Reconcile/it_should_ensure_the_correct_cluster-name_label_when_the_label_has_the_wrong_value
I0816 15:08:40.756688   10483 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={}
E0816 15:08:40.757152   10483 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="Cluster.cluster.x-k8s.io \"test-cluster-rx4w9\" not found"  "cluster"="test-mhc-4grrx/test-cluster-rx4w9"
E0816 15:08:40.761163   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="[MachineHealthCheck.cluster.x-k8s.io \"test-mhc-tz4nn\" not found, machinehealthchecks.cluster.x-k8s.io \"test-mhc-tz4nn\" not found]" "controller"="machinehealthcheck" "name"="test-mhc-tz4nn" "namespace"="test-mhc-4grrx"
=== RUN   TestMachineHealthCheck_Reconcile/it_should_ensure_the_correct_cluster-name_label_when_other_labels_are_present
=== RUN   TestMachineHealthCheck_Reconcile/it_should_ensure_an_owner_reference_is_present_when_no_existing_ones_exist
I0816 15:08:41.761491   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-tz4nn" "namespace"="test-mhc-4grrx" 
I0816 15:08:41.761614   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-m7kds" "namespace"="test-mhc-9jhw6" 
I0816 15:08:41.761654   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-z2wn6" "namespace"="test-mhc-2x6qt" 
I0816 15:08:41.761696   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lpxxx" "namespace"="test-mhc-2j6xc" 
I0816 15:08:41.787322   10483 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={}
I0816 15:08:41.815332   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lpxxx" "namespace"="test-mhc-2j6xc" 
I0816 15:08:41.826004   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lpxxx" "namespace"="test-mhc-2j6xc" 
I0816 15:08:41.910006   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-lpxxx" "namespace"="test-mhc-2j6xc" 
=== RUN   TestMachineHealthCheck_Reconcile/it_should_ensure_an_owner_reference_is_present_when_modifying_existing_ones
E0816 15:08:41.921192   10483 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-2j6xc/test-cluster-92zlw"
E0816 15:08:41.924211   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusters.cluster.x-k8s.io \"test-cluster-92zlw\" not found" "controller"="cluster" "name"="test-cluster-92zlw" "namespace"="test-mhc-2j6xc"
I0816 15:08:42.033396   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-hnbhx" "namespace"="test-mhc-zxgdn" 
I0816 15:08:42.051288   10483 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={}
I0816 15:08:42.072998   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-hnbhx" "namespace"="test-mhc-zxgdn" 
I0816 15:08:42.078501   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-hnbhx" "namespace"="test-mhc-zxgdn" 
E0816 15:08:42.140438   10483 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-zxgdn/test-cluster-g6wsj"
=== RUN   TestMachineHealthCheck_Reconcile/it_doesn't_mark_anything_unhealthy_when_all_Machines_are_healthy
I0816 15:08:42.145984   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-hnbhx" "namespace"="test-mhc-zxgdn" 
I0816 15:08:42.265773   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz" 
inframachine created: test-mhc-machine-infra-sdlb2
I0816 15:08:42.288774   10483 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={}
machine created: test-mhc-machine-d7wzj
I0816 15:08:42.322585   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz" 
I0816 15:08:42.323043   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-cxccz/test-mhc-gx4kq/test-mhc-machine-d7wzj/"
I0816 15:08:42.354146   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz" 
I0816 15:08:42.354723   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-cxccz/test-mhc-gx4kq/test-mhc-machine-d7wzj/"
I0816 15:08:42.360865   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz" 
I0816 15:08:42.361259   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-cxccz/test-mhc-gx4kq/test-mhc-machine-d7wzj/"
node created: test-mhc-node-wh4p6
E0816 15:08:42.404888   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-wh4p6, got []"  "node"="test-mhc-node-wh4p6"
E0816 15:08:42.407111   10483 machine_controller.go:685] controllers/Machine "msg"="Unable to retrieve machine from node" "error"="no matching Machine"  "node"="test-mhc-node-wh4p6"
I0816 15:08:42.414060   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz" 
inframachine created: test-mhc-machine-infra-d5pgz
machine created: test-mhc-machine-5mswl
I0816 15:08:42.432536   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz" 
I0816 15:08:42.439025   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz" 
I0816 15:08:42.440216   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz" 
... skipping 26 lines ...
I0816 15:08:42.497752   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz" 
I0816 15:08:42.500204   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz" 
I0816 15:08:42.503869   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz" 
I0816 15:08:42.506103   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz" 
I0816 15:08:42.514006   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz" 
I0816 15:08:42.526217   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz" 
I0816 15:08:42.529391   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-cxccz/test-mhc-gx4kq/test-mhc-machine-5mswl/"
node created: test-mhc-node-txscs
E0816 15:08:42.534214   10483 machine_controller.go:685] controllers/Machine "msg"="Unable to retrieve machine from node" "error"="no matching Machine"  "node"="test-mhc-node-txscs"
E0816 15:08:42.534576   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-txscs, got []"  "node"="test-mhc-node-txscs"
I0816 15:08:42.561322   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz" 
Cleaning up nodes, machines and infra machines.
I0816 15:08:42.595774   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz" 
I0816 15:08:42.599528   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz" 
I0816 15:08:42.600027   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="NodeNotFound" "target"="test-mhc-cxccz/test-mhc-gx4kq/test-mhc-machine-d7wzj/"
I0816 15:08:42.629969   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz" 
I0816 15:08:42.630532   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="NodeNotFound" "target"="test-mhc-cxccz/test-mhc-gx4kq/test-mhc-machine-d7wzj/"
I0816 15:08:42.631008   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="NodeNotFound" "target"="test-mhc-cxccz/test-mhc-gx4kq/test-mhc-machine-5mswl/"
E0816 15:08:42.641260   10483 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-cxccz/test-cluster-vxn97"
=== RUN   TestMachineHealthCheck_Reconcile/it_marks_unhealthy_machines_for_remediation_when_there_is_one_unhealthy_Machine
E0816 15:08:42.664423   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machinehealthchecks.cluster.x-k8s.io \"test-mhc-gx4kq\" not found" "controller"="machinehealthcheck" "name"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz"
E0816 15:08:42.797605   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-d7wzj\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-d7wzj" "namespace"="test-mhc-cxccz"
inframachine created: test-mhc-machine-infra-vqq2l
machine created: test-mhc-machine-t5vqk
E0816 15:08:42.939952   10483 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-machine-watches-m56lq/machine-reconcile-x4mwn"
I0816 15:08:43.664765   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-gx4kq" "namespace"="test-mhc-cxccz" 
I0816 15:08:43.664867   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:43.684040   10483 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={}
I0816 15:08:43.714585   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:43.719394   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:43.721154   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
... skipping 30 lines ...
I0816 15:08:43.788672   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:43.790751   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:43.792520   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:43.794307   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:43.796056   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:43.797786   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
E0816 15:08:43.797937   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-5mswl\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-5mswl" "namespace"="test-mhc-cxccz"
I0816 15:08:43.799617   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:43.801373   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:43.803187   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:43.804974   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:43.806730   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:43.808497   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
... skipping 463 lines ...
I0816 15:08:44.787536   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:44.789298   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:44.791179   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:44.792956   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:44.794826   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:44.796603   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
E0816 15:08:44.798290   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-d7wzj\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-d7wzj" "namespace"="test-mhc-cxccz"
I0816 15:08:44.798332   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:44.800145   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:44.801892   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:44.803817   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:44.805639   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:44.807529   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
... skipping 416 lines ...
I0816 15:08:45.800405   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:45.802225   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:45.804344   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:45.806241   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:45.807153   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:45.808182   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
E0816 15:08:45.812831   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-5mswl\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-5mswl" "namespace"="test-mhc-cxccz"
I0816 15:08:45.814978   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:45.815342   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-tltr6/test-mhc-c97kv/test-mhc-machine-t5vqk/"
I0816 15:08:45.833604   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:45.834036   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-tltr6/test-mhc-c97kv/test-mhc-machine-t5vqk/"
E0816 15:08:45.838440   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-l2bgd, got []"  "node"="test-mhc-node-l2bgd"
node created: test-mhc-node-l2bgd
I0816 15:08:45.847893   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
inframachine created: test-mhc-machine-infra-s2c8l
I0816 15:08:45.869201   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:45.872208   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
machine created: test-mhc-machine-bvh8b
... skipping 295 lines ...
I0816 15:08:46.787828   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:46.791771   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:46.794619   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:46.800063   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:46.803601   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:46.807188   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
E0816 15:08:46.814840   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-d7wzj\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-d7wzj" "namespace"="test-mhc-cxccz"
I0816 15:08:46.816994   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:46.819466   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:46.823039   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:46.826496   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:46.829935   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:46.834748   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
... skipping 401 lines ...
I0816 15:08:47.895855   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:47.898042   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:47.900582   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:47.901775   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:47.904045   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:47.906198   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
E0816 15:08:47.919932   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-5mswl\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-5mswl" "namespace"="test-mhc-cxccz"
I0816 15:08:47.932764   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:47.944534   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:47.946953   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:47.948970   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:47.950834   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:47.952963   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
... skipping 335 lines ...
I0816 15:08:48.922490   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:48.924669   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:48.926812   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:48.929075   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:48.932103   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:48.933362   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:48.933731   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-tltr6/test-mhc-c97kv/test-mhc-machine-bvh8b/"
E0816 15:08:48.933759   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-d7wzj\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-d7wzj" "namespace"="test-mhc-cxccz"
I0816 15:08:48.943939   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:48.944363   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-tltr6/test-mhc-c97kv/test-mhc-machine-bvh8b/"
E0816 15:08:48.985636   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-ds2qw, got []"  "node"="test-mhc-node-ds2qw"
node created: test-mhc-node-ds2qw
I0816 15:08:48.994627   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
inframachine created: test-mhc-machine-infra-nbqwm
machine created: test-mhc-machine-ztllk
I0816 15:08:49.012822   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:49.020141   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
... skipping 243 lines ...
I0816 15:08:49.926915   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:49.933989   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:49.937082   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:49.940162   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:49.942919   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:49.945594   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
E0816 15:08:49.947925   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-5mswl\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-5mswl" "namespace"="test-mhc-cxccz"
I0816 15:08:49.948964   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:49.950346   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:49.951785   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:49.953326   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:49.955989   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:49.958626   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
... skipping 268 lines ...
I0816 15:08:50.946105   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:50.970566   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:50.972170   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:50.973639   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:50.975180   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:50.981430   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
E0816 15:08:50.991648   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-d7wzj\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-d7wzj" "namespace"="test-mhc-cxccz"
I0816 15:08:50.995806   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:51.008846   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:51.011161   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:51.013279   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:51.015291   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:51.017661   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
... skipping 286 lines ...
I0816 15:08:51.983502   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:51.986861   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:51.990184   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:51.994510   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:51.997172   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:52.016336   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:52.016866   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-tltr6/test-mhc-c97kv/test-mhc-machine-ztllk/"
E0816 15:08:52.022862   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-5mswl\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-5mswl" "namespace"="test-mhc-cxccz"
I0816 15:08:52.030634   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:52.031365   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-tltr6/test-mhc-c97kv/test-mhc-machine-ztllk/"
E0816 15:08:52.033876   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-4kqvt, got []"  "node"="test-mhc-node-4kqvt"
node created: test-mhc-node-4kqvt
Cleaning up nodes, machines and infra machines.
I0816 15:08:52.049093   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:52.049653   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Condition Ready on node is reporting status Unknown for more than 5m0s" "reason"="UnhealthyNode" "target"="test-mhc-tltr6/test-mhc-c97kv/test-mhc-machine-ztllk/test-mhc-node-4kqvt"
I0816 15:08:52.080393   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
Cleaning up nodes, machines and infra machines.
I0816 15:08:52.084933   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="NodeNotFound" "target"="test-mhc-tltr6/test-mhc-c97kv/test-mhc-machine-ztllk/"
E0816 15:08:52.098359   10483 machinehealthcheck_controller.go:167] controllers/MachineHealthCheck "msg"="Failed to reconcile MachineHealthCheck" "error"="failed to patch unhealthy machine status for machine: test-mhc-tltr6/test-mhc-machine-ztllk: error patching conditions: The condition \"HealthCheckSucceeded\" was modified by a different process and this caused a merge/ChangeCondition conflict:   \u0026v1alpha3.Condition{\n  \t... // 2 identical fields\n  \tSeverity:           \"Warning\",\n  \tLastTransitionTime: v1.Time{Time: s\"2022-08-16 15:08:52 +0000 UTC\"},\n- \tReason:             \"UnhealthyNode\",\n+ \tReason:             \"NodeNotFound\",\n- \tMessage:            \"Condition Ready on node is reporting status Unknown for more than 5m0s\",\n+ \tMessage:            \"\",\n  }\n" "cluster"="test-cluster-27qbg" 
E0816 15:08:52.103792   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to patch unhealthy machine status for machine: test-mhc-tltr6/test-mhc-machine-ztllk: error patching conditions: The condition \"HealthCheckSucceeded\" was modified by a different process and this caused a merge/ChangeCondition conflict:   \u0026v1alpha3.Condition{\n  \t... // 2 identical fields\n  \tSeverity:           \"Warning\",\n  \tLastTransitionTime: v1.Time{Time: s\"2022-08-16 15:08:52 +0000 UTC\"},\n- \tReason:             \"UnhealthyNode\",\n+ \tReason:             \"NodeNotFound\",\n- \tMessage:            \"Condition Ready on node is reporting status Unknown for more than 5m0s\",\n+ \tMessage:            \"\",\n  }\n" "controller"="machinehealthcheck" "name"="test-mhc-c97kv" "namespace"="test-mhc-tltr6"
I0816 15:08:52.126834   10483 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="test-cluster-27qbg" "namespace"="test-mhc-tltr6" "count"=2
I0816 15:08:52.126925   10483 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-27qbg" "namespace"="test-mhc-tltr6" "descendants"="Worker machines: test-mhc-machine-t5vqk,test-mhc-machine-bvh8b,test-mhc-machine-ztllk" "indirect descendants count"=1
I0816 15:08:52.141322   10483 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="test-cluster-27qbg" "namespace"="test-mhc-tltr6" "count"=2
I0816 15:08:52.141401   10483 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-27qbg" "namespace"="test-mhc-tltr6" "descendants"="Worker machines: test-mhc-machine-ztllk,test-mhc-machine-t5vqk,test-mhc-machine-bvh8b" "indirect descendants count"=1
=== RUN   TestMachineHealthCheck_Reconcile/it_marks_unhealthy_machines_for_remediation_when_the_unhealthy_Machines_exceed_MaxUnhealthy
inframachine created: test-mhc-machine-infra-865pm
machine created: test-mhc-machine-x6jtl
I0816 15:08:53.026833   10483 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-27qbg" "machine"="test-mhc-machine-bvh8b" "namespace"="test-mhc-tltr6" "cause"="cluster is being deleted" "node"={"name":"test-mhc-node-ds2qw"}
E0816 15:08:53.085319   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-bvh8b\" not found" "controller"="machine" "name"="test-mhc-machine-bvh8b" "namespace"="test-mhc-tltr6"
I0816 15:08:53.104080   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-c97kv" "namespace"="test-mhc-tltr6" 
I0816 15:08:53.104185   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:08:53.119082   10483 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={}
I0816 15:08:53.248505   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:08:53.253660   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:08:53.274586   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:08:53.315631   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:08:53.396726   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:08:53.557784   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:08:53.882596   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
E0816 15:08:54.085731   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-d7wzj\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-d7wzj" "namespace"="test-mhc-cxccz"
I0816 15:08:54.523533   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:08:55.086306   10483 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-27qbg" "machine"="test-mhc-machine-ztllk" "namespace"="test-mhc-tltr6" "cause"="cluster is being deleted" "node"={"name":"test-mhc-node-4kqvt"}
E0816 15:08:55.132926   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-ztllk\" not found" "controller"="machine" "name"="test-mhc-machine-ztllk" "namespace"="test-mhc-tltr6"
I0816 15:08:55.804608   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:08:56.133520   10483 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-27qbg" "machine"="test-mhc-machine-t5vqk" "namespace"="test-mhc-tltr6" "cause"="cluster is being deleted" "node"={"name":"test-mhc-node-l2bgd"}
E0816 15:08:56.312455   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-t5vqk\" not found" "controller"="machine" "name"="test-mhc-machine-t5vqk" "namespace"="test-mhc-tltr6"
E0816 15:08:57.158928   10483 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-tltr6/test-cluster-27qbg"
E0816 15:08:57.312873   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-5mswl\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-5mswl" "namespace"="test-mhc-cxccz"
I0816 15:08:58.330431   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:08:58.336246   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
E0816 15:08:58.337637   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-d7wzj\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-d7wzj" "namespace"="test-mhc-cxccz"
I0816 15:08:58.379029   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:08:58.394176   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
node created: test-mhc-node-qp57z
E0816 15:08:58.424871   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-qp57z, got []"  "node"="test-mhc-node-qp57z"
I0816 15:08:58.433185   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
inframachine created: test-mhc-machine-infra-kqldn
machine created: test-mhc-machine-p74hs
I0816 15:08:58.483923   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:08:58.503728   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:08:58.509937   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:08:58.526492   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:08:58.567900   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:08:58.652092   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:08:58.813592   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:08:59.135142   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
E0816 15:08:59.338073   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-5mswl\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-5mswl" "namespace"="test-mhc-cxccz"
I0816 15:08:59.776554   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:09:00.360523   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:09:00.367923   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:09:00.382406   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:09:00.400405   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:09:00.415978   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:09:00.422401   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
E0816 15:09:00.422659   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-d7wzj\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-d7wzj" "namespace"="test-mhc-cxccz"
I0816 15:09:00.456283   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
node created: test-mhc-node-8jlpx
E0816 15:09:00.476017   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-8jlpx, got []"  "node"="test-mhc-node-8jlpx"
I0816 15:09:00.484879   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
inframachine created: test-mhc-machine-infra-pfcxv
I0816 15:09:00.497589   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:09:00.501496   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
machine created: test-mhc-machine-9pd77
I0816 15:09:00.522197   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:09:01.058884   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
E0816 15:09:01.423043   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-5mswl\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-5mswl" "namespace"="test-mhc-cxccz"
I0816 15:09:02.436522   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:09:02.459052   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:09:02.471731   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:09:02.484372   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:09:02.488777   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:09:02.505479   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
E0816 15:09:02.512024   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-d7wzj\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-d7wzj" "namespace"="test-mhc-cxccz"
I0816 15:09:02.512069   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:09:02.540554   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
E0816 15:09:02.616366   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-hds5r, got []"  "node"="test-mhc-node-hds5r"
node created: test-mhc-node-hds5r
I0816 15:09:02.626494   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
Cleaning up nodes, machines and infra machines.
I0816 15:09:02.641365   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:09:02.677854   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:09:02.680936   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
... skipping 3 lines ...
I0816 15:09:02.719950   10483 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-wt6qv" "namespace"="test-mhc-55hlk" "descendants"="Worker machines: test-mhc-machine-9pd77,test-mhc-machine-x6jtl,test-mhc-machine-p74hs" "indirect descendants count"=1
I0816 15:09:02.729139   10483 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="test-cluster-wt6qv" "namespace"="test-mhc-55hlk" "count"=2
I0816 15:09:02.729208   10483 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-wt6qv" "namespace"="test-mhc-55hlk" "descendants"="Worker machines: test-mhc-machine-p74hs,test-mhc-machine-9pd77,test-mhc-machine-x6jtl" "indirect descendants count"=1
=== RUN   TestMachineHealthCheck_Reconcile/when_a_Machine_has_no_Node_ref_for_less_than_the_NodeStartupTimeout
inframachine created: test-mhc-machine-infra-zkbjt
machine created: test-mhc-machine-mrpmf
E0816 15:09:02.898427   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="[MachineHealthCheck.cluster.x-k8s.io \"test-mhc-ltqqx\" not found, machinehealthchecks.cluster.x-k8s.io \"test-mhc-ltqqx\" not found]" "controller"="machinehealthcheck" "name"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk"
E0816 15:09:03.512537   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-5mswl\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-5mswl" "namespace"="test-mhc-cxccz"
I0816 15:09:03.898933   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
I0816 15:09:03.926503   10483 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={}
I0816 15:09:03.946746   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-ltqqx" "namespace"="test-mhc-55hlk" 
I0816 15:09:03.946969   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
I0816 15:09:04.514523   10483 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-wt6qv" "machine"="test-mhc-machine-x6jtl" "namespace"="test-mhc-55hlk" "cause"="cluster is being deleted" "node"={"name":"test-mhc-node-qp57z"}
E0816 15:09:04.567391   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-x6jtl\" not found" "controller"="machine" "name"="test-mhc-machine-x6jtl" "namespace"="test-mhc-55hlk"
I0816 15:09:05.568010   10483 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-wt6qv" "machine"="test-mhc-machine-p74hs" "namespace"="test-mhc-55hlk" "cause"="cluster is being deleted" "node"={"name":"test-mhc-node-8jlpx"}
E0816 15:09:05.619943   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-p74hs\" not found" "controller"="machine" "name"="test-mhc-machine-p74hs" "namespace"="test-mhc-55hlk"
I0816 15:09:06.622294   10483 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-wt6qv" "machine"="test-mhc-machine-9pd77" "namespace"="test-mhc-55hlk" "cause"="cluster is being deleted" "node"={"name":"test-mhc-node-hds5r"}
E0816 15:09:06.663159   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-9pd77\" not found" "controller"="machine" "name"="test-mhc-machine-9pd77" "namespace"="test-mhc-55hlk"
I0816 15:09:07.672066   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
E0816 15:09:07.677658   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-d7wzj\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-d7wzj" "namespace"="test-mhc-cxccz"
I0816 15:09:07.678080   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
node created: test-mhc-node-htkhd
E0816 15:09:07.718507   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-htkhd, got []"  "node"="test-mhc-node-htkhd"
E0816 15:09:07.718775   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-htkhd, got []"  "node"="test-mhc-node-htkhd"
I0816 15:09:07.726902   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
inframachine created: test-mhc-machine-infra-m9zsw
machine created: test-mhc-machine-6jq5v
I0816 15:09:07.746670   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
E0816 15:09:07.748552   10483 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-55hlk/test-cluster-wt6qv"
I0816 15:09:07.748904   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
I0816 15:09:07.758665   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
E0816 15:09:08.678108   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-5mswl\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-5mswl" "namespace"="test-mhc-cxccz"
I0816 15:09:09.693473   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
I0816 15:09:09.700736   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
I0816 15:09:09.712881   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
I0816 15:09:09.722228   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
I0816 15:09:09.732665   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
I0816 15:09:09.740993   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
I0816 15:09:09.766925   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
E0816 15:09:09.777858   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-kgnjz, got []"  "node"="test-mhc-node-kgnjz"
node created: test-mhc-node-kgnjz
I0816 15:09:09.782479   10483 machine_controller_noderef.go:86] controllers/Machine "msg"="Set Machine's NodeRef" "machine"="test-mhc-machine-6jq5v" "namespace"="test-mhc-4g2gq" "noderef"="test-mhc-node-kgnjz"
I0816 15:09:09.791340   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
inframachine created: test-mhc-machine-infra-4h52t
I0816 15:09:09.814878   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
machine created: test-mhc-machine-spnfj
... skipping 8 lines ...
I0816 15:09:10.047668   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
I0816 15:09:10.059640   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
I0816 15:09:10.060096   10483 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-czrxd" "machine"="test-mhc-machine-spnfj" "namespace"="test-mhc-4g2gq" "cause"="noderef is nil" "node"=null
Cleaning up nodes, machines and infra machines.
I0816 15:09:10.073670   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
I0816 15:09:10.086866   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
I0816 15:09:10.087457   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="NodeNotFound" "target"="test-mhc-4g2gq/test-mhc-l2v26/test-mhc-machine-mrpmf/"
I0816 15:09:10.121916   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
I0816 15:09:10.122635   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="NodeNotFound" "target"="test-mhc-4g2gq/test-mhc-l2v26/test-mhc-machine-mrpmf/"
I0816 15:09:10.123138   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="NodeNotFound" "target"="test-mhc-4g2gq/test-mhc-l2v26/test-mhc-machine-6jq5v/"
E0816 15:09:10.142606   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-spnfj\" not found" "controller"="machine" "name"="test-mhc-machine-spnfj" "namespace"="test-mhc-4g2gq"
=== RUN   TestMachineHealthCheck_Reconcile/when_a_Machine_has_no_Node_ref_for_longer_than_the_NodeStartupTimeout
=== RUN   TestMachineHealthCheck_Reconcile/when_a_Machine's_Node_has_gone_away
=== RUN   TestMachineHealthCheck_Reconcile/should_react_when_a_Node_transitions_to_unhealthy
I0816 15:09:10.154738   10483 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="test-cluster-czrxd" "namespace"="test-mhc-4g2gq" "count"=2
I0816 15:09:10.154936   10483 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-czrxd" "namespace"="test-mhc-4g2gq" "descendants"="Worker machines: test-mhc-machine-mrpmf,test-mhc-machine-6jq5v" "indirect descendants count"=0
I0816 15:09:10.160980   10483 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="test-cluster-czrxd" "namespace"="test-mhc-4g2gq" "count"=2
I0816 15:09:10.161191   10483 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-czrxd" "namespace"="test-mhc-4g2gq" "descendants"="Worker machines: test-mhc-machine-mrpmf,test-mhc-machine-6jq5v" "indirect descendants count"=0
inframachine created: test-mhc-machine-infra-fqkmw
machine created: test-mhc-machine-8wdgw
E0816 15:09:10.316726   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machinehealthchecks.cluster.x-k8s.io \"test-mhc-l2v26\" not found" "controller"="machinehealthcheck" "name"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq"
I0816 15:09:11.143170   10483 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-czrxd" "machine"="test-mhc-machine-6jq5v" "namespace"="test-mhc-4g2gq" "cause"="cluster is being deleted" "node"={"kind":"Node","name":"test-mhc-node-kgnjz","uid":"d09a908e-8a3d-4436-9a52-dae5d94df1b1","apiVersion":"v1"}
E0816 15:09:11.191320   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-6jq5v\" not found" "controller"="machine" "name"="test-mhc-machine-6jq5v" "namespace"="test-mhc-4g2gq"
I0816 15:09:11.317025   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:11.353263   10483 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={}
I0816 15:09:11.372841   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-l2v26" "namespace"="test-mhc-4g2gq" 
I0816 15:09:11.372914   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:11.373915   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:11.375927   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
... skipping 391 lines ...
I0816 15:09:12.223825   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:12.225701   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:12.227571   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:12.229368   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:12.240081   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:12.242290   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
E0816 15:09:12.244590   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-mrpmf\" not found" "controller"="machine" "name"="test-mhc-machine-mrpmf" "namespace"="test-mhc-4g2gq"
I0816 15:09:12.244591   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:12.254529   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:12.256691   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:12.259245   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:12.261295   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:12.263405   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
... skipping 426 lines ...
I0816 15:09:13.248353   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:13.250137   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:13.253135   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:13.255218   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:13.255839   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:13.260866   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:13.261176   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-8rv2d/test-mhc-5c8qt/test-mhc-machine-8wdgw/"
E0816 15:09:13.262308   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-d7wzj\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-d7wzj" "namespace"="test-mhc-cxccz"
I0816 15:09:13.273404   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:13.274050   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "target"="test-mhc-8rv2d/test-mhc-5c8qt/test-mhc-machine-8wdgw/"
E0816 15:09:13.318852   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-v2k4h, got []"  "node"="test-mhc-node-v2k4h"
E0816 15:09:13.319170   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-v2k4h, got []"  "node"="test-mhc-node-v2k4h"
node created: test-mhc-node-v2k4h
I0816 15:09:13.339736   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:13.368056   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:13.376269   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:13.376691   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Condition Ready on node is reporting status Unknown for more than 5m0s" "reason"="UnhealthyNode" "target"="test-mhc-8rv2d/test-mhc-5c8qt/test-mhc-machine-8wdgw/test-mhc-node-v2k4h"
I0816 15:09:13.403469   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:13.403909   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Condition Ready on node is reporting status Unknown for more than 5m0s" "reason"="UnhealthyNode" "target"="test-mhc-8rv2d/test-mhc-5c8qt/test-mhc-machine-8wdgw/test-mhc-node-v2k4h"
Cleaning up nodes, machines and infra machines.
I0816 15:09:13.412501   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:13.412890   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="NodeNotFound" "target"="test-mhc-8rv2d/test-mhc-5c8qt/test-mhc-machine-8wdgw/"
I0816 15:09:13.433092   10483 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-gwpdj" "namespace"="test-mhc-8rv2d" "descendants"="Worker machines: test-mhc-machine-8wdgw" "indirect descendants count"=1
=== RUN   TestMachineHealthCheck_Reconcile/when_in_a_MachineSet,_unhealthy_machines_should_be_deleted
I0816 15:09:13.439275   10483 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-gwpdj" "namespace"="test-mhc-8rv2d" "descendants"="Worker machines: test-mhc-machine-8wdgw" "indirect descendants count"=1
I0816 15:09:13.547445   10483 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="mhc-ms-fzclq" "namespace"="test-mhc-js72c" "creating"=1 "need"=1
I0816 15:09:13.547506   10483 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 1, ( spec.replicas(1) \u003e currentMachineCount(0) )" "machineset"="mhc-ms-fzclq" "namespace"="test-mhc-js72c" 
I0816 15:09:13.564743   10483 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 1 with name \"mhc-ms-fzclq-srdks\"" "machineset"="mhc-ms-fzclq" "namespace"="test-mhc-js72c" 
I0816 15:09:13.598672   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-5c8qt" "namespace"="test-mhc-8rv2d" 
I0816 15:09:13.630176   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-rp795" "namespace"="test-mhc-js72c" 
I0816 15:09:13.663349   10483 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinehealthcheck" "source"={}
I0816 15:09:13.683550   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-rp795" "namespace"="test-mhc-js72c" 
E0816 15:09:14.262725   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-5mswl\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-5mswl" "namespace"="test-mhc-cxccz"
I0816 15:09:14.683757   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-rp795" "namespace"="test-mhc-js72c" 
E0816 15:09:15.176005   10483 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-4g2gq/test-cluster-czrxd"
I0816 15:09:15.263289   10483 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-gwpdj" "machine"="test-mhc-machine-8wdgw" "namespace"="test-mhc-8rv2d" "cause"="cluster is being deleted" "node"={"name":"test-mhc-node-v2k4h"}
E0816 15:09:15.308993   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-8wdgw\" not found" "controller"="machine" "name"="test-mhc-machine-8wdgw" "namespace"="test-mhc-8rv2d"
I0816 15:09:15.684629   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-rp795" "namespace"="test-mhc-js72c" 
I0816 15:09:16.317553   10483 machineset_controller.go:139] controllers/MachineSet "msg"="Reconciliation is paused for this object" "machineset"="mhc-ms-fzclq" "namespace"="test-mhc-js72c" 
I0816 15:09:16.317759   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-rp795" "namespace"="test-mhc-js72c" 
I0816 15:09:16.341180   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-rp795" "namespace"="test-mhc-js72c" 
I0816 15:09:16.350622   10483 machineset_controller.go:139] controllers/MachineSet "msg"="Reconciliation is paused for this object" "machineset"="mhc-ms-fzclq" "namespace"="test-mhc-js72c" 
I0816 15:09:16.359498   10483 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="mhc-ms-fzclq-srdks" "namespace"="test-mhc-js72c" 
... skipping 5 lines ...
I0816 15:09:16.378877   10483 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="mhc-ms-fzclq-srdks" "namespace"="test-mhc-js72c" 
I0816 15:09:16.378915   10483 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="mhc-ms-fzclq-srdks" "namespace"="test-mhc-js72c" 
I0816 15:09:16.685691   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-rp795" "namespace"="test-mhc-js72c" 
I0816 15:09:17.378178   10483 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="mhc-ms-fzclq-srdks" "namespace"="test-mhc-js72c" 
I0816 15:09:17.378222   10483 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="mhc-ms-fzclq-srdks" "namespace"="test-mhc-js72c" 
I0816 15:09:18.000706   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-rp795" "namespace"="test-mhc-js72c" 
I0816 15:09:18.001140   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1s" "reason"="NodeStartupTimeout" "target"="test-mhc-js72c/test-mhc-rp795/mhc-ms-fzclq-srdks/"
I0816 15:09:18.009171   10483 machineset_controller.go:139] controllers/MachineSet "msg"="Reconciliation is paused for this object" "machineset"="mhc-ms-fzclq" "namespace"="test-mhc-js72c" 
I0816 15:09:18.017537   10483 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="mhc-ms-fzclq-srdks" "namespace"="test-mhc-js72c" 
I0816 15:09:18.017585   10483 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="mhc-ms-fzclq-srdks" "namespace"="test-mhc-js72c" 
I0816 15:09:18.026499   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-rp795" "namespace"="test-mhc-js72c" 
I0816 15:09:18.026911   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1s" "reason"="NodeStartupTimeout" "target"="test-mhc-js72c/test-mhc-rp795/mhc-ms-fzclq-srdks/"
I0816 15:09:18.030069   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-rp795" "namespace"="test-mhc-js72c" 
I0816 15:09:18.030409   10483 machinehealthcheck_controller.go:387] controllers/MachineHealthCheck "msg"="Target has failed health check, marking for remediation"  "message"="Node failed to report startup in 1s" "reason"="NodeStartupTimeout" "target"="test-mhc-js72c/test-mhc-rp795/mhc-ms-fzclq-srdks/"
I0816 15:09:18.031508   10483 machineset_controller.go:139] controllers/MachineSet "msg"="Reconciliation is paused for this object" "machineset"="mhc-ms-fzclq" "namespace"="test-mhc-js72c" 
I0816 15:09:18.031632   10483 machineset_controller.go:139] controllers/MachineSet "msg"="Reconciliation is paused for this object" "machineset"="mhc-ms-fzclq" "namespace"="test-mhc-js72c" 
I0816 15:09:18.043193   10483 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="mhc-ms-fzclq-srdks" "namespace"="test-mhc-js72c" 
I0816 15:09:18.043238   10483 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="mhc-ms-fzclq-srdks" "namespace"="test-mhc-js72c" 
I0816 15:09:18.106016   10483 cluster_controller.go:223] controllers/Cluster "msg"="Cluster still has children - deleting them first" "cluster"="test-cluster-7prth" "namespace"="test-mhc-js72c" "count"=1
I0816 15:09:18.106080   10483 cluster_controller.go:241] controllers/Cluster "msg"="Deleting child" "cluster"="test-cluster-7prth" "namespace"="test-mhc-js72c" "gvk"="cluster.x-k8s.io/v1alpha3, Kind=MachineSet" "name"="mhc-ms-fzclq"
... skipping 63 lines ...
I0816 15:09:18.361973   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-svs7m" "namespace"="test-mhc-lll68" 
I0816 15:09:18.363558   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-svs7m" "namespace"="test-mhc-lll68" 
I0816 15:09:18.365283   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-svs7m" "namespace"="test-mhc-lll68" 
I0816 15:09:18.367097   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-svs7m" "namespace"="test-mhc-lll68" 
I0816 15:09:18.369316   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-svs7m" "namespace"="test-mhc-lll68" 
I0816 15:09:18.370034   10483 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-7prth" "machine"="mhc-ms-fzclq-srdks" "namespace"="test-mhc-js72c" "cause"="cluster is being deleted" "node"=null
E0816 15:09:18.408338   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"mhc-ms-fzclq-srdks\" not found" "controller"="machine" "name"="mhc-ms-fzclq-srdks" "namespace"="test-mhc-js72c"
I0816 15:09:18.419986   10483 machinehealthcheck_controller.go:379] controllers/MachineHealthCheck "msg"="Target has failed health check, creating an external remediation request"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "remediation request name"="test-mhc-machine-tx9pc" "target"="test-mhc-lll68/test-mhc-svs7m/test-mhc-machine-tx9pc/"
E0816 15:09:18.422597   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-pnrl4, got []"  "node"="test-mhc-node-pnrl4"
E0816 15:09:18.422799   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-pnrl4, got []"  "node"="test-mhc-node-pnrl4"
E0816 15:09:18.422998   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-pnrl4, got []"  "node"="test-mhc-node-pnrl4"
node created: test-mhc-node-pnrl4
I0816 15:09:18.476047   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-svs7m" "namespace"="test-mhc-lll68" 
E0816 15:09:18.487103   10483 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-8rv2d/test-cluster-gwpdj"
I0816 15:09:18.509162   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-svs7m" "namespace"="test-mhc-lll68" 
I0816 15:09:18.511838   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-svs7m" "namespace"="test-mhc-lll68" 
I0816 15:09:18.519789   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-svs7m" "namespace"="test-mhc-lll68" 
I0816 15:09:18.522722   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-svs7m" "namespace"="test-mhc-lll68" 
I0816 15:09:18.526223   10483 machinehealthcheck_controller.go:379] controllers/MachineHealthCheck "msg"="Target has failed health check, creating an external remediation request"  "message"="Condition Ready on node is reporting status Unknown for more than 5m0s" "reason"="UnhealthyNode" "remediation request name"="test-mhc-machine-tx9pc" "target"="test-mhc-lll68/test-mhc-svs7m/test-mhc-machine-tx9pc/test-mhc-node-pnrl4"
I0816 15:09:18.543007   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-svs7m" "namespace"="test-mhc-lll68" 
I0816 15:09:18.552019   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-svs7m" "namespace"="test-mhc-lll68" 
Cleaning up nodes, machines and infra machines.
I0816 15:09:18.569309   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-svs7m" "namespace"="test-mhc-lll68" 
I0816 15:09:18.572211   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-svs7m" "namespace"="test-mhc-lll68" 
I0816 15:09:18.576169   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-svs7m" "namespace"="test-mhc-lll68" 
... skipping 336 lines ...
I0816 15:09:19.455855   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:19.457775   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:19.459697   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:19.461941   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:19.463705   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:19.465984   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
E0816 15:09:19.467082   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-tx9pc\" not found" "controller"="machine" "name"="test-mhc-machine-tx9pc" "namespace"="test-mhc-lll68"
I0816 15:09:19.467971   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:19.469924   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:19.471983   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:19.474028   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:19.476008   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:19.478149   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
... skipping 461 lines ...
I0816 15:09:20.458088   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:20.459828   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:20.461693   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:20.463705   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:20.465479   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:20.467138   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
E0816 15:09:20.467390   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-d7wzj\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-d7wzj" "namespace"="test-mhc-cxccz"
I0816 15:09:20.469006   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:20.470603   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:20.472577   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:20.474488   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:20.476331   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:20.478259   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
... skipping 503 lines ...
I0816 15:09:21.472280   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:21.474045   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:21.476435   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:21.477120   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:21.479009   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:21.480934   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
E0816 15:09:21.481220   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-5mswl\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-5mswl" "namespace"="test-mhc-cxccz"
I0816 15:09:21.484243   10483 machinehealthcheck_controller.go:379] controllers/MachineHealthCheck "msg"="Target has failed health check, creating an external remediation request"  "message"="Node failed to report startup in 1ms" "reason"="NodeStartupTimeout" "remediation request name"="test-mhc-machine-x76lj" "target"="test-mhc-7clbs/test-mhc-nrj2x/test-mhc-machine-x76lj/"
I0816 15:09:21.495470   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
E0816 15:09:21.573849   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-t7ghv, got []"  "node"="test-mhc-node-t7ghv"
E0816 15:09:21.574092   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-t7ghv, got []"  "node"="test-mhc-node-t7ghv"
node created: test-mhc-node-t7ghv
E0816 15:09:21.574776   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node test-mhc-node-t7ghv, got []"  "node"="test-mhc-node-t7ghv"
I0816 15:09:21.584095   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:21.606528   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:21.619451   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:21.635270   10483 machinehealthcheck_controller.go:379] controllers/MachineHealthCheck "msg"="Target has failed health check, creating an external remediation request"  "message"="Condition Ready on node is reporting status Unknown for more than 5m0s" "reason"="UnhealthyNode" "remediation request name"="test-mhc-machine-x76lj" "target"="test-mhc-7clbs/test-mhc-nrj2x/test-mhc-machine-x76lj/test-mhc-node-t7ghv"
I0816 15:09:21.655138   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:21.666381   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:21.694367   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
Cleaning up nodes, machines and infra machines.
I0816 15:09:21.702481   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:21.705832   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
I0816 15:09:21.713535   10483 machinehealthcheck_controller.go:379] controllers/MachineHealthCheck "msg"="Target has failed health check, creating an external remediation request"  "message"="" "reason"="NodeNotFound" "remediation request name"="test-mhc-machine-x76lj" "target"="test-mhc-7clbs/test-mhc-nrj2x/test-mhc-machine-x76lj/"
I0816 15:09:21.720912   10483 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-pjrbt" "namespace"="test-mhc-7clbs" "descendants"="Worker machines: test-mhc-machine-x76lj" "indirect descendants count"=1
I0816 15:09:21.726672   10483 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster-pjrbt" "namespace"="test-mhc-7clbs" "descendants"="Worker machines: test-mhc-machine-x76lj" "indirect descendants count"=1
E0816 15:09:21.734412   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machinehealthchecks.cluster.x-k8s.io \"test-mhc-nrj2x\" not found" "controller"="machinehealthcheck" "name"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs"
--- PASS: TestMachineHealthCheck_Reconcile (41.15s)
    --- PASS: TestMachineHealthCheck_Reconcile/it_should_ensure_the_correct_cluster-name_label_when_no_existing_labels_exist (0.15s)
    --- PASS: TestMachineHealthCheck_Reconcile/it_should_ensure_the_correct_cluster-name_label_when_the_label_has_the_wrong_value (0.05s)
    --- PASS: TestMachineHealthCheck_Reconcile/it_should_ensure_the_correct_cluster-name_label_when_other_labels_are_present (0.09s)
    --- PASS: TestMachineHealthCheck_Reconcile/it_should_ensure_an_owner_reference_is_present_when_no_existing_ones_exist (1.04s)
    --- PASS: TestMachineHealthCheck_Reconcile/it_should_ensure_an_owner_reference_is_present_when_modifying_existing_ones (0.23s)
... skipping 10 lines ...
    --- SKIP: TestMachineHealthCheck_Reconcile/when_a_machine_is_paused (0.00s)
        machinehealthcheck_controller_test.go:933: skipping until made stable
    --- PASS: TestMachineHealthCheck_Reconcile/When_remediationTemplate_is_set_and_node_transitions_to_unhealthy,_new_Remediation_Request_should_be_created (0.46s)
    --- PASS: TestMachineHealthCheck_Reconcile/When_remediationTemplate_is_set_and_node_transitions_back_to_healthy,_new_Remediation_Request_should_be_deleted (3.15s)
=== RUN   TestClusterToMachineHealthCheck
=== RUN   TestClusterToMachineHealthCheck/when_the_object_passed_isn't_a_cluster
E0816 15:09:21.738071   10483 machinehealthcheck_controller.go:416]  "msg"="expected a Cluster" "error"="incorrect type"  "type"="handler.MapObject"
=== RUN   TestClusterToMachineHealthCheck/when_a_MachineHealthCheck_exists_for_the_Cluster_in_the_same_namespace
=== RUN   TestClusterToMachineHealthCheck/when_2_MachineHealthChecks_exists_for_the_Cluster_in_the_same_namespace
=== RUN   TestClusterToMachineHealthCheck/when_a_MachineHealthCheck_exists_for_another_Cluster_in_the_same_namespace
=== RUN   TestClusterToMachineHealthCheck/when_a_MachineHealthCheck_exists_for_another_Cluster_in_another_namespace
--- PASS: TestClusterToMachineHealthCheck (0.00s)
    --- PASS: TestClusterToMachineHealthCheck/when_the_object_passed_isn't_a_cluster (0.00s)
    --- PASS: TestClusterToMachineHealthCheck/when_a_MachineHealthCheck_exists_for_the_Cluster_in_the_same_namespace (0.00s)
    --- PASS: TestClusterToMachineHealthCheck/when_2_MachineHealthChecks_exists_for_the_Cluster_in_the_same_namespace (0.00s)
    --- PASS: TestClusterToMachineHealthCheck/when_a_MachineHealthCheck_exists_for_another_Cluster_in_the_same_namespace (0.00s)
    --- PASS: TestClusterToMachineHealthCheck/when_a_MachineHealthCheck_exists_for_another_Cluster_in_another_namespace (0.00s)
=== RUN   TestMachineToMachineHealthCheck
=== RUN   TestMachineToMachineHealthCheck/when_the_object_passed_isn't_a_machine
E0816 15:09:21.741156   10483 machinehealthcheck_controller.go:445]  "msg"="expected a Machine" "error"="incorrect type"  "type"="handler.MapObject"
=== RUN   TestMachineToMachineHealthCheck/when_a_MachineHealthCheck_matches_labels_for_the_Machine_in_the_same_namespace
=== RUN   TestMachineToMachineHealthCheck/when_2_MachineHealthChecks_match_labels_for_the_Machine_in_the_same_namespace
=== RUN   TestMachineToMachineHealthCheck/when_a_MachineHealthCheck_does_not_match_labels_for_the_Machine_in_the_same_namespace
=== RUN   TestMachineToMachineHealthCheck/when_a_MachineHealthCheck_matches_labels_for_the_Machine_in_another_namespace
--- PASS: TestMachineToMachineHealthCheck (0.00s)
    --- PASS: TestMachineToMachineHealthCheck/when_the_object_passed_isn't_a_machine (0.00s)
    --- PASS: TestMachineToMachineHealthCheck/when_a_MachineHealthCheck_matches_labels_for_the_Machine_in_the_same_namespace (0.00s)
    --- PASS: TestMachineToMachineHealthCheck/when_2_MachineHealthChecks_match_labels_for_the_Machine_in_the_same_namespace (0.00s)
    --- PASS: TestMachineToMachineHealthCheck/when_a_MachineHealthCheck_does_not_match_labels_for_the_Machine_in_the_same_namespace (0.00s)
    --- PASS: TestMachineToMachineHealthCheck/when_a_MachineHealthCheck_matches_labels_for_the_Machine_in_another_namespace (0.00s)
=== RUN   TestNodeToMachineHealthCheck
=== RUN   TestNodeToMachineHealthCheck/when_the_object_passed_isn't_a_Node
E0816 15:09:21.744290   10483 machinehealthcheck_controller.go:474]  "msg"="expected a Node" "error"="incorrect type"  "type"="handler.MapObject"
=== RUN   TestNodeToMachineHealthCheck/when_no_Machine_exists_for_the_Node
E0816 15:09:21.744641   10483 machinehealthcheck_controller.go:480]  "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node node1, got []"  "node"="node1"
=== RUN   TestNodeToMachineHealthCheck/when_two_Machines_exist_for_the_Node
E0816 15:09:21.745298   10483 machinehealthcheck_controller.go:480]  "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node node1, got [machine1 machine2]"  "node"="node1"
=== RUN   TestNodeToMachineHealthCheck/when_no_MachineHealthCheck_exists_for_the_Node_in_the_Machine's_namespace
=== RUN   TestNodeToMachineHealthCheck/when_a_MachineHealthCheck_exists_for_the_Node_in_the_Machine's_namespace
=== RUN   TestNodeToMachineHealthCheck/when_two_MachineHealthChecks_exist_for_the_Node_in_the_Machine's_namespace
=== RUN   TestNodeToMachineHealthCheck/when_a_MachineHealthCheck_exists_for_the_Node,_but_not_in_the_Machine's_cluster
--- PASS: TestNodeToMachineHealthCheck (0.00s)
    --- PASS: TestNodeToMachineHealthCheck/when_the_object_passed_isn't_a_Node (0.00s)
... skipping 31 lines ...
    --- PASS: TestGetMaxUnhealthy/when_maxUnhealthy_is_nil (0.00s)
    --- PASS: TestGetMaxUnhealthy/when_maxUnhealthy_is_not_an_int_or_percentage (0.00s)
    --- PASS: TestGetMaxUnhealthy/when_maxUnhealthy_is_an_int (0.00s)
    --- PASS: TestGetMaxUnhealthy/when_maxUnhealthy_is_a_40%_(of_5) (0.00s)
    --- PASS: TestGetMaxUnhealthy/when_maxUnhealthy_is_a_60%_(of_7) (0.00s)
=== RUN   TestPatchTargets
I0816 15:09:21.748804   10483 machinehealthcheck_controller.go:387]  "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="" "target"="default/mhc/machine1/"
I0816 15:09:21.749266   10483 machinehealthcheck_controller.go:387]  "msg"="Target has failed health check, marking for remediation"  "message"="" "reason"="" "target"="default/mhc/machine2/"
E0816 15:09:21.750648   10483 machinehealthcheck_controller.go:320]  "msg"="failed to patch healthy machine status for machine" "error"="machines.cluster.x-k8s.io \"machine1\" not found"  "machine"="machine1"
--- PASS: TestPatchTargets (0.00s)
=== RUN   TestGetTargetsFromMHC
=== RUN   TestGetTargetsFromMHC/with_no_matching_machines
=== RUN   TestGetTargetsFromMHC/when_a_machine's_node_is_missing
=== RUN   TestGetTargetsFromMHC/when_a_machine's_labels_do_not_match_the_selector
=== RUN   TestGetTargetsFromMHC/with_multiple_machines,_should_match_correct_nodes
... skipping 26 lines ...
--- PASS: TestMachineSetOwnerReference (0.00s)
    --- PASS: TestMachineSetOwnerReference/should_add_cluster_owner_reference_to_machine_set (0.00s)
    --- PASS: TestMachineSetOwnerReference/should_not_add_cluster_owner_reference_if_machine_is_owned_by_a_machine_deployment (0.00s)
=== RUN   TestMachineSetReconcile
=== RUN   TestMachineSetReconcile/ignore_machine_sets_marked_for_deletion
=== RUN   TestMachineSetReconcile/records_event_if_reconcile_fails
E0816 15:09:21.758659   10483 machineset_controller.go:151]  "msg"="Failed to reconcile MachineSet" "error"="failed to calculate MachineSet's Status: failed to calculate status for MachineSet default/machineset1: invalid label key \"--$-invalid\": name part must consist of alphanumeric characters, '-', '_' or '.', and must start and end with an alphanumeric character (e.g. 'MyName',  or 'my.name',  or '123-abc', regex used for validation is '([A-Za-z0-9][-A-Za-z0-9_.]*)?[A-Za-z0-9]')" "machineset"="machineset1" "namespace"="default" 
--- PASS: TestMachineSetReconcile (0.00s)
    --- PASS: TestMachineSetReconcile/ignore_machine_sets_marked_for_deletion (0.00s)
    --- PASS: TestMachineSetReconcile/records_event_if_reconcile_fails (0.00s)
=== RUN   TestMachineSetToMachines
=== RUN   TestMachineSetToMachines/should_return_empty_request_when_controller_is_set
=== RUN   TestMachineSetToMachines/should_return_nil_if_machine_has_no_owner_reference
... skipping 8 lines ...
--- PASS: TestAdoptOrphan (0.00s)
=== RUN   TestHasMatchingLabels
=== RUN   TestHasMatchingLabels/machine_set_and_machine_have_matching_labels
=== RUN   TestHasMatchingLabels/machine_set_and_machine_do_not_have_matching_labels
=== RUN   TestHasMatchingLabels/machine_set_has_empty_selector
=== RUN   TestHasMatchingLabels/machine_set_has_bad_selector
E0816 15:09:21.760398   10483 machineset_controller.go:569]  "msg"="Unable to convert selector" "error"="\"bad-operator\" is not a valid pod selector operator" "machine"="match" "machineset"="" "namespace"="" 
--- PASS: TestHasMatchingLabels (0.00s)
    --- PASS: TestHasMatchingLabels/machine_set_and_machine_have_matching_labels (0.00s)
    --- PASS: TestHasMatchingLabels/machine_set_and_machine_do_not_have_matching_labels (0.00s)
    --- PASS: TestHasMatchingLabels/machine_set_has_empty_selector (0.00s)
    --- PASS: TestHasMatchingLabels/machine_set_has_bad_selector (0.00s)
=== RUN   TestMachineToDelete
... skipping 82 lines ...
I0816 15:09:21.780037   10483 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="machine-test" "namespace"="default" "err"="cannot create a metadata client without a rest config"
•I0816 15:09:21.781744   10483 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="machine-test" "namespace"="default" "err"="cannot create a metadata client without a rest config"
I0816 15:09:21.782444   10483 conversion.go:64]  "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="machine-test" "namespace"="default" "err"="cannot create a metadata client without a rest config"
I0816 15:09:21.783046   10483 machine_controller_phases.go:278]  "msg"="Infrastructure provider is not ready, requeuing" "machine"="machine-test" "namespace"="default" 
I0816 15:09:21.783128   10483 machine_controller_noderef.go:45]  "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="machine-test" "namespace"="default" 
•I0816 15:09:21.783733   10483 machine_controller.go:327]  "msg"="Draining node" "cluster"="test-cluster" "machine"="machine-test" "namespace"="default" "node"="machine-test-node"
E0816 15:09:21.785089   10483 machine_controller.go:494]  "msg"="Error creating a remote client while deleting Machine, won't retry" "error"="failed to create REST configuration for Cluster default/test-cluster: invalid configuration: no configuration has been provided" "cluster"="test-cluster" "machine"="machine-test" "namespace"="default" "node"="machine-test-node" 
•I0816 15:09:21.842951   10483 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="md-ccnkm-6657c7fddb" "namespace"="md-test" "creating"=2 "need"=2
I0816 15:09:21.843039   10483 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 2, ( spec.replicas(2) \u003e currentMachineCount(0) )" "machineset"="md-ccnkm-6657c7fddb" "namespace"="md-test" 
I0816 15:09:21.859310   10483 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 2 with name \"md-ccnkm-6657c7fddb-6bfpt\"" "machineset"="md-ccnkm-6657c7fddb" "namespace"="md-test" 
I0816 15:09:21.859377   10483 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 2 of 2, ( spec.replicas(2) \u003e currentMachineCount(0) )" "machineset"="md-ccnkm-6657c7fddb" "namespace"="md-test" 
I0816 15:09:21.872961   10483 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 2 of 2 with name \"md-ccnkm-6657c7fddb-fxvdn\"" "machineset"="md-ccnkm-6657c7fddb" "namespace"="md-test" 
I0816 15:09:21.984314   10483 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="md-ccnkm-6657c7fddb" "namespace"="md-test" "creating"=2 "need"=2
... skipping 4 lines ...
I0816 15:09:22.049196   10483 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="md-ccnkm-6657c7fddb" "namespace"="md-test" "creating"=1 "need"=3
I0816 15:09:22.049438   10483 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 1, ( spec.replicas(3) \u003e currentMachineCount(2) )" "machineset"="md-ccnkm-6657c7fddb" "namespace"="md-test" 
I0816 15:09:22.065973   10483 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 1 with name \"md-ccnkm-6657c7fddb-bgxd2\"" "machineset"="md-ccnkm-6657c7fddb" "namespace"="md-test" 
I0816 15:09:22.161463   10483 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="md-ccnkm-cdfc6fd6c" "namespace"="md-test" "creating"=1 "need"=1
I0816 15:09:22.161513   10483 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 1, ( spec.replicas(1) \u003e currentMachineCount(0) )" "machineset"="md-ccnkm-cdfc6fd6c" "namespace"="md-test" 
I0816 15:09:22.175641   10483 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 1 with name \"md-ccnkm-cdfc6fd6c-xd7mw\"" "machineset"="md-ccnkm-cdfc6fd6c" "namespace"="md-test" 
E0816 15:09:22.254618   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-xd7mw-4vftr, got []"  "node"="md-ccnkm-cdfc6fd6c-xd7mw-4vftr"
E0816 15:09:22.254723   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-xd7mw-4vftr, got []"  "node"="md-ccnkm-cdfc6fd6c-xd7mw-4vftr"
E0816 15:09:22.254850   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-xd7mw-4vftr, got []"  "node"="md-ccnkm-cdfc6fd6c-xd7mw-4vftr"
E0816 15:09:22.359866   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-xd7mw-4vftr, got []"  "node"="md-ccnkm-cdfc6fd6c-xd7mw-4vftr"
E0816 15:09:22.359884   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-xd7mw-4vftr, got []"  "node"="md-ccnkm-cdfc6fd6c-xd7mw-4vftr"
E0816 15:09:22.359914   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-xd7mw-4vftr, got []"  "node"="md-ccnkm-cdfc6fd6c-xd7mw-4vftr"
E0816 15:09:22.359928   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-xd7mw-4vftr, got []"  "node"="md-ccnkm-cdfc6fd6c-xd7mw-4vftr"
E0816 15:09:22.360008   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-xd7mw-4vftr, got []"  "node"="md-ccnkm-cdfc6fd6c-xd7mw-4vftr"
E0816 15:09:22.360092   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-xd7mw-4vftr, got []"  "node"="md-ccnkm-cdfc6fd6c-xd7mw-4vftr"
E0816 15:09:22.386110   10483 machineset_controller.go:625] controllers/MachineSet "msg"="Unable to retrieve Node status" "error"="error retrieving node md-ccnkm-cdfc6fd6c-xd7mw-4vftr for machine md-test/md-ccnkm-cdfc6fd6c-xd7mw: the cache is not started, can not read objects" "machineset"="md-ccnkm-cdfc6fd6c" "namespace"="md-test" 
I0816 15:09:22.438389   10483 machineset_controller.go:388] controllers/MachineSet "msg"="Too many replicas" "machineset"="md-ccnkm-6657c7fddb" "namespace"="md-test" "deleting"=1 "need"=2
I0816 15:09:22.438438   10483 machineset_controller.go:394] controllers/MachineSet "msg"="Found delete policy" "machineset"="md-ccnkm-6657c7fddb" "namespace"="md-test" "delete-policy"="Random"
I0816 15:09:22.446538   10483 machineset_controller.go:405] controllers/MachineSet "msg"="Deleted machine" "machineset"="md-ccnkm-6657c7fddb" "namespace"="md-test" "machine"="md-ccnkm-6657c7fddb-9hkcd"
I0816 15:09:22.481739   10483 machine_controller.go:305] controllers/Machine "msg"="Deleting Kubernetes Node associated with Machine is not allowed" "cluster"="test-cluster-pjrbt" "machine"="test-mhc-machine-x76lj" "namespace"="test-mhc-7clbs" "cause"="cluster is being deleted" "node"={"name":"test-mhc-node-t7ghv"}
E0816 15:09:22.530685   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="machines.cluster.x-k8s.io \"test-mhc-machine-x76lj\" not found" "controller"="machine" "name"="test-mhc-machine-x76lj" "namespace"="test-mhc-7clbs"
I0816 15:09:22.556044   10483 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="md-ccnkm-cdfc6fd6c" "namespace"="md-test" "creating"=1 "need"=2
I0816 15:09:22.556108   10483 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 1, ( spec.replicas(2) \u003e currentMachineCount(1) )" "machineset"="md-ccnkm-cdfc6fd6c" "namespace"="md-test" 
I0816 15:09:22.566785   10483 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 1 with name \"md-ccnkm-cdfc6fd6c-h86gm\"" "machineset"="md-ccnkm-cdfc6fd6c" "namespace"="md-test" 
E0816 15:09:22.605335   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-h86gm-n946h, got []"  "node"="md-ccnkm-cdfc6fd6c-h86gm-n946h"
E0816 15:09:22.605600   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-h86gm-n946h, got []"  "node"="md-ccnkm-cdfc6fd6c-h86gm-n946h"
E0816 15:09:22.605626   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-h86gm-n946h, got []"  "node"="md-ccnkm-cdfc6fd6c-h86gm-n946h"
E0816 15:09:22.608851   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-h86gm-n946h, got []"  "node"="md-ccnkm-cdfc6fd6c-h86gm-n946h"
E0816 15:09:22.608915   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-h86gm-n946h, got []"  "node"="md-ccnkm-cdfc6fd6c-h86gm-n946h"
E0816 15:09:22.608974   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-h86gm-n946h, got []"  "node"="md-ccnkm-cdfc6fd6c-h86gm-n946h"
E0816 15:09:22.609005   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-h86gm-n946h, got []"  "node"="md-ccnkm-cdfc6fd6c-h86gm-n946h"
E0816 15:09:22.609008   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-h86gm-n946h, got []"  "node"="md-ccnkm-cdfc6fd6c-h86gm-n946h"
E0816 15:09:22.609039   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-h86gm-n946h, got []"  "node"="md-ccnkm-cdfc6fd6c-h86gm-n946h"
I0816 15:09:22.645402   10483 machineset_controller.go:388] controllers/MachineSet "msg"="Too many replicas" "machineset"="md-ccnkm-6657c7fddb" "namespace"="md-test" "deleting"=1 "need"=1
I0816 15:09:22.645458   10483 machineset_controller.go:394] controllers/MachineSet "msg"="Found delete policy" "machineset"="md-ccnkm-6657c7fddb" "namespace"="md-test" "delete-policy"="Random"
I0816 15:09:22.651412   10483 machineset_controller.go:405] controllers/MachineSet "msg"="Deleted machine" "machineset"="md-ccnkm-6657c7fddb" "namespace"="md-test" "machine"="md-ccnkm-6657c7fddb-2kzzz"
I0816 15:09:22.674811   10483 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="md-ccnkm-cdfc6fd6c" "namespace"="md-test" "creating"=1 "need"=3
I0816 15:09:22.674872   10483 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 1, ( spec.replicas(3) \u003e currentMachineCount(2) )" "machineset"="md-ccnkm-cdfc6fd6c" "namespace"="md-test" 
I0816 15:09:22.684584   10483 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 1 with name \"md-ccnkm-cdfc6fd6c-nszvp\"" "machineset"="md-ccnkm-cdfc6fd6c" "namespace"="md-test" 
I0816 15:09:22.734802   10483 machinehealthcheck_controller.go:109] controllers/MachineHealthCheck "msg"="Reconciling" "machinehealthcheck"="test-mhc-nrj2x" "namespace"="test-mhc-7clbs" 
E0816 15:09:22.755804   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-nszvp-jqlb5, got []"  "node"="md-ccnkm-cdfc6fd6c-nszvp-jqlb5"
E0816 15:09:22.756133   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-nszvp-jqlb5, got []"  "node"="md-ccnkm-cdfc6fd6c-nszvp-jqlb5"
E0816 15:09:22.756133   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-nszvp-jqlb5, got []"  "node"="md-ccnkm-cdfc6fd6c-nszvp-jqlb5"
E0816 15:09:22.859862   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-nszvp-jqlb5, got []"  "node"="md-ccnkm-cdfc6fd6c-nszvp-jqlb5"
E0816 15:09:22.859942   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-nszvp-jqlb5, got []"  "node"="md-ccnkm-cdfc6fd6c-nszvp-jqlb5"
E0816 15:09:22.859866   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-nszvp-jqlb5, got []"  "node"="md-ccnkm-cdfc6fd6c-nszvp-jqlb5"
E0816 15:09:22.860003   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-nszvp-jqlb5, got []"  "node"="md-ccnkm-cdfc6fd6c-nszvp-jqlb5"
E0816 15:09:22.860010   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-nszvp-jqlb5, got []"  "node"="md-ccnkm-cdfc6fd6c-nszvp-jqlb5"
E0816 15:09:22.860049   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-cdfc6fd6c-nszvp-jqlb5, got []"  "node"="md-ccnkm-cdfc6fd6c-nszvp-jqlb5"
I0816 15:09:22.897926   10483 machineset_controller.go:388] controllers/MachineSet "msg"="Too many replicas" "machineset"="md-ccnkm-6657c7fddb" "namespace"="md-test" "deleting"=1 "need"=0
I0816 15:09:22.897963   10483 machineset_controller.go:394] controllers/MachineSet "msg"="Found delete policy" "machineset"="md-ccnkm-6657c7fddb" "namespace"="md-test" "delete-policy"="Random"
I0816 15:09:22.901843   10483 machineset_controller.go:405] controllers/MachineSet "msg"="Deleted machine" "machineset"="md-ccnkm-6657c7fddb" "namespace"="md-test" "machine"="md-ccnkm-6657c7fddb-bgxd2"
I0816 15:09:23.031502   10483 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="md-ccnkm-74d45c49c5" "namespace"="md-test" "creating"=1 "need"=1
I0816 15:09:23.031552   10483 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 1, ( spec.replicas(1) \u003e currentMachineCount(0) )" "machineset"="md-ccnkm-74d45c49c5" "namespace"="md-test" 
I0816 15:09:23.041967   10483 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 1 with name \"md-ccnkm-74d45c49c5-rjqgw\"" "machineset"="md-ccnkm-74d45c49c5" "namespace"="md-test" 
E0816 15:09:23.125127   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-74d45c49c5-rjqgw-4bv4h, got []"  "node"="md-ccnkm-74d45c49c5-rjqgw-4bv4h"
E0816 15:09:23.125127   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-74d45c49c5-rjqgw-4bv4h, got []"  "node"="md-ccnkm-74d45c49c5-rjqgw-4bv4h"
E0816 15:09:23.125128   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-74d45c49c5-rjqgw-4bv4h, got []"  "node"="md-ccnkm-74d45c49c5-rjqgw-4bv4h"
E0816 15:09:23.131836   10483 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-js72c/test-cluster-7prth"
E0816 15:09:23.228673   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-74d45c49c5-rjqgw-4bv4h, got []"  "node"="md-ccnkm-74d45c49c5-rjqgw-4bv4h"
E0816 15:09:23.228724   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-74d45c49c5-rjqgw-4bv4h, got []"  "node"="md-ccnkm-74d45c49c5-rjqgw-4bv4h"
E0816 15:09:23.228768   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-74d45c49c5-rjqgw-4bv4h, got []"  "node"="md-ccnkm-74d45c49c5-rjqgw-4bv4h"
E0816 15:09:23.228819   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-74d45c49c5-rjqgw-4bv4h, got []"  "node"="md-ccnkm-74d45c49c5-rjqgw-4bv4h"
I0816 15:09:23.264406   10483 machineset_controller.go:388] controllers/MachineSet "msg"="Too many replicas" "machineset"="md-ccnkm-cdfc6fd6c" "namespace"="md-test" "deleting"=1 "need"=2
I0816 15:09:23.264453   10483 machineset_controller.go:394] controllers/MachineSet "msg"="Found delete policy" "machineset"="md-ccnkm-cdfc6fd6c" "namespace"="md-test" "delete-policy"="Random"
I0816 15:09:23.269002   10483 machineset_controller.go:405] controllers/MachineSet "msg"="Deleted machine" "machineset"="md-ccnkm-cdfc6fd6c" "namespace"="md-test" "machine"="md-ccnkm-cdfc6fd6c-nszvp"
I0816 15:09:23.378703   10483 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="md-ccnkm-74d45c49c5" "namespace"="md-test" "creating"=1 "need"=2
I0816 15:09:23.378755   10483 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 1, ( spec.replicas(2) \u003e currentMachineCount(1) )" "machineset"="md-ccnkm-74d45c49c5" "namespace"="md-test" 
I0816 15:09:23.388786   10483 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 1 with name \"md-ccnkm-74d45c49c5-jfq7v\"" "machineset"="md-ccnkm-74d45c49c5" "namespace"="md-test" 
E0816 15:09:23.469444   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-74d45c49c5-jfq7v-t5shl, got []"  "node"="md-ccnkm-74d45c49c5-jfq7v-t5shl"
E0816 15:09:23.469613   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-74d45c49c5-jfq7v-t5shl, got []"  "node"="md-ccnkm-74d45c49c5-jfq7v-t5shl"
E0816 15:09:23.472464   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-74d45c49c5-jfq7v-t5shl, got []"  "node"="md-ccnkm-74d45c49c5-jfq7v-t5shl"
E0816 15:09:23.472515   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-74d45c49c5-jfq7v-t5shl, got []"  "node"="md-ccnkm-74d45c49c5-jfq7v-t5shl"
E0816 15:09:23.472591   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-74d45c49c5-jfq7v-t5shl, got []"  "node"="md-ccnkm-74d45c49c5-jfq7v-t5shl"
E0816 15:09:23.472624   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-74d45c49c5-jfq7v-t5shl, got []"  "node"="md-ccnkm-74d45c49c5-jfq7v-t5shl"
I0816 15:09:23.537434   10483 machineset_controller.go:388] controllers/MachineSet "msg"="Too many replicas" "machineset"="md-ccnkm-cdfc6fd6c" "namespace"="md-test" "deleting"=1 "need"=1
I0816 15:09:23.537472   10483 machineset_controller.go:394] controllers/MachineSet "msg"="Found delete policy" "machineset"="md-ccnkm-cdfc6fd6c" "namespace"="md-test" "delete-policy"="Random"
I0816 15:09:23.542288   10483 machineset_controller.go:405] controllers/MachineSet "msg"="Deleted machine" "machineset"="md-ccnkm-cdfc6fd6c" "namespace"="md-test" "machine"="md-ccnkm-cdfc6fd6c-xd7mw"
I0816 15:09:23.573901   10483 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="md-ccnkm-74d45c49c5" "namespace"="md-test" "creating"=1 "need"=3
I0816 15:09:23.573946   10483 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 1, ( spec.replicas(3) \u003e currentMachineCount(2) )" "machineset"="md-ccnkm-74d45c49c5" "namespace"="md-test" 
I0816 15:09:23.583631   10483 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 1 with name \"md-ccnkm-74d45c49c5-q7bj5\"" "machineset"="md-ccnkm-74d45c49c5" "namespace"="md-test" 
E0816 15:09:23.599579   10483 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-lll68/test-cluster-5hrd6"
I0816 15:09:23.608526   10483 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="md-ccnkm-6657c7fddb-6bfpt" "namespace"="md-test" 
I0816 15:09:23.608572   10483 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="md-ccnkm-6657c7fddb-6bfpt" "namespace"="md-test" 
I0816 15:09:23.622903   10483 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="md-ccnkm-6657c7fddb-fxvdn" "namespace"="md-test" 
I0816 15:09:23.622943   10483 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="md-ccnkm-6657c7fddb-fxvdn" "namespace"="md-test" 
E0816 15:09:23.659544   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-cdfc6fd6c-h86gm\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-cdfc6fd6c-h86gm" "namespace"="md-test"
E0816 15:09:23.754577   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-74d45c49c5-q7bj5-l78vm, got []"  "node"="md-ccnkm-74d45c49c5-q7bj5-l78vm"
E0816 15:09:23.858826   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-74d45c49c5-q7bj5-l78vm, got []"  "node"="md-ccnkm-74d45c49c5-q7bj5-l78vm"
E0816 15:09:23.858922   10483 machinehealthcheck_controller.go:480] controllers/MachineHealthCheck "msg"="Unable to retrieve machine from node" "error"="expecting one machine for node md-ccnkm-74d45c49c5-q7bj5-l78vm, got []"  "node"="md-ccnkm-74d45c49c5-q7bj5-l78vm"
I0816 15:09:23.881065   10483 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster" "namespace"="md-test" "descendants"="Machine sets: md-ccnkm-74d45c49c5,md-ccnkm-cdfc6fd6c;Worker machines: md-ccnkm-6657c7fddb-6bfpt,md-ccnkm-6657c7fddb-fxvdn,md-ccnkm-cdfc6fd6c-h86gm,md-ccnkm-74d45c49c5-jfq7v,md-ccnkm-74d45c49c5-rjqgw,md-ccnkm-74d45c49c5-q7bj5" "indirect descendants count"=8
I0816 15:09:23.886086   10483 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster" "namespace"="md-test" "descendants"="Machine sets: md-ccnkm-74d45c49c5,md-ccnkm-cdfc6fd6c;Worker machines: md-ccnkm-74d45c49c5-rjqgw,md-ccnkm-74d45c49c5-q7bj5,md-ccnkm-6657c7fddb-6bfpt,md-ccnkm-6657c7fddb-fxvdn,md-ccnkm-cdfc6fd6c-h86gm,md-ccnkm-74d45c49c5-jfq7v" "indirect descendants count"=8
••E0816 15:09:24.011025   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusters.cluster.x-k8s.io \"test1-nfl5z\" not found" "controller"="cluster" "name"="test1-nfl5z" "namespace"="default"
E0816 15:09:24.702822   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-74d45c49c5-rjqgw\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-74d45c49c5-rjqgw" "namespace"="md-test"
•I0816 15:09:25.131245   10483 conversion.go:64] controllers/Cluster "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "cluster"="test2-xf25g" "namespace"="default" "err"="you requested PartialObjectMetadata, but the requested object is a list (*apiextensions.CustomResourceDefinitionList)"
I0816 15:09:25.250141   10483 conversion.go:64] controllers/Cluster "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "cluster"="test2-xf25g" "namespace"="default" "err"="you requested PartialObjectMetadata, but the requested object is a list (*apiextensions.CustomResourceDefinitionList)"
E0816 15:09:25.255098   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to find a CustomResourceDefinition for /, Kind= with contract \"cluster.x-k8s.io/v1alpha3\"" "controller"="cluster" "name"="test2-xf25g" "namespace"="default"
E0816 15:09:25.730309   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-74d45c49c5-jfq7v\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-74d45c49c5-jfq7v" "namespace"="md-test"
E0816 15:09:26.266889   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test-too\" for Cluster default/test2-xf25g: failed to retrieve  external object \"default\"/\"test-too\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test2-xf25g" "namespace"="default"
•I0816 15:09:26.735227   10483 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="md-ccnkm-6657c7fddb-6bfpt" "namespace"="md-test" 
I0816 15:09:26.735274   10483 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="md-ccnkm-6657c7fddb-6bfpt" "namespace"="md-test" 
I0816 15:09:26.739456   10483 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="md-ccnkm-6657c7fddb-fxvdn" "namespace"="md-test" 
I0816 15:09:26.739491   10483 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="md-ccnkm-6657c7fddb-fxvdn" "namespace"="md-test" 
E0816 15:09:26.744026   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-cdfc6fd6c-h86gm\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-cdfc6fd6c-h86gm" "namespace"="md-test"
E0816 15:09:27.287685   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusters.cluster.x-k8s.io \"test3-qnldn\" not found" "controller"="cluster" "name"="test3-qnldn" "namespace"="default"
E0816 15:09:27.774191   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-74d45c49c5-rjqgw\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-74d45c49c5-rjqgw" "namespace"="md-test"
E0816 15:09:28.288407   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test-too\" for Cluster default/test2-xf25g: failed to retrieve  external object \"default\"/\"test-too\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test2-xf25g" "namespace"="default"
E0816 15:09:28.779737   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-74d45c49c5-jfq7v\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-74d45c49c5-jfq7v" "namespace"="md-test"
E0816 15:09:29.308304   10483 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="test-mhc-7clbs/test-cluster-pjrbt"
E0816 15:09:29.308745   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test-too\" for Cluster default/test2-xf25g: failed to retrieve  external object \"default\"/\"test-too\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test2-xf25g" "namespace"="default"
•E0816 15:09:29.785567   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-cdfc6fd6c-h86gm\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-cdfc6fd6c-h86gm" "namespace"="md-test"
I0816 15:09:30.309414   10483 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster" "namespace"="md-test" "descendants"="Machine sets: md-ccnkm-74d45c49c5,md-ccnkm-cdfc6fd6c;Worker machines: md-ccnkm-6657c7fddb-fxvdn,md-ccnkm-cdfc6fd6c-h86gm,md-ccnkm-74d45c49c5-jfq7v,md-ccnkm-74d45c49c5-rjqgw,md-ccnkm-74d45c49c5-q7bj5,md-ccnkm-6657c7fddb-6bfpt" "indirect descendants count"=8
E0816 15:09:30.313427   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test\" for Cluster default/test4-2g95l: failed to retrieve  external object \"default\"/\"test\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test4-2g95l" "namespace"="default"
I0816 15:09:30.791295   10483 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="md-ccnkm-6657c7fddb-6bfpt" "namespace"="md-test" 
I0816 15:09:30.791341   10483 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="md-ccnkm-6657c7fddb-6bfpt" "namespace"="md-test" 
I0816 15:09:30.796911   10483 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="md-ccnkm-6657c7fddb-fxvdn" "namespace"="md-test" 
I0816 15:09:30.796970   10483 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="md-ccnkm-6657c7fddb-fxvdn" "namespace"="md-test" 
E0816 15:09:30.808965   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-74d45c49c5-rjqgw\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-74d45c49c5-rjqgw" "namespace"="md-test"
E0816 15:09:31.314435   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test-too\" for Cluster default/test2-xf25g: failed to retrieve  external object \"default\"/\"test-too\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test2-xf25g" "namespace"="default"
E0816 15:09:31.814811   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-74d45c49c5-jfq7v\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-74d45c49c5-jfq7v" "namespace"="md-test"
E0816 15:09:32.325331   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test\" for Cluster default/test4-2g95l: failed to retrieve  external object \"default\"/\"test\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test4-2g95l" "namespace"="default"
•E0816 15:09:32.820200   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-cdfc6fd6c-h86gm\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-cdfc6fd6c-h86gm" "namespace"="md-test"
E0816 15:09:33.326128   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test-too\" for Cluster default/test2-xf25g: failed to retrieve  external object \"default\"/\"test-too\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test2-xf25g" "namespace"="default"
E0816 15:09:33.820681   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-d7wzj\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-d7wzj" "namespace"="test-mhc-cxccz"
E0816 15:09:34.326920   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test\" for Cluster default/test4-2g95l: failed to retrieve  external object \"default\"/\"test\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test4-2g95l" "namespace"="default"
E0816 15:09:34.826748   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-74d45c49c5-rjqgw\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-74d45c49c5-rjqgw" "namespace"="md-test"
E0816 15:09:35.336557   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test-too\" for Cluster default/test2-xf25g: failed to retrieve  external object \"default\"/\"test-too\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test2-xf25g" "namespace"="default"
E0816 15:09:35.827232   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get cluster \"test-cluster-vxn97\" for machine \"test-mhc-machine-5mswl\" in namespace \"test-mhc-cxccz\": Cluster.cluster.x-k8s.io \"test-cluster-vxn97\" not found" "controller"="machine" "name"="test-mhc-machine-5mswl" "namespace"="test-mhc-cxccz"
E0816 15:09:36.337420   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test\" for Cluster default/test4-2g95l: failed to retrieve  external object \"default\"/\"test\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test4-2g95l" "namespace"="default"
I0816 15:09:36.832961   10483 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="md-ccnkm-6657c7fddb-6bfpt" "namespace"="md-test" 
I0816 15:09:36.833034   10483 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="md-ccnkm-6657c7fddb-6bfpt" "namespace"="md-test" 
I0816 15:09:36.837947   10483 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="md-ccnkm-6657c7fddb-fxvdn" "namespace"="md-test" 
I0816 15:09:36.837984   10483 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="md-ccnkm-6657c7fddb-fxvdn" "namespace"="md-test" 
E0816 15:09:36.843759   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-74d45c49c5-jfq7v\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-74d45c49c5-jfq7v" "namespace"="md-test"
I0816 15:09:37.338187   10483 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster" "namespace"="md-test" "descendants"="Machine sets: md-ccnkm-74d45c49c5,md-ccnkm-cdfc6fd6c;Worker machines: md-ccnkm-6657c7fddb-6bfpt,md-ccnkm-6657c7fddb-fxvdn,md-ccnkm-cdfc6fd6c-h86gm,md-ccnkm-74d45c49c5-jfq7v,md-ccnkm-74d45c49c5-rjqgw,md-ccnkm-74d45c49c5-q7bj5" "indirect descendants count"=8
E0816 15:09:37.338976   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test-too\" for Cluster default/test2-xf25g: failed to retrieve  external object \"default\"/\"test-too\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test2-xf25g" "namespace"="default"
E0816 15:09:37.849579   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-cdfc6fd6c-h86gm\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-cdfc6fd6c-h86gm" "namespace"="md-test"
E0816 15:09:38.339904   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test\" for Cluster default/test4-2g95l: failed to retrieve  external object \"default\"/\"test\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test4-2g95l" "namespace"="default"
E0816 15:09:38.855507   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-74d45c49c5-rjqgw\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-74d45c49c5-rjqgw" "namespace"="md-test"
E0816 15:09:39.340865   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test-too\" for Cluster default/test2-xf25g: failed to retrieve  external object \"default\"/\"test-too\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test2-xf25g" "namespace"="default"
E0816 15:09:39.871979   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-74d45c49c5-jfq7v\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-74d45c49c5-jfq7v" "namespace"="md-test"
E0816 15:09:40.341785   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test\" for Cluster default/test4-2g95l: failed to retrieve  external object \"default\"/\"test\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test4-2g95l" "namespace"="default"
I0816 15:09:40.876596   10483 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="md-ccnkm-6657c7fddb-6bfpt" "namespace"="md-test" 
I0816 15:09:40.876641   10483 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="md-ccnkm-6657c7fddb-6bfpt" "namespace"="md-test" 
I0816 15:09:40.880391   10483 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="md-ccnkm-6657c7fddb-fxvdn" "namespace"="md-test" 
I0816 15:09:40.880430   10483 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="md-ccnkm-6657c7fddb-fxvdn" "namespace"="md-test" 
E0816 15:09:40.884797   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-cdfc6fd6c-h86gm\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-cdfc6fd6c-h86gm" "namespace"="md-test"
E0816 15:09:41.342611   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test\" for Cluster default/test4-2g95l: failed to retrieve  external object \"default\"/\"test\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test4-2g95l" "namespace"="default"
E0816 15:09:41.891184   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-74d45c49c5-rjqgw\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-74d45c49c5-rjqgw" "namespace"="md-test"
E0816 15:09:42.343484   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test-too\" for Cluster default/test2-xf25g: failed to retrieve  external object \"default\"/\"test-too\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test2-xf25g" "namespace"="default"
I0816 15:09:42.905576   10483 conversion.go:64] controllers/Machine "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="test6-h6zx5" "namespace"="default" "err"="you requested PartialObjectMetadata, but the requested object is a list (*apiextensions.CustomResourceDefinitionList)"
E0816 15:09:42.917109   10483 machine_controller_noderef.go:73] controllers/Machine "msg"="Failed to retrieve Node by ProviderID" "error"="the cache is not started, can not read objects" "machine"="test6-h6zx5" "namespace"="default" 
E0816 15:09:42.933000   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="[failed to find a CustomResourceDefinition for /, Kind= with contract \"cluster.x-k8s.io/v1alpha3\", the cache is not started, can not read objects]" "controller"="machine" "name"="test6-h6zx5" "namespace"="default"
E0816 15:09:43.344324   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test\" for Cluster default/test4-2g95l: failed to retrieve  external object \"default\"/\"test\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test4-2g95l" "namespace"="default"
E0816 15:09:43.938591   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-74d45c49c5-jfq7v\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-74d45c49c5-jfq7v" "namespace"="md-test"
I0816 15:09:44.345029   10483 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster" "namespace"="md-test" "descendants"="Machine sets: md-ccnkm-74d45c49c5,md-ccnkm-cdfc6fd6c;Worker machines: md-ccnkm-74d45c49c5-q7bj5,md-ccnkm-6657c7fddb-6bfpt,md-ccnkm-6657c7fddb-fxvdn,md-ccnkm-cdfc6fd6c-h86gm,md-ccnkm-74d45c49c5-jfq7v,md-ccnkm-74d45c49c5-rjqgw" "indirect descendants count"=8
E0816 15:09:44.345539   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test\" for Cluster default/test4-2g95l: failed to retrieve  external object \"default\"/\"test\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test4-2g95l" "namespace"="default"
E0816 15:09:44.943679   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-cdfc6fd6c-h86gm\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-cdfc6fd6c-h86gm" "namespace"="md-test"
E0816 15:09:45.346484   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test-too\" for Cluster default/test2-xf25g: failed to retrieve  external object \"default\"/\"test-too\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test2-xf25g" "namespace"="default"
I0816 15:09:45.947944   10483 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="md-ccnkm-6657c7fddb-6bfpt" "namespace"="md-test" 
I0816 15:09:45.948007   10483 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="md-ccnkm-6657c7fddb-6bfpt" "namespace"="md-test" 
I0816 15:09:45.951761   10483 machine_controller_phases.go:278] controllers/Machine "msg"="Infrastructure provider is not ready, requeuing" "machine"="md-ccnkm-6657c7fddb-fxvdn" "namespace"="md-test" 
I0816 15:09:45.951800   10483 machine_controller_noderef.go:45] controllers/Machine "msg"="Cannot reconcile Machine's Node, no valid ProviderID yet" "machine"="md-ccnkm-6657c7fddb-fxvdn" "namespace"="md-test" 
E0816 15:09:45.955556   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-74d45c49c5-rjqgw\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-74d45c49c5-rjqgw" "namespace"="md-test"
E0816 15:09:46.347328   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get  \"test\" for Cluster default/test4-2g95l: failed to retrieve  external object \"default\"/\"test\": Object 'Kind' is missing in 'unstructured object has no kind'" "controller"="cluster" "name"="test4-2g95l" "namespace"="default"
I0816 15:09:46.969931   10483 conversion.go:64] controllers/Machine "msg"="Cannot retrieve CRD with metadata only client, falling back to slower listing" "machine"="test6-h6zx5" "namespace"="default" "err"="you requested PartialObjectMetadata, but the requested object is a list (*apiextensions.CustomResourceDefinitionList)"
I0816 15:09:46.970206   10483 machine_controller_noderef.go:86] controllers/Machine "msg"="Set Machine's NodeRef" "machine"="test6-h6zx5" "namespace"="default" "noderef"="id-node-1"
E0816 15:09:46.985986   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to find a CustomResourceDefinition for /, Kind= with contract \"cluster.x-k8s.io/v1alpha3\"" "controller"="machine" "name"="test6-h6zx5" "namespace"="default"

------------------------------
• [SLOW TEST:15.069 seconds]
Cluster Reconciler
/home/prow/go/src/sigs.k8s.io/cluster-api/controllers/cluster_controller_test.go:45
  Should successfully set Status.ControlPlaneInitialized on the cluster object if controlplane is ready
... skipping 8 lines ...
I0816 15:09:47.535585   10483 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 2 with name \"ms-whlvq-wwmn7\"" "machineset"="ms-whlvq" "namespace"="ms-test" 
I0816 15:09:47.535651   10483 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 2 of 2, ( spec.replicas(2) \u003e currentMachineCount(0) )" "machineset"="ms-whlvq" "namespace"="ms-test" 
I0816 15:09:47.573138   10483 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 2 of 2 with name \"ms-whlvq-ztknx\"" "machineset"="ms-whlvq" "namespace"="ms-test" 
I0816 15:09:47.653681   10483 machineset_controller.go:316] controllers/MachineSet "msg"="Too few replicas" "machineset"="ms-whlvq" "namespace"="ms-test" "creating"=1 "need"=2
I0816 15:09:47.653742   10483 machineset_controller.go:324] controllers/MachineSet "msg"="Creating machine 1 of 1, ( spec.replicas(2) \u003e currentMachineCount(1) )" "machineset"="ms-whlvq" "namespace"="ms-test" 
I0816 15:09:47.671131   10483 machineset_controller.go:378] controllers/MachineSet "msg"="Created machine 1 of 1 with name \"ms-whlvq-8hjh9\"" "machineset"="ms-whlvq" "namespace"="ms-test" 
E0816 15:09:47.912769   10483 machineset_controller.go:625] controllers/MachineSet "msg"="Unable to retrieve Node status" "error"="error retrieving node ms-whlvq-8hjh9-b4scp for machine ms-test/ms-whlvq-8hjh9: the cache is not started, can not read objects" "machineset"="ms-whlvq" "namespace"="ms-test" 
E0816 15:09:47.991795   10483 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="no matching Node for Machine \"md-ccnkm-74d45c49c5-jfq7v\" in namespace \"md-test\": cannot find node with matching ProviderID" "controller"="machine" "name"="md-ccnkm-74d45c49c5-jfq7v" "namespace"="md-test"
I0816 15:09:48.033645   10483 cluster_controller.go:256] controllers/Cluster "msg"="Cluster still has descendants - need to requeue" "cluster"="test-cluster" "namespace"="ms-test" "descendants"="Worker machines: ms-whlvq-8hjh9,ms-whlvq-ztknx" "indirect descendants count"=2
•

Ran 16 of 16 Specs in 26.274 seconds
SUCCESS! -- 16 Passed | 0 Failed | 0 Pending | 0 Skipped
--- PASS: TestGinkgoSuite (26.27s)
PASS
Tearing down test suite
I0816 15:09:48.036104   10483 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="machinedeployment" 
I0816 15:09:48.036123   10483 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="cluster" 
I0816 15:09:48.036218   10483 server.go:208] controller-runtime/webhook "msg"="shutting down webhook server"  
I0816 15:09:48.036354   10483 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="machine" 
I0816 15:09:48.036385   10483 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="cluster" 
I0816 15:09:48.036405   10483 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="machinehealthcheck" 
I0816 15:09:48.036425   10483 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="machineset" 
E0816 15:09:48.067443   10483 reflector.go:309] pkg/mod/k8s.io/client-go@v0.17.9/tools/cache/reflector.go:105: Failed to watch *v1.Node: Get http://127.0.0.1:36785/api/v1/nodes?allowWatchBookmarks=true&resourceVersion=1257&timeout=10s&timeoutSeconds=428&watch=true: dial tcp 127.0.0.1:36785: connect: connection refused
E0816 15:09:48.067436   10483 reflector.go:309] pkg/mod/k8s.io/client-go@v0.17.9/tools/cache/reflector.go:105: Failed to watch *v1.Node: Get http://127.0.0.1:36785/api/v1/nodes?allowWatchBookmarks=true&resourceVersion=1257&timeout=10s&timeoutSeconds=519&watch=true: dial tcp 127.0.0.1:36785: connect: connection refused
E0816 15:09:48.067457   10483 reflector.go:309] pkg/mod/k8s.io/client-go@v0.17.9/tools/cache/reflector.go:105: Failed to watch *v1.Node: Get http://127.0.0.1:36785/api/v1/nodes?allowWatchBookmarks=true&resourceVersion=1257&timeout=10s&timeoutSeconds=354&watch=true: dial tcp 127.0.0.1:36785: connect: connection refused
ok  	sigs.k8s.io/cluster-api/controllers	85.417s
=== RUN   TestGetResourceFound
--- PASS: TestGetResourceFound (0.00s)
=== RUN   TestGetResourceNotFound
--- PASS: TestGetResourceNotFound (0.00s)
=== RUN   TestCloneTemplateResourceNotFound
... skipping 261 lines ...
I0816 15:08:37.234207   11006 certwatcher.go:83] controller-runtime/certwatcher "msg"="Starting certificate watcher"  
I0816 15:08:37.254874   11006 controller.go:155] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinedeployment" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"clusterName":"","selector":{},"template":{"metadata":{},"spec":{"clusterName":"","bootstrap":{},"infrastructureRef":{}}}},"status":{}}}
I0816 15:08:37.459298   11006 controller.go:162] controller-runtime/controller "msg"="Starting Controller" "controller"="machinedeployment" 
I0816 15:08:37.459369   11006 controller.go:189] controller-runtime/controller "msg"="Starting workers" "controller"="machinedeployment" "worker count"=1
I0816 15:08:37.721840   11006 controller.go:132] controller-runtime/controller "msg"="Starting EventSource" "controller"="machinedeployment" "source"={}
•I0816 15:08:38.261904   11006 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="machinedeployment" 
E0816 15:08:40.338877   11006 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="timed out waiting for the condition"  "cluster"="cluster-cache-test-cjktv/test-cluster"
•E0816 15:08:40.846442   11006 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="the server could not find the requested resource"  "cluster"="cluster-cache-test-8wwcp/test-cluster"
•E0816 15:08:41.452279   11006 cluster_cache.go:366]  "msg"="Error health checking cluster" "error"="Get http://127.0.0.1:35571/?timeout=50ms: dial tcp 127.0.0.1:35571: connect: connection refused"  "cluster"="cluster-cache-test-l7vbf/test-cluster"
•I0816 15:08:41.596596   11006 controller.go:155] controller-runtime/controller "msg"="Starting EventSource" "controller"="cluster" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"controlPlaneEndpoint":{"host":"","port":0}},"status":{"infrastructureReady":false,"controlPlaneInitialized":false}}}
I0816 15:08:41.697027   11006 controller.go:162] controller-runtime/controller "msg"="Starting Controller" "controller"="cluster" 
I0816 15:08:41.697095   11006 controller.go:189] controller-runtime/controller "msg"="Starting workers" "controller"="cluster" "worker count"=1
•I0816 15:08:41.907428   11006 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="cluster" 
I0816 15:08:41.907524   11006 server.go:208] controller-runtime/webhook "msg"="shutting down webhook server"  
E0816 15:08:41.955954   11006 reflector.go:309] pkg/mod/k8s.io/client-go@v0.17.9/tools/cache/reflector.go:105: Failed to watch *v1alpha3.Cluster: Get http://127.0.0.1:32865/apis/cluster.x-k8s.io/v1alpha3/clusters?allowWatchBookmarks=true&resourceVersion=143&timeout=10s&timeoutSeconds=478&watch=true: dial tcp 127.0.0.1:32865: connect: connection refused


Ran 5 of 5 Specs in 16.681 seconds
SUCCESS! -- 5 Passed | 0 Failed | 0 Pending | 0 Skipped
--- PASS: TestGinkgoSuite (16.68s)
PASS
ok  	sigs.k8s.io/cluster-api/controllers/remote	16.865s
?   	sigs.k8s.io/cluster-api/controllers/remote/fake	[no test files]
?   	sigs.k8s.io/cluster-api/controlplane/kubeadm	[no test files]
=== RUN   TestKubeadmControlPlaneDefault
... skipping 208 lines ...
=== RUN   TestReconcileNoClusterOwnerRef
I0816 15:08:48.646652   11620 controller.go:130]  "msg"="Cluster Controller has not yet set OwnerRef" "kubeadmControlPlane"="foo" "namespace"="test" 
--- PASS: TestReconcileNoClusterOwnerRef (0.00s)
=== RUN   TestReconcileNoKCP
--- PASS: TestReconcileNoKCP (0.00s)
=== RUN   TestReconcileNoCluster
E0816 15:08:48.648017   11620 controller.go:126]  "msg"="Failed to retrieve owner Cluster from the API Server" "error"="clusters.cluster.x-k8s.io \"foo\" not found" "kubeadmControlPlane"="foo" "namespace"="test" 
--- PASS: TestReconcileNoCluster (0.00s)
=== RUN   TestReconcilePaused
I0816 15:08:48.648660   11620 controller.go:136]  "msg"="Reconciliation is paused for this object" "cluster"="foo" "kubeadmControlPlane"="foo" "namespace"="test" 
I0816 15:08:48.648808   11620 controller.go:136]  "msg"="Reconciliation is paused for this object" "cluster"="foo" "kubeadmControlPlane"="foo" "namespace"="test" 
--- PASS: TestReconcilePaused (0.00s)
=== RUN   TestReconcileClusterNoEndpoints
... skipping 192 lines ...
    --- PASS: TestSelectMachineForScaleDown/when_there_is_an_up_to_date_machine_with_delete_annotation,_while_there_are_any_outdated_machines_without_annotatio_that_still_exist,_it_returns_oldest_marked_machine_first (0.00s)
=== RUN   TestPreflightChecks
=== RUN   TestPreflightChecks/control_plane_without_machines_(not_initialized)_should_pass
=== RUN   TestPreflightChecks/control_plane_with_a_deleting_machine_should_requeue
I0816 15:09:06.402389   11620 scale.go:173]  "msg"="Waiting for machines to be deleted" "cluster"="" "kubeadmControlPlane"="" "namespace"="" "Machines"=""
=== RUN   TestPreflightChecks/control_plane_with_an_unhealthy_machine_condition_should_requeue
I0816 15:09:06.402530   11620 scale.go:212]  "msg"="Waiting for control plane to pass preflight checks" "cluster"="" "kubeadmControlPlane"="" "namespace"="" "failures"="machine  reports APIServerPodHealthy condition is false (Error, )"
=== RUN   TestPreflightChecks/control_plane_with_an_healthy_machine_and_an_healthy_kcp_condition_should_pass
--- PASS: TestPreflightChecks (0.00s)
    --- PASS: TestPreflightChecks/control_plane_without_machines_(not_initialized)_should_pass (0.00s)
    --- PASS: TestPreflightChecks/control_plane_with_a_deleting_machine_should_requeue (0.00s)
    --- PASS: TestPreflightChecks/control_plane_with_an_unhealthy_machine_condition_should_requeue (0.00s)
    --- PASS: TestPreflightChecks/control_plane_with_an_healthy_machine_and_an_healthy_kcp_condition_should_pass (0.00s)
... skipping 18 lines ...
=== RUN   TestAPIs
Running Suite: Controller Suite
===============================
Random Seed: 1660662516
Will run 1 of 1 specs

E0816 15:09:06.431709   11620 controller.go:126]  "msg"="Failed to retrieve owner Cluster from the API Server" "error"="Cluster.cluster.x-k8s.io \"kcp-foo-4oaila\" not found" "kubeadmControlPlane"="kcp-foo-4oaila" "namespace"="test" 
•

Ran 1 of 1 Specs in 0.025 seconds
SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
--- PASS: TestAPIs (0.03s)
=== RUN   TestKubeadmControlPlaneReconciler_upgradeControlPlane
I0816 15:09:06.432966   11620 controller.go:246]  "msg"="Reconcile KubeadmControlPlane" "cluster"="kcp-foo-9hujwa" "kubeadmControlPlane"="kcp-foo-9hujwa" "namespace"="test" 
I0816 15:09:08.188879   11620 controller.go:331]  "msg"="Rolling out Control Plane machines" "cluster"="kcp-foo-9hujwa" "kubeadmControlPlane"="kcp-foo-9hujwa" "namespace"="test" "needRollout"=["kcp-foo-9hujwa-nt6gw"]
I0816 15:09:08.189030   11620 scale.go:212]  "msg"="Waiting for control plane to pass preflight checks" "cluster"="kcp-foo-9hujwa" "kubeadmControlPlane"="kcp-foo-9hujwa" "namespace"="test" "failures"="[machine kcp-foo-9hujwa-glqvl does not have APIServerPodHealthy condition, machine kcp-foo-9hujwa-glqvl does not have ControllerManagerPodHealthy condition, machine kcp-foo-9hujwa-glqvl does not have SchedulerPodHealthy condition, machine kcp-foo-9hujwa-glqvl does not have EtcdPodHealthy condition, machine kcp-foo-9hujwa-glqvl does not have EtcdMemberHealthy condition]"
--- PASS: TestKubeadmControlPlaneReconciler_upgradeControlPlane (1.76s)
... skipping 60 lines ...
==================================
Random Seed: 1660662515
Will run 7 of 7 specs

•••••••
Ran 7 of 7 Specs in 0.000 seconds
SUCCESS! -- 7 Passed | 0 Failed | 0 Pending | 0 Skipped
--- PASS: TestControlPlane (0.00s)
=== RUN   TestHasUnhealthyMachine
--- PASS: TestHasUnhealthyMachine (0.00s)
=== RUN   TestNewFailureDomainPicker
=== RUN   TestNewFailureDomainPicker/simple
=== RUN   TestNewFailureDomainPicker/no_machines
... skipping 111 lines ...
=======================================
Random Seed: 1660662515
Will run 7 of 7 specs

•••••••
Ran 7 of 7 Specs in 0.000 seconds
SUCCESS! -- 7 Passed | 0 Failed | 0 Pending | 0 Skipped
--- PASS: TestMachineCollection (0.00s)
=== RUN   TestUpdateEtcdConditions
=== RUN   TestUpdateEtcdConditions/if_list_nodes_return_an_error_should_report_all_the_conditions_Unknown
=== RUN   TestUpdateEtcdConditions/node_without_machine_should_be_ignored_if_there_are_provisioning_machines
=== RUN   TestUpdateEtcdConditions/node_without_machine_should_report_a_problem_at_KCP_level_if_there_are_no_provisioning_machines
=== RUN   TestUpdateEtcdConditions/failure_creating_the_etcd_client_should_report_unknown_condition
... skipping 297 lines ...
    --- PASS: TestUpdateKubeProxyImageInfo/returns_error_if_image_repository_is_invalid (0.00s)
    --- PASS: TestUpdateKubeProxyImageInfo/does_not_update_image_repository_when_no_kube-proxy_update_is_requested (0.00s)
=== RUN   TestRemoveMachineFromKubeadmConfigMap
=== RUN   TestRemoveMachineFromKubeadmConfigMap/does_not_panic_if_machine_is_nil
=== RUN   TestRemoveMachineFromKubeadmConfigMap/does_not_panic_if_machine_noderef_is_nil
=== RUN   TestRemoveMachineFromKubeadmConfigMap/returns_error_if_unable_to_find_kubeadm-config_for_Kubernetes_version_<_1.22.0
E0816 15:08:50.652670   11548 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
E0816 15:08:58.975761   11548 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
E0816 15:09:07.961833   11548 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
E0816 15:09:19.092166   11548 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
E0816 15:09:35.565437   11548 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
E0816 15:09:48.574108   11548 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
E0816 15:10:06.221612   11548 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
E0816 15:10:27.145001   11548 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
E0816 15:10:58.161479   11548 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
E0816 15:11:43.318711   11548 workload_cluster.go:354]  "msg"="unable to get kubeadmConfigMap" "error"="error getting kube-system/kubeadm-config configmap from target cluster: configmaps \"kubeadm-config\" not found"  
=== RUN   TestRemoveMachineFromKubeadmConfigMap/returns_error_if_unable_to_remove_api_endpoint_for_Kubernetes_version_<_1.22.0
=== RUN   TestRemoveMachineFromKubeadmConfigMap/removes_the_machine_node_ref_from_kubeadm_config_for_Kubernetes_version_<_1.22.0
=== RUN   TestRemoveMachineFromKubeadmConfigMap/no_op_for_Kubernetes_version_>=_1.22.0
--- PASS: TestRemoveMachineFromKubeadmConfigMap (172.67s)
    --- PASS: TestRemoveMachineFromKubeadmConfigMap/does_not_panic_if_machine_is_nil (0.00s)
    --- PASS: TestRemoveMachineFromKubeadmConfigMap/does_not_panic_if_machine_noderef_is_nil (0.00s)
... skipping 84 lines ...
    --- PASS: TestIsKubernetesVersionSupported/workload_cluster_and_version_>=_v1.22.0 (0.00s)
    --- PASS: TestIsKubernetesVersionSupported/management_cluster_and_version_<_v1.22.0 (0.00s)
    --- PASS: TestIsKubernetesVersionSupported/management_cluster_and_version_>=_v1.22.0 (0.00s)
    --- PASS: TestIsKubernetesVersionSupported/management_cluster_and_version_>=_v1.23.0 (0.00s)
PASS
I0816 15:11:43.328874   11548 server.go:208] controller-runtime/webhook "msg"="shutting down webhook server"  
E0816 15:11:43.329058   11548 certwatcher.go:143] controller-runtime/certwatcher "msg"="error re-watching file" "error"="inotify instance already closed"  
E0816 15:11:43.329127   11548 certwatcher.go:148] controller-runtime/certwatcher "msg"="error re-reading certificate" "error"="open /tmp/envtest-serving-certs-562837244/tls.crt: no such file or directory"  
ok  	sigs.k8s.io/cluster-api/controlplane/kubeadm/internal	188.070s
=== RUN   TestEtcdMembers_WithErrors
--- PASS: TestEtcdMembers_WithErrors (0.00s)
=== RUN   TestEtcdMembers_WithSuccess
--- PASS: TestEtcdMembers_WithSuccess (0.00s)
PASS
... skipping 287 lines ...
I0816 15:08:59.244278   11910 controller.go:162] controller-runtime/controller "msg"="Starting Controller" "controller"="clusterresourcesetbinding" 
I0816 15:08:59.342353   11910 controller.go:155] controller-runtime/controller "msg"="Starting EventSource" "controller"="clusterresourceset" "source"={"Type":{"kind":"Secret","apiVersion":"v1","metadata":{"creationTimestamp":null}}}
I0816 15:08:59.344857   11910 controller.go:189] controller-runtime/controller "msg"="Starting workers" "controller"="clusterresourcesetbinding" "worker count"=1
I0816 15:08:59.442744   11910 controller.go:162] controller-runtime/controller "msg"="Starting Controller" "controller"="clusterresourceset" 
I0816 15:08:59.442814   11910 controller.go:189] controller-runtime/controller "msg"="Starting workers" "controller"="clusterresourceset" "worker count"=1
I0816 15:08:59.525966   11910 clusterresourcesetbinding_controller.go:84]  "msg"="deleting ClusterResourceSetBinding because the owner Cluster no longer exists" "clusterresourcesetbinding"={"Namespace":"default","Name":"cluster-awrfzf"} 
E0816 15:08:59.591017   11910 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusterresourcesets.addons.cluster.x-k8s.io \"test-clusterresourceset\" not found" "controller"="clusterresourceset" "name"="test-clusterresourceset" "namespace"="default"
•I0816 15:09:00.647318   11910 clusterresourcesetbinding_controller.go:84]  "msg"="deleting ClusterResourceSetBinding because the owner Cluster no longer exists" "clusterresourcesetbinding"={"Namespace":"default","Name":"cluster-hb25hz"} 
•E0816 15:09:00.719226   11910 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusterresourcesets.addons.cluster.x-k8s.io \"test-clusterresourceset\" not found" "controller"="clusterresourceset" "name"="test-clusterresourceset" "namespace"="default"
E0816 15:09:01.788529   11910 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="failed to get data field from the resource" "controller"="clusterresourceset" "name"="test-clusterresourceset" "namespace"="default"
E0816 15:09:02.813249   11910 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusterresourcesets.addons.cluster.x-k8s.io \"test-clusterresourceset\" not found" "controller"="clusterresourceset" "name"="test-clusterresourceset" "namespace"="default"
•E0816 15:09:03.981339   11910 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusterresourcesets.addons.cluster.x-k8s.io \"test-clusterresourceset\" not found" "controller"="clusterresourceset" "name"="test-clusterresourceset" "namespace"="default"
•E0816 15:09:05.012163   11910 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusterresourcesets.addons.cluster.x-k8s.io \"test-clusterresourceset2\" not found" "controller"="clusterresourceset" "name"="test-clusterresourceset2" "namespace"="default"
E0816 15:09:06.029134   11910 controller.go:257] controller-runtime/controller "msg"="Reconciler error" "error"="clusterresourcesets.addons.cluster.x-k8s.io \"test-clusterresourceset\" not found" "controller"="clusterresourceset" "name"="test-clusterresourceset" "namespace"="default"
•I0816 15:09:06.032682   11910 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="clusterresourceset" 
I0816 15:09:06.032728   11910 server.go:208] controller-runtime/webhook "msg"="shutting down webhook server"  
I0816 15:09:06.032819   11910 controller.go:203] controller-runtime/controller "msg"="Stopping workers" "controller"="clusterresourcesetbinding" 


Ran 5 of 5 Specs in 20.907 seconds
SUCCESS! -- 5 Passed | 0 Failed | 0 Pending | 0 Skipped
--- PASS: TestAPIs (20.91s)
PASS
ok  	sigs.k8s.io/cluster-api/exp/addons/controllers	21.039s
?   	sigs.k8s.io/cluster-api/exp/addons/controllers/predicates	[no test files]
=== RUN   TestMachinePoolDefault
=== RUN   TestMachinePoolDefault/for_MachinePool
... skipping 61 lines ...
    --- PASS: TestReconcileMachinePoolBootstrap/new_machinepool,_no_bootstrap_config_or_data (0.00s)
    --- PASS: TestReconcileMachinePoolBootstrap/existing_machinepool,_bootstrap_data_should_not_change (0.00s)
    --- PASS: TestReconcileMachinePoolBootstrap/existing_machinepool,_bootstrap_provider_is_to_not_ready (0.00s)
=== RUN   TestReconcileMachinePoolInfrastructure
=== RUN   TestReconcileMachinePoolInfrastructure/new_machinepool,_infrastructure_config_ready
=== RUN   TestReconcileMachinePoolInfrastructure/ready_bootstrap,_infra,_and_nodeRef,_machinepool_is_running,_infra_object_is_deleted,_expect_failed
E0816 15:08:49.360841   12045 machinepool_controller_phases.go:237]  "msg"="MachinePool infrastructure reference has been deleted after being ready, setting failure state" "error"="could not find infrastructure.cluster.x-k8s.io/v1alpha3, Kind=InfrastructureConfig \"infra-config1\" for MachinePool \"machinepool-test\" in namespace \"default\", requeuing: failed to retrieve InfrastructureConfig external object \"default\"/\"infra-config1\": infrastructureconfigs.infrastructure.cluster.x-k8s.io \"infra-config1\" not found" "cluster"="test-cluster" "machinepool"="machinepool-test" "namespace"="default" 
=== RUN   TestReconcileMachinePoolInfrastructure/infrastructure_ref_is_paused
--- PASS: TestReconcileMachinePoolInfrastructure (0.00s)
    --- PASS: TestReconcileMachinePoolInfrastructure/new_machinepool,_infrastructure_config_ready (0.00s)
    --- PASS: TestReconcileMachinePoolInfrastructure/ready_bootstrap,_infra,_and_nodeRef,_machinepool_is_running,_infra_object_is_deleted,_expect_failed (0.00s)
    --- PASS: TestReconcileMachinePoolInfrastructure/infrastructure_ref_is_paused (0.00s)
=== RUN   TestMachinePoolFinalizer
... skipping 96 lines ...
I0816 15:09:02.371463   12045 machinepool_controller_noderef.go:90]  "msg"="Cannot assign NodeRefs to MachinePool, no matching Nodes"  
•I0816 15:09:02.419719   12045 machinepool_controller_noderef.go:90]  "msg"="Cannot assign NodeRefs to MachinePool, no matching Nodes"  
••I0816 15:09:02.424506   12045 server.go:208] controller-runtime/webhook "msg"="shutting down webhook server"  


Ran 9 of 9 Specs in 13.063 seconds
SUCCESS! -- 9 Passed | 0 Failed | 0 Pending | 0 Skipped
--- PASS: TestAPIs (13.06s)
PASS
ok  	sigs.k8s.io/cluster-api/exp/controllers	13.354s
?   	sigs.k8s.io/cluster-api/exp/util	[no test files]
?   	sigs.k8s.io/cluster-api/feature	[no test files]
?   	sigs.k8s.io/cluster-api/hack/boilerplate/test	[no test files]
... skipping 266 lines ...
--- PASS: TestGetFirstReasonAndMessage (0.00s)
=== RUN   TestNewConditionsGroup
--- PASS: TestNewConditionsGroup (0.00s)
=== RUN   TestMergeRespectPriority
=== RUN   TestMergeRespectPriority/aggregate_nil_list_return_nil
=== RUN   TestMergeRespectPriority/aggregate_empty_list_return_nil
=== RUN   TestMergeRespectPriority/When_there_is_false/error_it_returns_false/error
=== RUN   TestMergeRespectPriority/When_there_is_false/warning_and_no_false/error,_it_returns_false/warning
=== RUN   TestMergeRespectPriority/When_there_is_false/info_and_no_false/error_or_false/warning,_it_returns_false/info
=== RUN   TestMergeRespectPriority/When_there_is_true_and_no_false/*,_it_returns_info
=== RUN   TestMergeRespectPriority/When_there_is_unknown_and_no_true_or_false/*,_it_returns_unknown
=== RUN   TestMergeRespectPriority/nil_conditions_are_ignored
--- PASS: TestMergeRespectPriority (0.00s)
    --- PASS: TestMergeRespectPriority/aggregate_nil_list_return_nil (0.00s)
    --- PASS: TestMergeRespectPriority/aggregate_empty_list_return_nil (0.00s)
    --- PASS: TestMergeRespectPriority/When_there_is_false/error_it_returns_false/error (0.00s)
    --- PASS: TestMergeRespectPriority/When_there_is_false/warning_and_no_false/error,_it_returns_false/warning (0.00s)
    --- PASS: TestMergeRespectPriority/When_there_is_false/info_and_no_false/error_or_false/warning,_it_returns_false/info (0.00s)
    --- PASS: TestMergeRespectPriority/When_there_is_true_and_no_false/*,_it_returns_info (0.00s)
    --- PASS: TestMergeRespectPriority/When_there_is_unknown_and_no_true_or_false/*,_it_returns_unknown (0.00s)
    --- PASS: TestMergeRespectPriority/nil_conditions_are_ignored (0.00s)
=== RUN   TestNewPatch
=== RUN   TestNewPatch/No_changes_return_empty_patch
... skipping 210 lines ...
/home/prow/go/src/sigs.k8s.io/cluster-api/util/patch/patch_test.go:39
  Should patch a clusterv1.Cluster
  /home/prow/go/src/sigs.k8s.io/cluster-api/util/patch/patch_test.go:411
    updating both spec, status, and adding a condition [It]
    /home/prow/go/src/sigs.k8s.io/cluster-api/util/patch/patch_test.go:550

    Expected success, but got an error:
        <errors.aggregate | len:1, cap:1>: [
            {
                ErrStatus: {
                    TypeMeta: {Kind: "", APIVersion: ""},
                    ListMeta: {
                        SelfLink: "",
... skipping 23 lines ...
STEP: Creating the object
STEP: Creating a new patch helper
STEP: Updating the object spec
STEP: Updating the object status
STEP: Setting Ready condition
STEP: Patching the object
•E0816 15:09:28.775565   15053 certwatcher.go:143] controller-runtime/certwatcher "msg"="error re-watching file" "error"="no such file or directory"  
E0816 15:09:28.775605   15053 certwatcher.go:148] controller-runtime/certwatcher "msg"="error re-reading certificate" "error"="open /tmp/envtest-serving-certs-806726639/tls.crt: no such file or directory"  
I0816 15:09:28.775639   15053 server.go:208] controller-runtime/webhook "msg"="shutting down webhook server"  



Summarizing 1 Failure:

[Fail] Patch Helper Should patch a clusterv1.Cluster [It] updating both spec, status, and adding a condition 
/home/prow/go/src/sigs.k8s.io/cluster-api/util/patch/patch_test.go:580

Ran 14 of 14 Specs in 8.499 seconds
FAIL! -- 13 Passed | 1 Failed | 0 Pending | 0 Skipped
--- FAIL: TestPatch (8.50s)
=== RUN   TestToUnstructured
=== RUN   TestToUnstructured/with_a_typed_object
=== RUN   TestToUnstructured/with_an_unstructured_object
--- PASS: TestToUnstructured (0.00s)
    --- PASS: TestToUnstructured/with_a_typed_object (0.00s)
    --- PASS: TestToUnstructured/with_an_unstructured_object (0.00s)
... skipping 2 lines ...
=== RUN   TestUnsafeFocusedUnstructured/focus=status_w/_condition-setter_object,_should_only_return_status_(without_conditions)_and_common_fields
=== RUN   TestUnsafeFocusedUnstructured/focus=status_w/o_condition-setter_object,_should_only_return_status_and_common_fields
--- PASS: TestUnsafeFocusedUnstructured (0.00s)
    --- PASS: TestUnsafeFocusedUnstructured/focus=spec,_should_only_return_spec_and_common_fields (0.00s)
    --- PASS: TestUnsafeFocusedUnstructured/focus=status_w/_condition-setter_object,_should_only_return_status_(without_conditions)_and_common_fields (0.00s)
    --- PASS: TestUnsafeFocusedUnstructured/focus=status_w/o_condition-setter_object,_should_only_return_status_and_common_fields (0.00s)
FAIL
FAIL	sigs.k8s.io/cluster-api/util/patch	8.570s
?   	sigs.k8s.io/cluster-api/util/predicates	[no test files]
?   	sigs.k8s.io/cluster-api/util/record	[no test files]
=== RUN   TestSortForCreate
--- PASS: TestSortForCreate (0.00s)
PASS
ok  	sigs.k8s.io/cluster-api/util/resource	0.008s
... skipping 88 lines ...
    --- PASS: TestToUnstructured/returns_error_for_invalid_yaml#01 (0.00s)
    --- PASS: TestToUnstructured/returns_error_for_invalid_yaml#02 (0.00s)
=== RUN   TestFromUnstructured
--- PASS: TestFromUnstructured (0.00s)
PASS
ok  	sigs.k8s.io/cluster-api/util/yaml	0.039s
FAIL
make: *** [Makefile:116: test] Error 1