There's not much you have to worry about. Disable HA, then disconnect and remove the host from the current vCenter. The VMs should not be affected at all , I actually did this a couple of times in the past.
Before you disconnect the hosts, ensure Lockdown Mode is not enabled and you are able to directly connect/login the hosts.
André