I think you described the problem, more and more of us are facing nowadays, very concise and correctly.
Alan will not like me for this 
, but PowerCLI as a module is the only way out I can see.
In any case it beats changing all your
Get-VM
lines into
VMware.VimAutomation.Core\Get-VM