Summary: Speed up the connection to Exchange by importing only the cmdlets that you need.
Is there a way to speed up the initial PowerShell connection to Exchange?
Yes, of course! With a little modification to Import-PSSession, we can speed up the connection. Normally, you would connect to Exchange 2010/2013/2016 like this:
$session = New-...