@Andrew That's what I thought, but basically wanted confirmation. Are there any settings to look at that may be able to be tuned in XCP to improve responsiveness?
If you want to login manually without any SSH key, you have to add a password for the account (passwd). Then you can log in with your Debian user with this password.