So I think I figured out my issue. The VMs I was importing were reading off the local storage of the ESX server which is a single SSD. Once I started one that was reading off the the storage device, it went much, much faster.
I still have an issue with something else on imports, but I will open a ticket since I have support. Thank you for the help.