Is it ESX(i) 4 that you're using? If so what is the performance like for the VM during one of these failures if you look at the Performance tab in the vSphere client? Are there any errors in the event log prior to have to reset the VM?
What sort of virtual NIC are you using?