Sure a VPS can not be EXACTLY a desktop because it is not "near" you. But you have PROs, too: it will work 24h/day and it will have better internet speed than at your home.
So, my doubt is about to use a VPS as a DESKTOP using 2 O.S.:
Linux Choose one Linux Distro with GUI. Maybe Ubuntu like the best desktop option.
Windows Here I could see a problem. If you want to choose one Windows VPS you will need to pay at least $5 for 256Mb RAM, what is not much and your vps will be slow.
The second option is to get a KVM VPS with 1 or 2Gb and install your own license. The problem is in what is "your own license" to VPS providers. How can I install Windows if I will not use it as SERVER? If I have a Win XP license, I imagine I can not install it in a VPS. Maybe the best option could be install a TRIAL Windows Server (2003, 2008 or 2012).
In my case I prefer to use WINDOWS because I can install a few SEO softwares that I can not install in Linux.
Do you have experience in use VPS as a desktop? What do you suggest me?
Tks!