There are some factors you need to consider during a VPS purchase :
Configuration of server on which the server is setup.
The Virtualization techniques used to set up the server.
Network Line of the VPS (Dedicated or shared)
Location of VPS
HDD or SSD storage : Preferred One is SSD Storage
