If you have install Ubuntu Server 12.04 and you install your own desktop environment, e.g: xfce, this can happen when you try to remote your server.
The solution is simple, yet tricky. There is 2 file that you need to take a look.
(usually at end of the file)
If the file is not there, create new.
Put this line:
Then try to connect to your server.