The machine where you sit and type ssh or scp is the client. This is the one where you should edit the .ssh/known_hosts file. BTW, since it is located in your home directory it is owned by you, not the superuser, so you are allowed to edit it.
If vi is just showing tildes, try the following...