By default the SSH will use the TCP port 22. If the SSH is running on the port other than 22, you can specify the port while connecting to the remote host:
ssh -p PORT SERVER_HOSTNAME
This can be specified on a per-host basis in the configuration file.
**I will update this post with more details soon.