Update SSH port when running bundle exec rake gitlab:app:setup

Created by: nodesocket

I am almost done installing on CentOS 6.4, but during one of the last steps:

bundle exec rake --trace gitlab:app:setup RAILS_ENV=production

I am getting:

ssh: connect to host localhost port 22: Connection refused
fatal: The remote end hung up unexpectedly
rake aborted!

Which is right, because I am running SSH on port 2020. Where can I configure or change a setting to override the SSH port to my custom value of 2020.