Can the REST API Sites Directory URLs via Manager be configured to a specific server

Hi, 

Just starting out on the REST side of things so still playing catch up but can the default listings for the REST API Sites Directory URLs via the REST MANAGER be configured against a specific server rather than localhost entries?  Is there an equivalent to the ADF framework.xml file that stores those sites currently configured for a deployment?  I wish to be able to access manager on my local desktop rather than residing locally on the web server itself where my REST components are stored.

Brad