Disallowing directory contents listing Options -Indexes (This can also be done via Site Management Tools > Index Manager.)
Changing your default home page DirectoryIndex index.cgi backup.html (By listing multiple files here, if one is inaccessible, it will failover to the next.)
Reroute error documents ErrorDocument ERRNUM /error/ERRNUM.html (Replace ERRNUM with an error code)