This file is used to specify pages that should not be visited by robots.