User-Agent: * Disallow: /members/fcib/board/ Disallow: /resourcelibrary/ Disallow: /members/leadership/ # /robots.txt file for gsa-crawler (This is a comment line.) User-agent: gsa-crawler (This names the user-agent that the file targets.) Allow: /$