|Liam Delahunty: Home||Tips||Web||Contact|
Think I deserve a present? See my Amazon Wish List
There are some issues with this script, the main concern being that it gets the robots.txt for all the external URLs on a page - so will return one for each IFRAME and JS call, such as adSense blocks.
It will display any meta content found for robots, and then read in the robots.txt. This displays for a few seconds then disappears. Clicking on the link in the display will load the robots.txt
Some sites have been pre-excluded, such as Google, Yahoo, digg and stumbleupon. Add other sites to exclude by clicking on the Greasemonkey icon, then selecting the script ("Show nofollow meta and robots.txt") and adding any further exclusions.
Download "Show nofollow meta and robots.txt" here:
This version only shows the meta tag if found:
Thanks to Rob from Yack Yack for suggesting the script.