Psbot

From LinuxReviews
Jump to: navigation, search

Psbot is a very dumb web crawler bot which follows the Robots Exclusion Standard.

The bot does give public benefit by allowing people to find your site using the picture search engine http://www.picsearch.com/

Many webmasters choose to deny the bot access anyway because the crawler is just so incredible dumb.

User-agent: psbot
Disallow: /
Personal tools
hardware tests
Categories
Privacy policy
linux events
ipv6
Networking
IPv6

Search:

linux newz | random page | poetry | free blog