Psbot

From LinuxReviews
Jump to: navigation, search

Psbot is a very dumb web crawler bot which follows the Robots Exclusion Standard.

The bot does give public benefit by allowing people to find your site using the picture search engine http://www.picsearch.com/

Many webmasters choose to deny the bot access anyway because the crawler is just so incredible dumb.

User-agent: psbot
Disallow: /
Personal tools
linuxreviews
Privacy policy
linux events
ipv6
Networking

You need to login to edit or create pages on this wiki.

IPv6

Search:

linux newz | random page | poetry | free blog | adult dating