Missigua Locator

From LinuxReviews
Jump to: navigation, search

Missigua Locator is a hostile web crawler program which collects e-mail addresses (which are then used by the person running the crawler to spam). It does not follow the Robots Exclusion Standard.

[edit] User-Agent

It identifies itself as "Missigua Locator 1.9".

This is a program anyone can get their hands on and run, so IP based blocking is sort of out of the question. However, the software (as is) does identify itself correctly using User-Agent when crawling - but it doesn't care about robots.txt.

Missigua Locator

Annoying web crawlers (follow robots.txt, but doesn't provide any public benefit)

CazoodleBot

Friendly web crawlers (used by search-engines, or somehow gives public benefit)

Psbot

Personal tools
hardware tests
Categories
Privacy policy
linux events
ipv6
Networking
IPv6

Search:

linux newz | random page | poetry | free blog