Spinn3r

From LinuxReviews
Jump to: navigation, search

Spinn3r is a very impolite web crawler which brings no public benefit.

Contents

[edit] Hostile

The Spinn3r robot may decide to fetch your RSS feed every 5 minutes, which is really impolite.

[edit] No public benefit

The spinn3r.com homepage states that "Spinn3r is licensed on a monthly basis per thousand blogs crawled, indexed, and delivered. Please contact us for a price quote.".

There is no public search interface. There is no way to enjoy the data it gathers without paying a license fee. Thus; Spinn3r costs a lot of resources and brings no visitors to your site. It has no public benefit at all.

[edit] Spinn3r's Reply

This is not true. We license data to many social media monitoring services which have public APIs.

Additionally, just because something costs money doesn't mean there is no public benefit.

If you're a customer of Spinn3r accessing the data is certainly MUCH MUCH cheaper than building your own search engine.

We also sponsor research access at free or cost for researchers and have done so for nearly a decade.

There are more than 350 academic papers that have been built from our corpus of content.

[edit] Solution

# aggregator:Spinn3r, "Spinn3r is licensed on a monthly basis"
# Copyright 2008 Tailrank Inc.
# 64.34.192.0 - 64.34.199.255, seen from 64.34.195.137
$IPTABLES -A INPUT -i eth0 -s 64.34.192.0/24 -j DROP
$IPTABLES -A INPUT -i eth0 -s 64.34.193.0/24 -j DROP
$IPTABLES -A INPUT -i eth0 -s 64.34.194.0/24 -j DROP
$IPTABLES -A INPUT -i eth0 -s 64.34.195.0/24 -j DROP
$IPTABLES -A INPUT -i eth0 -s 64.34.196.0/24 -j DROP
$IPTABLES -A INPUT -i eth0 -s 64.34.197.0/24 -j DROP
$IPTABLES -A INPUT -i eth0 -s 64.34.198.0/24 -j DROP
$IPTABLES -A INPUT -i eth0 -s 64.34.199.0/24 -j DROP
Personal tools
hardware tests
Categories
Privacy policy
linux events
ipv6
Networking
IPv6

Search:

linux newz | random page | poetry | free blog