PDA

View Full Version : compute-1.amazonaws.com bot / scrape?



Todd W
01-06-2009, 12:08 PM
What does AmazonAWS.com have to do with spiders and scraping?

They are hitting my site lately and i`m not sure for what search engine or reason?

Chris
01-06-2009, 02:21 PM
Amazon has services where they rent out computer space to third parties, could it be that? Or do you think it is Amazon themselves doing it.

Todd W
01-06-2009, 03:25 PM
Amazon has services where they rent out computer space to third parties, could it be that? Or do you think it is Amazon themselves doing it.

Hmmm.... maybe it's for Alexa search is my thought.

Blue Cat Buxton
01-07-2009, 03:50 AM
Hmmm.... maybe it's for Alexa search is my thought.

The Alexa bot identifies itself as from Alexa though - or I thought it always used to.