PDA

View Full Version : AWS spidering


Mike
03-08-2004, 11:57 AM
Hi all,

I know I'm moaning a lot at this, but google still hasen't spidered many of my product pages. It's approaching two months, and about 40 have been indexed - no more spidered.

Does anyone have any tips for my AWS sites? I don't have a clue what it could be...

Thanks a lot,
Mike
Chris
03-08-2004, 12:01 PM
Sure its been that long?

In anycase your server seems very slow, that could be one cause.
Mike
03-08-2004, 12:19 PM
It's been about seven weeks I think...

I got a new account over at hostony. Do you think that's any faster (http://www.sitestem.com)? If it is I could swap it to that...

Thanks a lot,
Mike
incka
03-08-2004, 12:29 PM
Each server is 1.4mbps I think on hostony.
Chris
03-08-2004, 01:03 PM
I'm trying the Patio Furniture site and it isn't even coming up for me. Wasn't when I posted first, still isn't now.

1.4mbps is pretty slow. Thats only 175kb/s, probably can't handle anymore than a couple dozen concurrent users.
Mike
03-08-2004, 01:41 PM
I've just been talking to a hostony support person and they say that it's 10mbps... :s Do you think thats fast Chris?

Patio furniture is slow for me as well. I'll probably move it to the hostony account soon.

Thanks for all your help so far,
Mike
michael_gersitz
03-08-2004, 02:19 PM
Patio furniture does not even show up for me, and I am on cable...

did you switch it?
Mike
03-08-2004, 02:23 PM
I haven't switched it yet no. Works for me though:S
incka
03-08-2004, 02:54 PM
Oh, I've worked it out, my server get the same as the others, I just had the settings for my main account as that, I have changed it now... It's so I can have loads of accounts, making sure one having loads of visitors doesn't effect others...
chromate
03-08-2004, 04:10 PM
All of your sites are timing out for me Mike, apart from SiteStem.com
MattM
03-08-2004, 04:39 PM
Only SiteStem and MSN Emotions is loading for me, and SiteStem is very slow.
chromate
03-08-2004, 05:01 PM
Yeah, I'm getting MSN emotions now too.
Jaffro
03-08-2004, 05:45 PM
I've got the same as MattM. I wouldn't say either were slow tho.
MattM
03-08-2004, 06:21 PM
Yes, they were slow for a little while, but now they're fast.
incka
03-09-2004, 12:19 AM
Strange because they are still on different servers...

I couldn't get the patio furniture one loaded before... Infact I can't now...
Mike
03-09-2004, 12:41 AM
Sitestem.com and msn-emotions.net are both on a different account. I will be moving the others later today...

Thanks for all the feedback.

Mike
incka
03-09-2004, 12:45 AM
SiteStem loads like a dream, look at the size of the images compared to the time it takes to load...
Mike
03-09-2004, 02:03 PM
There's only two images though (but they are big). The rest is basic css...
Dalgar
03-13-2004, 11:03 PM
I've having the same problem. The front page of my site gets indexed every few days (I have a link in the footer of another site of mine), but Google doesn't go any deeper. Maybe I'm just getting antsy, but with that frequency I think it should've at least taken a couple dozen pages by now.

The site has been up a little over 2 weeks.
Mike
03-14-2004, 12:50 AM
My AWS site has actually got spidered a lot today. Google seemd to visit a lot of the product pages.

Shame my sites down now :( Although I am getting my account upgraded free because of the downtime :)
incka
03-14-2004, 02:53 AM
My server is being swapped I think... I'm getting a different root address now which includes '/tmp/'