Yahoo site explorer

[duncan drennan]

I added my site to Yahoo a long time ago, and also set up my site feed on their Site Explorer. When I checked back a while ago I noticed that the last time it was processed was when I originally submitted it. I resubmitted it and it was processed again, but there does not seem to be any way of getting it to regularly check the feed (sitemap).

Any way to do this other than checking back regularly to resubmit it?

[Dave A]

Are you using an XML sitemap?

[duncan drennan]

Are you using an XML sitemap?

It is actually for my blog and the feed can be used as the sitemap.

[Dave A]

I see you use a sitemap line in your robots.txt file.

I also see Yahoo! has got 354 pages indexed for your blog anyway...

By the way - what have you got against Mediapartners-Google?

And after drawing up this next bit, I now notice you are using the blogger platform. Damn. But for anyone else who might be using Wordpress:

Use an XML sitemap generator plugin for Wordpress instead of the feed format and put the URL for an XML sitemap in your robots.txt file instead. Yahoo! found the sitemaps here via robots.txt no problem and collects them about every 48 hours without prompting.

[duncan drennan]

I see you use a sitemap line in your robots.txt file.

I also see Yahoo! has got 354 pages indexed for your blog anyway...

By the way - what have you got against Mediapartners-Google?

And after drawing up this next bit, I now notice you are using the blogger platform.

The robots.txt is the default set by Blogger. I do know that yahoo has the site indexed, but was just confused by the way their site explorer works. With Google Sitemaps it is quite clear when it lasted processed your sitemap, but with Site Explorer it appears to only process it at submission time (but that may not actually be the case - they just report it that way).

How do you know The Forum's sitemap is being picked up every 48 hours?

[duncan drennan]

By the way - what have you got against Mediapartners-Google?

If you look carefully you will actually see that that line allows the Adsense bot to access all pages, while the next line stops search engines from going through certain directories which contain "duplicate" content.

I wish Wordpress users would do the same on their blogs so that their tags pages are not indexed.

[Dave A]

How do you know The Forum's sitemap is being picked up every 48 hours?

Downloads of any file are logged. There is a vB plugin that filters and puts the data into a rather handy report accessible from the backend.