How does Google work?
I bought this domain on March 23rd, set it up two days later and then started trying to get it crawled. The first trace of Tesugen.com on Google was when Eatonweb Portal was crawled on March 28th. A couple of days later, I think maybe around April 2nd, WebLogs.Com and blo.gs were both crawled when this site appeared in the recently changed list.
Not until April 5th, Google crawled my site, but only the first page. And you couldn’t do “Similar pages” on it. And if I tried to create a SiteSearch account, their app told me nothing was known about Tesugen.com. Then they crawled me again yesterday, but still only the first page and still without a “Similar pages” link—but now SiteSearch works!
They probably have some kind of threshold for when they think it is interesting to crawl a newly found URL. Then there’s probably a threshold for determining how often to crawl a site—which is why I find it strange to get crawled two days in a row. I know of very busy sites that aren’t crawled every day—so it shall be interesting to see what happens tonight.
I wonder if they will crawl my old URL, Tesugen.org if I put in a link to it. It has been crawled way back in the past only.
Hm, I read a FAQ on the Google site and the fact that my >META< description isn’t listed probably means that “[my] page is currently partially indexed, which means that although [Google knows] about [my] site, [their] robots have not read all the content on [my] page(s) in past crawls.”