Archive for the ‘Updates’ Category
This is the index update for this month.
325,434,932,904 Pages crawled
3,207,846,754,541 Unique URLs… Continue reading
We’ve updated our index today with freshly crawled data – it now includes full crawl for 2010. Our crawling system is now recrawling a lot of URLs, so you should be able to see more fresh December 2010 crawl dates on backlinks: URLs with higher ACRank get recrawled more frequently.
We’ve also revised calculation of ACRanks to have better distributions, you can see new thresholds in our updated Glossary… Continue reading
Recrawling 300,000,000 urls every day and we STILL increased the index size to an all time high. Continue reading