Daily Crawl Data Improvement
Today we can announce some improvements to the “fresh Crawl” reports that users can see in their control panel.
In addition to our now monthly full index updates, we track, daily, any new back-links that we discover to any given domain. The problem was that many of the flags on these back-links were not being parsed until the full update and the “mentions” of a domain (where a domain might be listed, but with no link) was appearing in these results. Whilst this is not necessarily wrong, it is hardly helpful for SEO.
So from the 26th of November onwards, mentions are removed from the daily updates.
Whilst this will reduce the numbers on this report, at least your clients won’t go clicking on all the links and saying “but there’s no link there!”.
Please note that this report lists when we FOUND new links, not when they were actually created.
You can download these reports into CSV files pretty easy, with the link at the bottom left of the page.
We hope this is helpful? It was my suggestion, so if it wasn’t, I’ll have to hang my head in shame and go back to the development team with cap in hand…