Majestic-12 confirms Google’s milestone: more than 1 trillion URLs found

By Alex October 8, 2009



Five years ago today Majestic-12 Distributed Search Engine project was founded with the aim to create a community driven search engine based on distributed computing model. Since then we have crawled over 200 billion web pages.

Today, we have more than just our anniversary to celebrate. Our web map index has now grown to 1,026,035,494,521 unique URLs. We believe that makes us the second organisation in the world to publicly announce that we have discovered more than 1 trillion (as in 1,000,000,000,000) unique URLs on the Web.

We are honoured therefore, to provide an independent verification of the milestone announced in July last year, that Google’s systems had detected 1 trillion (as in 1,000,000,000,000) unique URLs on the web.

Our webmap can be explored by visiting www.majesticseo.com, where anyone can get free backlinks data by verifying ownership of their web site.

Additionally our licensed data is processed and offered as a part of services offered by our clients Wordtracker and SearchDNA.net. Wordtracker is a leading keyword research service popular with search engine optimizers, web designers and marketers throughout the world. SearchDNA.net is an SEO link, commerce, content and contact discovery engine and is now taking beta applications.

We look forward to other organisations being able to join the “webmap trillionaires club” in years to come!

Posted In: General

34 Responses to “Majestic-12 confirms Google’s milestone: more than 1 trillion URLs found”

  1. Oracleslave said:

    October 08, 2009 at 1:52 pm

    Many congrats Alex!

  2. Pablo said:

    October 08, 2009 at 1:55 pm

    Congratulations, this is a huge improvement and you are on the right track :)

  3. Jori said:

    October 08, 2009 at 2:05 pm

    Congratulations for this splendid word over the years! I’ve discovered majestic seo some months ago, and it is true, it’s one of my useful tools in my everyday life at work. Thanks :)

  4. Olivier, WebRankInfo said:

    October 08, 2009 at 2:27 pm

    Congrats Alex! Your tool is on top of my favourites!

    When I talk about your tool to my community (WebRankInfo.com), my clients or the people who attend my seminars, they enjoy your tool.

    Keep up the good work!

    Olivier Duffez
    NB: gona write a post about this milestone…

  5. Kevin said:

    October 08, 2009 at 2:37 pm

    That is an incredible milestone guys and it feels good to know that this was reached using the crawling from my computers and every other participant from majestic12.co.uk. Here is to another trillion!

  6. Malte Landwehr said:

    October 08, 2009 at 3:05 pm

    The Website stats still say “Total known URLs: 178,761,104,639″?

    • Alex Chudnovsky said:

      October 08, 2009 at 3:08 pm

      Malte, that’s on Majestic-12 site – these are URLs that we selected for crawl, our Majestic-SEO index includes ALL URLs that we found.

  7. Stephen Field said:

    October 08, 2009 at 4:05 pm

    your searchdna.net link is going to the .com…

    • Alex Chudnovsky said:

      October 08, 2009 at 4:11 pm

      Fixed now, sorry about that!

  8. Dixon said:

    October 08, 2009 at 5:18 pm

    It’s been a great day for Majestic. Alex must be rightly proud. We’re going to tell the wider world on this one tomorrow. If you see it on a news feed, tell them you were there guys :)

    Dixon.

  9. Goran said:

    October 09, 2009 at 3:17 pm

    Great job guys! I will use your services more often and probably even contribute!

  10. SEO Doctor said:

    October 11, 2009 at 8:08 pm

    Well you seem to be crawling more than Linkscape. If the Yahoo/Bing partnership sees the dropping of Yahoo site explorer – you’ll be quids in.

  11. SEOsean said:

    October 15, 2009 at 10:21 am

    This is just awesome! Congrats on indexing that many URLs. You’re truly worthy of it!

    I’m glad I came back… I recently got turned back on to Majestic SEO from a post on Aaron Wall’s site. I had used it a little before but I now signed up as a member and I’m going to be using it a lot more. So thanks again for providing an excellent service.

    Best,
    Sean Gallagher
    CEO / Founder
    Gallagher Website Design
    http://www.GallagherWebsiteDesign.com
    http://www.SEOsean.com

  12. SEOsean said:

    October 15, 2009 at 10:21 am

    This is just awesome! Congrats on indexing that many URLs. You’re truly worthy of it!

    I’m glad I came back… I recently got turned back on to Majestic SEO from a post on Aaron Wall’s site. I had used it a little before but I now signed up as a member and I’m going to be using it a lot more. So thanks again for providing an excellent service.

    Best,
    Sean Gallagher
    CEO / Founder
    Gallagher Website Design

  13. AQC said:

    October 17, 2009 at 5:24 pm

    Awesome, all my websites are in your tool ! I own more than 500 websites and all of them are there !

    Congrats !

  14. seo london said:

    October 19, 2009 at 2:00 pm

    Great Alex congrats for this awesome achievement keep it on .

  15. David Hunt said:

    October 25, 2009 at 10:11 am

    I’ve worked in distributed computing since 2001 in the SETI days.
    Hearing about Alex’s project back in 2006 has turned into a 3 year friendship and it’s my pleasure to work on this project.
    I think you’d have to look long and hard to find a better and more dedicated person than you find in Alex.
    Thanks Alex!
    Dave

  16. Martin Neuzil said:

    October 26, 2009 at 9:40 pm

    Really nice result. Hard work always pays, right? Congratulations!

  17. Marian said:

    February 15, 2010 at 4:19 pm

    Hi. How add my site http://locuinte.webs.com in Majestic Seo?

    • Alex Chudnovsky said:

      February 19, 2010 at 3:07 pm

      Hi, we’ll add this site automatically once we crawl pages with a link pointing to it.

  18. Marian said:

    February 25, 2010 at 7:13 pm

    hi . Need to give my pages link to your site?
    my site is http://locuinte.webs.com

    I apologize, I do not know English well.

  19. Dixon said:

    March 15, 2010 at 1:01 pm

    No, you do not need to link to our site.

  20. CoolBuddy said:

    March 23, 2010 at 6:15 pm

    Hi, I used the MajesticSeo to check the backlinks I have and some other tools.
    I found it very useful and accurate. Thanks

  21. Jiri said:

    April 25, 2010 at 8:53 pm

    Please, maybe I don’t understand well, but where is some webform where I can use this engine ??

    Thanks. Jiri

  22. Dixon said:

    April 26, 2010 at 10:56 am

    The engine ONLY analyzes backlinks, Jiri. So start by putting a URL into http://www.majesticseo.com/ and see where it gets you :)

  23. Multiweb Agência said:

    May 29, 2010 at 12:46 pm

    We are using Majestic SEO for a couple of weeks and it is really fantastic! Simple, clear, objective. Thank you and congratulations.

  24. Vince Grattage said:

    August 12, 2010 at 9:06 am

    Congratulations Alex !

    Your tool is excellent. My community is very happy !

  25. sam said:

    October 08, 2010 at 9:18 am

    Congratulations Alex ! Keep up the good work.

  26. Ramiroyal said:

    October 11, 2010 at 11:40 am

    Majesticseo is on of my favourites! Congratulations Alex !

  27. qualitytraffic said:

    March 10, 2011 at 4:29 pm

    Not sure about what the fascination with sheer link numbers is.

    Rather that emulating Google, I would dedicate my server’s processing time to writing a web application to maintain a database of spam domains and blogs to ban them from ever being crawled byany software. Point in case, even after Google has just applied their latest and greatest Panda algorithm update, the goson?.net (a ‘song’ website) has more than 5 million spam links conveniently indexed to cause countless hours of cleanup every day.

    • Alex Chudnovsky said:

      March 10, 2011 at 5:16 pm

      Hi,

      Number of unique URLs is the only parameter that Google voiced recently that enabled us to judge whether we’ve got scale close enough to what they have in terms of web coverage.

      Alex