While doing SEO of your website, and especially when you’re stuck!, it sometimes become important to sneak a peek in Google’s database to see which of your website’s URLs are there in the Google index. And you wish if you could get the list of your URLs indexed by Google. Unfortunately, Google does not give any direct access into its index database. Therefore, it is not possible to straightway ask Google to give you a list of URLs that is has indexed.
Google, however, provides a lot of search operators and facilities to show you the information you are seeking. One of these operators is site. This operator can be used to get a list of all the URLs of a particular domain from Google Index. For example, if you enter the following in Google search:
The results will contain all the TechWelkin pages from Google’s index. The first page, as usual, will have 10 results and then you can go through result pages to view more pages.
This method is okay if your website has a few pages. But if your website boasts of hundreds or thousands of pages —the above method will be difficult to use.
Moreover, some SEO tools require a URL list to operate upon. Preparing such a list by copying indexed addresses from returned results is going to be very taxing. So, I am presenting a simpler solution here.
STEP 1: Log into your Google account and then go to Google Drive.
STEP 2: Create a new spreadsheet.
STEP 3: Paste the following function in first cell:
We have noticed that this method no longer works and Google no longer allows easy access to the list of indexed URLs.
STEP 4: Now place the cursor in cell number A101 and paste the above function again after changing start param from 1 to 101
Repeat the fourth step for as long as you need to. Every time you’ll get 100 URLs. Don’t be greedy by changing num=100 to num=1000 … this will not work because Google does not return more than 100 results in one go.
We hope this will help you. Share with us your questions and suggestions.