Investigate the lowest crawl depth that will result in complete graphs

[premasagar]

Test a number of different graphs. Increment the crawl depth, testing the number of URLs in the resultant URL list (i.e. 'graph').

Use this process to determine a suitable default value for the crawl depth - see #24.