Support parallel downloads

[mgrabovsky]

Allow for webpages on different domains (or even the same?) to be downloaded in parallel.

Care needs to be taken with regards to concurrent database access.