Handle failures gracefully

[mgrabovsky]

Handle various kinds of errors gracefully with proper logging and recovery modes. Possible failures include:

• various HTTP errors,
• web page download times out,
• corrupted database,
• decoding errors etc.