Summary

Added archiving - The contents of the artefact folder is compressed
Added an index of the pages scraped to aid ingestion
Changed filenames to ensure there are no collisions, items are prefixed with either ps_, em or ci_.
Implemented Amazon SQS message service so that an announcement can be made when a new file is avilable for ingestion