spidercache

Makes the application crawlable to web spiders and caches results