# Exclude way back machine User-agent: ia_archiver Disallow: / # All robots will not be allowed to index things in images directories User-agent: * Disallow: /images/ Disallow: /captions/images/ Disallow: /movies/