User-agent: * Disallow: /cms/json_cache/cache/ Disallow: /cms/media/*.pdf Disallow: /cms/media/*.mp4 Disallow: /cmsdoc/ Disallow: /download/ Disallow: /assets/