Sitemap: https://techidaily.com/sitemap_index.xml User-agent: * Allow: / Disallow: /scripts/ Disallow: /public/ Disallow: /css/ Disallow: /images/ Disallow: /content/ Disallow: /assets/ Disallow: /ui/ Disallow: /js/ Disallow: /lib/ Disallow: /fonts/ Disallow: /fontawesome/ Disallow: /scripts/ Disallow: /article_preview.html*