# https://www.robotstxt.org/robotstxt.html # Allow all search engines to crawl everything User-agent: * Allow: / Allow: /blogs/ Allow: /blogs/* Allow: /blogs/static-pages/* Disallow: /lander Disallow: /_next/static/media/a34f9d1faa5f3315-s.p.woff2 # 允许爬取所有博客URL # Disallow: /blogs/slug?* # Sitemap location Sitemap: https://emojimyface.com/sitemap.xml