User-agent: * Disallow: /*/amp/ Disallow: /*?preview* Disallow: /press/ Disallow: /pdf/ Disallow: /hotbanner/ Disallow: /*?p Disallow: /wp-json/wordpress-popular-posts/v1/popular-posts #----------------------------------------- # Crawl-delayの指定をこの下に置く # このブロックにはDisallow系の指定は一切記載しない #----------------------------------------- User-Agent: FacebookBot Crawl-delay: 5 User-Agent: meta-externalagent Crawl-delay: 5