{"id":1554,"date":"2020-06-07T22:02:24","date_gmt":"2020-06-07T14:02:24","guid":{"rendered":"https:\/\/www.wesbytes.com\/guide\/?post_type=kb&#038;p=1554"},"modified":"2026-01-12T14:36:02","modified_gmt":"2026-01-12T06:36:02","slug":"how-do-i-block-bots-and-crawlers","status":"publish","type":"kb","link":"https:\/\/www.servergigabit.com\/guide\/kb\/how-do-i-block-bots-and-crawlers","title":{"rendered":"How do I block bots and crawlers?"},"content":{"rendered":"<h3><strong>How do I block bots and crawlers?<\/strong><\/h3>\n<p><a href=\"https:\/\/www.cloudflare.com\/\" rel=\"nofollow noopener\" target=\"_blank\">Cloudflare\u2019s<\/a> data sources will help reduce the number of bad bots and crawlers hitting your site automatically block bots and crawlers (not all). If you would like to place a block of your own for\u00a0 bad bots and crawlers, you can block them by IP in your Firewall app.<\/p>\n<p>In addition, customers that are on a paid plan can look at turning on Cloudflare\u2019s\u00a0Web Application Firewall (WAF)\u00a0to further help reduce the threat of bad bots and crawlers that don\u2019t follow good behavior guidelines.<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>How do I block bots and crawlers? Cloudflare\u2019s data sources will help reduce the number of bad bots and crawlers hitting your site automatically block bots and crawlers (not all). If you would like to place a block of your own for\u00a0 bad bots and crawlers, you can block them by IP in your Firewall app. In addition, customers that&hellip;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"kbtopic":[43],"kbtag":[1436,1437],"class_list":["post-1554","kb","type-kb","status-publish","hentry","kbtopic-cloudflare","kbtag-bots","kbtag-crawlers"],"_links":{"self":[{"href":"https:\/\/www.servergigabit.com\/guide\/wp-json\/wp\/v2\/kb\/1554","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.servergigabit.com\/guide\/wp-json\/wp\/v2\/kb"}],"about":[{"href":"https:\/\/www.servergigabit.com\/guide\/wp-json\/wp\/v2\/types\/kb"}],"author":[{"embeddable":true,"href":"https:\/\/www.servergigabit.com\/guide\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.servergigabit.com\/guide\/wp-json\/wp\/v2\/comments?post=1554"}],"version-history":[{"count":4,"href":"https:\/\/www.servergigabit.com\/guide\/wp-json\/wp\/v2\/kb\/1554\/revisions"}],"predecessor-version":[{"id":6072,"href":"https:\/\/www.servergigabit.com\/guide\/wp-json\/wp\/v2\/kb\/1554\/revisions\/6072"}],"wp:attachment":[{"href":"https:\/\/www.servergigabit.com\/guide\/wp-json\/wp\/v2\/media?parent=1554"}],"wp:term":[{"taxonomy":"kbtopic","embeddable":true,"href":"https:\/\/www.servergigabit.com\/guide\/wp-json\/wp\/v2\/kbtopic?post=1554"},{"taxonomy":"kbtag","embeddable":true,"href":"https:\/\/www.servergigabit.com\/guide\/wp-json\/wp\/v2\/kbtag?post=1554"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}