# AI and scraping, robots.txt

**URL:** <https://forum.readymag.com/t/ai-and-scraping-robots-txt/7276>\
**Category:** General topics\
**Created:** [October 21, 2026, 11:59am UTC](https://forum.readymag.com/t/ai-and-scraping-robots-txt/7276 "2026-10-21T11:59:02Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![cardboredbox](https://sea1.discourse-cdn.com/flex015/user_avatar/forum.readymag.com/cardboredbox/32/4731_2.png) [@cardboredbox](https://forum.readymag.com/u/cardboredbox)\
**Post date:** [October 21, 2026, 11:59am UTC](https://forum.readymag.com/t/ai-and-scraping-robots-txt/7276/1 "2026-10-21T11:59:02Z")

</div>

hey there all!

I’m new to making a website and i’m using this for my portfolio. anybody know how to discourage scraper bots? i’ve heard of robots.txt but i’m not sure where i’d put it.