kamran210·bulan lalu·discussExactly, and even without sitemap ai can crawl the webpage content for internal links.Not to mention the environmental impact of creating extra files just for AI to crawl and eventually use for training
kamran210·bulan lalu·discussHonestly, I don’t see a point in adding llms.txt file when all the information is already available on internet.So, i am staying away from them as principle.
Not to mention the environmental impact of creating extra files just for AI to crawl and eventually use for training