View Issue Details

IDProjectCategoryView StatusLast Update
0005548Composrrobots_txtpublic2024-07-25 19:50
ReporterChris GrahamAssigned To 
SeverityFeature-request 
Status non-assignedResolutionopen 
Product Version 
Fixed in Version 
Summary0005548: Allow easy GPT crawl blocking
DescriptionSee https://www.twentyfirstdigital.com/blog/block-chatgpt-content-crawling
TagsType: Anti-big-tech
Time estimation (hours)1
Sponsorship open

Relationships

related to 0005570 non-assigned Generative AI poisoning 

Activities

Patrick Schmalstig

2024-01-14 17:11

administrator   ~0008185

How would you like this implemented? Are you thinking about a setting that adds it in (or removes it) automatically in robots.txt? Are you thinking it should be a comment block that can be un-commented if desired? Should it be in Composr's robots.txt by default?

Chris Graham

2024-01-14 17:18

administrator   ~0008187

Good point. Maybe even we just document it. I don't want to think about it too much now.

Patrick Schmalstig

2024-01-25 21:48

administrator   ~0008241

See Also link added to tut_security in v10. Pending addition to v11.

Issue History

Date Modified Username Field Change
2024-01-14 15:42 Chris Graham New Issue
2024-01-14 17:11 Patrick Schmalstig Note Added: 0008185
2024-01-14 17:18 Chris Graham Note Added: 0008187
2024-01-21 15:55 Chris Graham Tag Attached: Type: Anti-big-tech
2024-01-25 21:48 Patrick Schmalstig Note Added: 0008241
2024-07-25 19:50 Chris Graham Relationship added related to 0005570