View Issue Details
| ID | Project | Category | View Status | Date Submitted | Last Update |
|---|---|---|---|---|---|
| 0003569 | Composr documentation | [All Projects] General / Uncategorised | public | 2018-03-28 00:08 | 2022-08-15 01:15 |
| Reporter | Adam Edington | Assigned To | |||
| Severity | Feature-request | ||||
| Status | non-assigned | Resolution | open | ||
| Summary | 0003569: Blocking nefarious crawlers via .htaccess changes | ||||
| Description | I am not sure if this is suitable for a distributable CMS, but it does sound like a useful level of protection I don't think we currently have. The .htaccess method sounds the simplest given I'm not sure how many end users will have root server access. Maybe some of the other snippets could be useful too, but primarily the blocking of bad crawlers I think would be beneficial to security and bandwidth/processing? https://github.com/mitchellkrogza/apache-ultimate-bad-bot-blocker | ||||
| Tags | Type: Spam | ||||
| Time estimation (hours) | |||||
| Sponsorship open | |||||
| related to | 0003315 | resolved | Chris Graham | Composr | Bundle default robots.txt |
| related to | 0000415 | closed | Chris Graham | Composr | robots.txt editor (formerly: "Allow exclusion of contents from sitemap for all content types") |
|
|
We do do some of this already, e.g. the rate limiting feature. So essentially this is addition of a block list in the default configuration. I probably would solve this via a tutorial to be honest, but there's a lot to read over, certainly could be some good ideas. |
|
|
I had a similar file years ago which appeared to work well, but this project seems way more thorough and is active so I thought I'd raise the suggestion that it might be worth a look and you'll certainly make more sense of it than me. |
| Date Modified | Username | Field | Change |
|---|---|---|---|
| 2018-03-28 00:08 | Adam Edington | New Issue | |
| 2018-03-28 00:12 | Chris Graham | Relationship added | related to 0003315 |
| 2018-03-28 00:13 | Chris Graham | Tag Attached: Type: Spam | |
| 2018-03-28 00:16 | Chris Graham | Relationship added | related to 0000415 |
| 2018-03-28 00:17 | Chris Graham | Note Added: 0005629 | |
| 2018-03-28 00:33 | Adam Edington | Note Added: 0005633 | |
| 2018-08-29 22:30 | Chris Graham | Summary | [Suggestion] Block nefarious crawlers option => Block nefarious crawlers option |
| 2018-08-29 22:30 | Chris Graham | Project | Composr => Composr documentation |
| 2022-08-15 01:15 | Chris Graham | Category | core => General |
| 2022-08-15 01:15 | Chris Graham | Summary | Block nefarious crawlers option => Blocking nefarious crawlers via .htaccess changes |
| 2023-02-26 18:29 | Chris Graham | Category | General => General / Uncategorised |
