View Issue Details
| ID | Project | Category | View Status | Date Submitted | Last Update |
|---|---|---|---|---|---|
| 0005586 | Composr | core | public | 2024-01-31 03:14 | 2024-07-23 15:03 |
| Reporter | Patrick Schmalstig | Assigned To | Patrick Schmalstig | ||
| Severity | Feature-request | ||||
| Status | assigned | Resolution | open | ||
| Product Version | |||||
| Fixed in Version | |||||
| Summary | 0005586: Task queue: Cron does not respect number of locked tasks; maybe it should | ||||
| Description | It is possible for a server to get overloaded with multiple tasks running at the same time. This is because Cron will start a new task from the queue regardless of the number of tasks locked. Perhaps this behaviour should be modified. Maybe Cron should not start a new task if X tasks are currently locked, or maybe base it off of whether or not we are in failsafe or if (using the same criteria as the health check) resource use is high. | ||||
| Additional Information | Actually Cron loads up all of them at the same time. Maybe we should also limit this to X tasks per Cron execution. Though, if all of them are loaded up in one Cron, that means only one thread is dedicated to running all of the tasks, which may be okay until / unless we get more tasks queued between each Cron run. | ||||
| Tags | Roadmap: Over the horizon | ||||
| Time estimation (hours) | |||||
| Sponsorship open | |||||
| related to | 0005656 | resolved | Patrick Schmalstig | Optimise task queue more intelligently |
|
|
We will also need a health check for making sure the task queue is not stuck. |
|
|
I'm keeping this as something we should consider for 11.0. This is because delete members and privacy purging are now background tasks, which both can be very intense processes if done on a mass amount of data. Therefore it makes this consideration more vital. |
|
|
Not as important now that the task queue was optimized in v11 alpha2. Changed to over the horizon. |
| Date Modified | Username | Field | Change |
|---|---|---|---|
| 2024-01-31 03:14 | Patrick Schmalstig | New Issue | |
| 2024-01-31 03:14 | Patrick Schmalstig | Status | non-assigned => assigned |
| 2024-01-31 03:14 | Patrick Schmalstig | Assigned To | => Patrick Schmalstig |
| 2024-01-31 03:14 | Patrick Schmalstig | Tag Attached: Roadmap: v11 | |
| 2024-01-31 03:17 | Patrick Schmalstig | Additional Information Updated | View Revisions |
| 2024-01-31 03:22 | Patrick Schmalstig | Note Added: 0008281 | |
| 2024-03-30 14:58 | Patrick Schmalstig | Severity | Minor-bug => Feature-request |
| 2024-03-30 14:59 | Patrick Schmalstig | Note Added: 0008499 | |
| 2024-04-12 20:17 | Patrick Schmalstig | Tag Detached: Roadmap: v11 | |
| 2024-04-12 20:17 | Patrick Schmalstig | Tag Attached: Roadmap: Over the horizon | |
| 2024-04-12 20:17 | Patrick Schmalstig | Note Added: 0008580 | |
| 2024-07-23 15:03 | Chris Graham | Relationship added | related to 0005656 |
