Timeline for Efficiently delete large directory containing thousands of files
Current License: CC BY-SA 3.0
11 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| S Jun 20, 2016 at 11:20 | history | suggested | Pierre.Vriens | CC BY-SA 3.0 |
Remove noise
|
| Jun 20, 2016 at 11:08 | review | Suggested edits | |||
| S Jun 20, 2016 at 11:20 | |||||
| Jun 29, 2015 at 12:49 | comment | added | Marki555 |
Also note that load average does not account for number of logical CPUs. So loadavg 1 for single-core machine is the same as loadavg 64 on 64-core system - meaning each CPU is busy 100% of time.
|
|
| Jul 14, 2014 at 12:47 | comment | added | Score_Under | Load average is not always CPU, it's just a measure of the number of blocked processes over time. Processes can block on disk I/O, which is likely what is happening here. | |
| Jan 4, 2014 at 7:24 | comment | added | derobert |
I think you should go ahead and edit this into its own answer… it's really too long for a comment. Also, it sound like your filesystem has fairly expensive deletes, curious which one it is? You can run that find … -delete through nice or ionice, that may help. So might changing some mount options to less-crash-safe settings. (And, of course, depending on what else is on the filesystem, the quickest way to delete everything is often mkfs.)
|
|
| Jan 3, 2014 at 17:48 | comment | added | xenoterracide |
if you're going to use exec you almost certainly want not use -ls and do find . -type f -exec rm '{}' + + is faster because it will give as many arguments to rm as it can handle at once.
|
|
| S Dec 31, 2013 at 19:27 | history | suggested | Barun | CC BY-SA 3.0 |
Code highlight
|
| Dec 31, 2013 at 19:26 | review | Suggested edits | |||
| S Dec 31, 2013 at 19:27 | |||||
| S Dec 31, 2013 at 19:18 | review | Late answers | |||
| Dec 31, 2013 at 19:19 | |||||
| S Dec 31, 2013 at 19:18 | review | First posts | |||
| Dec 31, 2013 at 19:26 | |||||
| Dec 31, 2013 at 19:00 | history | answered | Scotty | CC BY-SA 3.0 |