Timeline for How to tune the linux Scheduler for parallel computation?
Current License: CC BY-SA 4.0
10 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Jan 7, 2021 at 11:09 | comment | added | Just Me | for what it's worth @Ole, neither have I. | |
| Jan 6, 2021 at 13:27 | comment | added | Ole Tange |
I have never been able to get more than 1% extra performance by fiddling with the scheduler (e.g. by using taskset to keep the process on a single CPU thus avoiding cache misses) as long as you run 1 thread per CPU core and all CPU cores show up as 100% busy. If you do get more than 1% speedup, I hope you will share the measurements.
|
|
| Jan 3, 2021 at 21:33 | comment | added | ctrl-alt-delor |
That looks like it will set the scheduler for batch. However I always use schedtool (keep deployment separate). Some of the other tuning from other posts e.g. slower scheduling for server may also help.
|
|
| Jan 3, 2021 at 17:40 | answer | added | Stewart | timeline score: 0 | |
| Jan 3, 2021 at 16:02 | comment | added | Just Me | and also: how do I actually tune these parameters? I can't seem to find if/how I can do this from the command line. Or is this something that I need to change through the jvm? | |
| Jan 3, 2021 at 15:50 | history | edited | Just Me | CC BY-SA 4.0 |
added 344 characters in body
|
| Jan 3, 2021 at 14:05 | comment | added | Just Me |
Thanks! Just to clarify - do you mean I should use set_scheduler with SCHED_BATCH?
|
|
| Jan 3, 2021 at 13:41 | comment | added | ctrl-alt-delor |
Consider the batch scheduler. It runs at a lower priority that the normal scheduler (this won't matter, unless you have a lot running in the normal scheduler), but uses slower pre-preemption ticks. [I have no experience of bench-marking it, hence just a comment.]
|
|
| Jan 3, 2021 at 10:27 | review | First posts | |||
| Jan 3, 2021 at 11:07 | |||||
| Jan 3, 2021 at 10:21 | history | asked | Just Me | CC BY-SA 4.0 |