Timeline for Replacing sshfs with ssh
Current License: CC BY-SA 3.0
8 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Mar 16, 2012 at 10:13 | comment | added | jofel |
@hhh Then the default 512 byte block size is used. See the man page of dd.
|
|
| Mar 16, 2012 at 9:36 | comment | added | user2362 | ..yes but what about if I do not specify the setting? | |
| Mar 16, 2012 at 9:23 | comment | added | jofel |
No, they do not fail. A pipe is limited queue between programs. On Linux, it has 64k. If the queue is full, the writing program on the one side is automatically blocked until the program on the other side reads data from the pipe. Therefore it make sense to write in blocks which fits into the queue. I've done now some pipe speed measurements. I see no big difference between values between obs=64k and obs=8k. Without any proof, it seems that obs=16k works best for me. But in our case, network or disk speed are the limiting factor, so obs= is not really important if it is not too small.
|
|
| Mar 16, 2012 at 8:15 | comment | added | user2362 | You mean that pipes will fail if you send 50GB with it? How can I see that it fails? | |
| Mar 16, 2012 at 8:12 | history | edited | jofel | CC BY-SA 3.0 |
added 16 characters in body
|
| Mar 16, 2012 at 8:12 | comment | added | jofel |
bs gives the block size for the transfer. AFAIK, the pipe buffer is 64k big. This is the reason for bs=64k. It maybe better to use e.g. ibs=1M as in Patrix answer for fast disk reading and obs=64k for good pipe performance. See (here)[unix.stackexchange.com/a/11954/15241] for more information. You can install programs in Knoppix based LiveCD systems if you have Internet access. Simply: apt-get update and then apt-get install pv.
|
|
| Mar 16, 2012 at 1:25 | comment | added | user2362 |
why bs=64k? Knoppix LiveCD misses the pv. This requires 36 hours at least to run on sparse ntfs -fs.
|
|
| Mar 15, 2012 at 19:27 | history | answered | jofel | CC BY-SA 3.0 |