6

I try to concatenate large files (some GB) in bash. I tried

    cat file1 file2 file3 > result

and it didn't work while 

    cat file1 file2 file3 >> result

worked. In both occasions the file result didn't exist before and my expectation would be, that both commands give the same result.

On the same system I tried the same thing with small files (just some bytes) and both commands produce the same output. I tried to find some explanation (for example here) but couldn't find any...

So, I know how to solve my problem, but I'm still puzzled. Is anyone able to produce a clue?

Improve this question
9
  • 4
    What happened when you run the first command? Commented Jul 15, 2015 at 12:04
  • Are those files all regular files? Commented Jul 15, 2015 at 12:28
  • @lcd047 the individual files are .gz.parts and the result would not let me decompress it it gave an error Commented Jul 15, 2015 at 12:41
  • @Alepac yes no devices or anything virtual, just normal files Commented Jul 15, 2015 at 12:42
  • Are you using this command to write a conatenate file or you redirect through a pipe | to gunzip? Commented Jul 15, 2015 at 12:47

1 Answer 1

Reset to default
1

when I need to split file I use a trick that works very well:

tar --one-file-system -czv /home | split -b 4000m - /media/DRIVENAME/BACKUPNAME.tgz

then, to restore :

cat /media/DRIVENAME/BACKUPNAME.tgz.* | tar -x /

so cat do the job whatever the containt is. So if it doesn't work whether there is a bad production of your splited files, or a limitation with your filesystem. What filesystem are you using ?

Improve this answer
Sign up to request clarification or add additional context in comments.

Comments