Read variables in output file & rsync

Question

Could someone perhaps give their advice on this.

I am wanting to take an output file from a mysql query ran:

$code    $IP
123456   192.168.26.176
10051    192.168.20.80
234567   192.168.26.178

and run it in command:

rsync -rvp *.$code.extension root@$IP:/path/of/dest

I am trying this:

while read -r line ; do echo 
"$SOURCE_TRANSMIT_DIR"*."$code".class.json 
"$DEST_HOST"@"$IP":"$DEST_TRANSMIT_DIR" ; done

Output I get is this:

/opt/file/outgoing/*.123456
10051
234567.class.json [email protected]
192.168.20.80
192.168.26.178:/opt/file/incoming/

Where I would like it to read like this in separate rsync commands:

rsync -rvp *.123456.extension [email protected]:/path/of/dest
rsync -rvp *.234567.extension [email protected]:/path/of/dest
rsync -rvp *.345678.extension [email protected]:/path/of/dest

Hopefully this explains better, sorry for the terrible explanation.

Answer 1

I can't see the result of your mysql query but you can execute it and parse with awk to print just what you want (see mysql option to avoid printing tuples and titles -raw or something like this )

mysql -printingoptions "your query" |awk '{print "rsync -rvp *."$1".extension  root@"$2":/path/of/dest"}' 

You can pipe it to sh or bash then (commands |sh) to execute the rsync :)

Seems to be the easiest way to do that for me.

Answer 2

If you run the output from your mysql-query through the following commands, it will give you the desired output. You can use this output to be evaluated, for example pipe it into a file and execute that file as a shell script.

mysql | grep -v '\$' | while read line; do echo "${line}" | sed 's#\(^[0-9]*\)[\ ]*\([0-9\.]*\)#rsync -rvp *.\1.extension root@\2:/path/of/dest#g'; done

Here are the details of the command:

mysql               # Your command with output (this is of course longer than this)
grep -v '\$'        # Exclude the header
while read line; do # Start a while-loop
echo "${line}"      # Echo the contents of the current line that we've read to the next command
# Regular expression to filter the number and the IP and add these to the command, they are held by the variables \1 \2.
sed 's#\(^[0-9]*\)[\ ]*\([0-9\.]*\)#rsync -rvp *.\1.extension root@\2:/path/of/dest#g'
done;               # Close the while loop

And the contents of the regexp explained:

(^[0-9]*\)   # From the beginning (^), zero or more (*) numerical [0-9] character
[\ ]*        # Zero or more (*) spaces. These are not in brackets, so they won't be matched into a variable.
([0-9\.]*    # Zero or more (*) numerical characters or points [0-9\.]