The files that you list as Only in ... are all located in the target directory. What this means is that these were there before you ran the rsync command.
If you want to remove those files from the target directory, you may run the rsync command with its --delete option. Doing so would delete all files in the target directory hierarchy not present in the source directory hierarchy.
Consider testing this on a copy of the data first, and always take frequent backups.