I think you can do this with the -C option.
From the tar man page:
-C directory, --cd directory, --directory directory
In c and r mode, this changes the directory before adding the following files.
In x mode, change directories after opening the archive but before extracting
entries from the archive.
This means that you should be able to run
tar cvzf result.tar.gz -C dir1/ * -C dir2/ *
tar cvzf result.tar.gz -C /path/to/dir1/ . -C /path/to/dir2/ .
to achieve what you want.