I want to replace a '&' with & 
Except the following occurance of XML special characters. 
"   "
'   '
<   <
>   >
&   &
I tried the method mentioned in Replace specified character between two strings? and Replacing all `&` but not the one in XML entity `&` with `#` with sed in a given XML tag does not seem to work for me.

XY Problem. What are you actually trying to accomplish here?