You can use grep
grep -F -x -f 'File2' -v 'File1'
Pattern of fixed--strings (-F) in File2 (-f)
 Use -x to match whole lines. Otherwise "0123" in File1 would be excluded from the output due to "12" in File2.
find similar line and inverse with (-v)