I agree with the answer by @Stefan Wyss -- reality is imperfect, and via exits will not be your biggest problem.
What is your alternative to a 90 degree exit? Are you planning to make the via physically resemble an hourglass instead of a tube? That could work if you're doing a giant-scale model. It also sort of describes some microvias, if you're willing to pay for that.
My first recommendation is to figure out how large a feature has to be before it matters to your actual rise and fall times; you may well decide that you don't have to worry after all.
For sufficiently high speed, the recommendation is to avoid vias. If you can't do that, minimize them (have fewer). Try to avoid stubs, which might mean back-drilling (or controlled-depth drilling) if you aren't going all the way from top to bottom or using blind/buried vias. Make sure the return current has its own via nearby, if that will also be switching layers. (Some designs use multiple ground vias.) There are materials with tighter tolerances. Maybe even consider impedance matching when sizing your vias.
If you're being very careful, use a 3D simulator and try to keep the impedance through the via the same as it is in the traces. This won't be modelled as well as you hope, in part because the capacitance will change when you're passing a plane vs dielectric.
But honestly? How sure are you about, for example, the uniformity of thickness of your via walls? The exact drill registration? (Fabs like Sierra Circuits talk about recalibrating to account for differential shrinkage across the same panel.) Are you worrying about effects that will be swamped by manufacturing tolerances?