I have a similar problem with my mirror, but the problem appears to only happen, when the car has been sitting under direct sunlight, for a while, and then heats up. At that point, the mirror is very wobbly, but, as I drive, and the car cools down, the mirror retains its solid stature.
Sucks because the dealer claims that they cannot replicate the problem. And, by the time I drive over to them, the mirror seems to fix itself.
Does anyone else experience this?