Why does my pawn stop drifting if I set camera height back to 0?

[devshaww]

Once the camera base height is greater than 0, it starts to drift, but no drifting if I set it to 0.
I’m really curious about it.
Can someone explain this?