So whenever I was at the edge of the bounding box of the camera and climbing a ladder while moving towards the platform the camera suddenly snapped as I got off the ladder for some reason, I solved it by setting the Min value for the Climbing camera to 1 like this:
Edit: I recorded a video of the bug, note that my climbing camera only zooms out by 1 compared to the run camera so it’s quite subtle.