In addition to what @ChibelD wrote about the rotation, also remove the object from the “Look At” field in the CinemachineVirtualCamera component. That field affects the rotation of the camera. We do not want to rotate the camera around the x- or y- axis.
If the issue persists, please rewatch lecture “Cinemachine Follow Camera” to see if there is another difference between your project and Rick’s.