In my case if I fire and move in the same time, it pushes me upwards. I’ve found out that the projectile is spawning at the player’s location, they collide and it pushes me upwards.
For anyone who is having the same issues you can go the the Projectile’s BP, in the details → Collision → Collision Presets and select Custom and from there you want to check to ignore the Pawn.
Now it collides with everything except the Player.