I joined my meshes (because I had made them different objects) and then cleaned them up and made them one mesh. I think the sphere at the top needs less edges to match the rest of the pawn so I also cleaned that up.
Lower poly top sphere.
Too detailed top sphere.