I was beating my head against the wall for awhile trying to figure this out: Whenever I did the normal map bake it would just appear as a mesh of light yellow:
Turns out I had accidentally disabled rendering of the collection the high poly object was in:
Enabling the render for the objects and the collection the object is in fixes the problem 
Hope this helps anyone else who runs into this!