After completing this and exporting to FBX then importing into Unity, I realized that my door archways had their normals reversed:
I had to go back and select the arches and Mesh->Normals->Flip.
Not sure what I did originally to make this mistake.
To see this in Blender, under Overlays->Normals you can check Display Normals.
Wrong:
Right:
