If baking time is taking a very long time, did we mess up, I mean like 5hrs type long
That does seem rather a long time. My guess would be if it still does complete then there is nothing wrong it is just the computer capacity related to the model complexity.
Blender Cycles renders can be bound by time or samples!
Render times exploding in Cycles because:
- Too many samples (> 1024) -go lower and use the denoiser option.
- Mesh data (vertices count) too high
- High mesh density, due to subdivision modifier.
Check the memory usage of your hardware.
If Blender is asking for too much memory then your OS is going to swap memory to disk which makes your machine terribly slow.