It’s the setting in the image texture node of the low poly material. Changing it from non-color to sRGB actually changes the outcome of the bake.
true, these are just numbers.
But RGB is ranged from red 0…255, green 0…255, and blue 0…255 integers.
While non-color is more or less a vector with a high dynamic range 0…1.