An interesting note based on the progress of this lecture is that if a new chair is placed on the opposite side of the wall (outside the room) it is still found an and reported as an object with which the grabber could potentially interact.
Did I configure my wall wrong?