I didn’t tested the game by putting the physics material on the collider but I don’t think the problem is solved by putting it on the collider.
Anyway I played your game again yesterday and I found a second bug which is this one
As you can see the ball isn’t in the game and what happened is this. I was trying to catch the ball in the bottom right of the screen when the ball passed it but when it’s passed it seems that it didn’t touched the Lose collider and I was stuck.