Replying to myself since I got it working. The essential part at the top which assigned Input Mapping Context was missing. The Action itself looks pretty much like in the lesson.
You also might need Input Actions one to move forward/backwards and another one to move sideways.

The other essential part is Input Mapping Context which is mapping actions to keyboard events.

