I am using Windows 10 on a PC and browsing with Chrome (version 52)
Edit
Did you check for Flash? I just tested mine using the URL in your error message and got confirmation with Chrome it comes pre-installed.
I think Udemy attempt to use HTML5 video playback support initially, and if that fails fall back to Flash support.
Additionally, Udemy have a support page for Video Playback Issues, one of the items I know that has helped a lot of people is clearing the browser cache (temp files/cookies etc)