For those using more-recent versions of the Unity Editor, in addition to downloading the “Starter Assets - First Person Character Controller” for your render pipeline, you’ll also need to import the “AI Navigation” package from Unity Technologies. This provides the NavMeshAgent, etc.
Hopefully this will save someone a little time.