I couldn’t get Select Loose Geometry to select anything like Mike had. It turns out I didn’t have Edge and Face enabled (selection mode), only vertex. Since I had extruded only a vertex, which resulted in an edge, it was only attempting to find loose vertices, which I guess there wasn’t one—instead there was a loose edge.
Enabling Edge and trying Select Loose Geometry selected my extrusion.