For anyone who dragged the Sprite Sheet into the Tile Palette only to see nothing happen, this appears to be a known bug in certain versions of 2017 and 2018:
https://forum.unity.com/threads/tile-palette.529314/
This was using Unity 2018.1.1f1. Reverting to 2017.4.4f1 fixed it.