Head to the top of the still-operational Cape Nelson lighthouse (c 1884) for fantastic views overlooking the edge of the world. You'll be shown around the premises while hearing tales of shipwrecks and the history of area. The Australian film South Solitary, starring Miranda Otto, was shot here. It's 13km southwest from town, a 15-minute drive.
There's also accommodation in the historic lighthouse keeper's cottage.