These converted rorbuer (fishermen's cabins) on the island of Ekkilsøy make an atmospheric spot to sleep. They're rustic, wood-panelled and endearingly old-fashioned; if you want something a bit more recent, there are also cottages to rent. The owners are fishermen themselves, and will gladly arrange fishing trips or supply some fresh for you to cook in your cabin.
There's also space to pitch a tent.