If you're looking for a little comfort in the wilderness, make a booking at the Beachplum Inn, located on a hill overlooking the Menemsha piers. The common areas are quite nice, while the rooms in the main house are a bit simple. Elsewhere on the property there are several cottages for weekly rentals.
For a more rustic experience check out its sister property, the Menemsha Inn.