Gabriel Hostel offers spotless dorms in a quiet location 1km south of the Black Church. Eponymous owner Gabriel offers myriad day trips (plus the odd shot of homemade plum brandy) and is a qualified guide.
Take bus 51 from the train station to the last stop; the door is just across the street.