Yes you could stay in Geneva or in one of the myriad of Hotels on the ends of the main lakes but Penn Yan is still a big enough place to find plenty to eat and do after a hard day exploring the Wineries, the National/State Parks and the Beaches or just looking at all the property for sale from Cabins to Mansions.
The hotel has the usual Amenities and looks well-kept, pool, hot tub but no Sauna or Steam Room or Games room for the kids. Breakfast is in the main Lobby and included in the rate, hot options are limited but available. Avoid peak times (given in a card in the room) - we went to breakfast and it was quiet, back to the room to grab our gear and by then the lobby was full of people looking for somewhere to sit and eat.
Free Coffee and Cookies all day is a nice touch. There are various places to eat or snack nearby, mostly the likes of Bar/Restaurants and Pizza Hut level, but there is a nice place attached to one of the other hotels at the top end of the Keuka Lake that Penn Yan sits on.
The drive to HammondsPort and the Aviation Museum is lovely. It said the room should have a safe on the web-site our Deluxe King didnt have one, but it did have lots of space, a comfortable sofa and other chairs. less