Can Upper Depot fit into a train weekend?

Yes. That’s actually one of the easier ways to do it. Walk around town first, then stop in later in the day for a beer and a slower hour or two.