You'd be better off going the other direction, i.e. uphill from Wetherspoons, away from the Town Hall. It's a steep hill, but at the top of the steep section (Beast Banks) you'll find the Riflemans Arms on the right, opposite the green. It's only a 5 minute walk from Wetherspoons. Always a warm welcome from Mel & Paul and a decent range of beers.