More than a hundred new homes could be built in the smallest of Herefordshire’s market towns.