BBC Gardener's World star Monty Don has admitted he "won't do any more" as he opens up on his future.