The landlord of the Fox & Hounds has defended his decision to give up his pub, saying "trade is so bad".