The antiques expert once jumped at the chance to appear on the BBC show but changed his mind after an uncomfortable encounter ...