UK man told to demolish 'secret' castle