Sir Walter is asking for the ridiculous - that people can stay in his home but not be allowed in the grounds. Mr Shepherd is very diplomatically stating that there is a standard set of usage for tenants (kinda like tenants rights).