ArcMap allows you to set a selection tolerance in the Selection Options dialog. The tolerance is in pixels and affects the Identify tool as well as the Selection tools.
When identifying WMS layer features, setting a selection tolerance has no effect.
ArcMap cannot set a tolerance for WMS services. This is set by the WMS server.