Unregister orphaned replicas from the ArcGIS Rest Server Directory > Feature Service if the user confirms that the maps are removed from all devices.
There is currently an enhancement that allows to identify and clean orphaned replicas:
ENH-000094776 : Add ability to identify replicas that have been orphaned by Collector for ArcGIS.