Open Geospatial Consortium (OGC) services that do not follow the conventional service URL scheme can be added as items to Portal for ArcGIS but cannot be deleted.
This issue is no longer reproducible in currently supported versions of the software. As of ArcGIS Enterprise 10.8.1, the workflow can be succesfully completed, and the service can be deleted via the portal home page.