There are differences in rendering of features with custom fonts when ArcMap is used on a physical machine, compared with a remote desktop session usage.
This issue is not reproducible in the current release of the software. Contact ESRI Technical Support (for users in the United States) or ESRI distributor (for users outside the United States) to resolve this issue, if the issue persists.