Data Interoperability 2022.0 and above fails if Python switches Character Encoding from UTF-8 to windows-1252

Description

When using ArcGIS Data Interoperability and FME version 2022.2.1.0 and above, in some cases character encoding is switched from UTF-8 to windows-1252.  If this occurs, the Data Interoperability or FME process fails. The following is an example of text from a LOG file indicating the problem.

OS Locale Name     : en_AU
OS Locale Encoding : windows-1252
Process Encoding   : UTF-8
C:\Users\<user_nam>\AppData\Local\Safe Software\Interoperability\logs
C:\Users\<user_name>\AppData\Roaming\ESRI\Interoperability\logs

The AppData folder noted in the log file is a hidden folder.  It may be necessary to display hidden folders in Windows.

Cause

The cause is due to a change in the way that FME processes workspaces for most string data. This is a known issue, described in a technical article from Safe Software. The article includes a tested, effective workaround.

Solution or Workaround

See the article from Safe Software in the Related Information section.