Unable to overwrite a hosted feature layer in ArcGIS Data Pipelines

Description

When attempting to overwrite a hosted feature layer created from a GeoJSON file in ArcGIS Data Pipelines, the following error message is returned:

Error:
Replace sample_incidents_points
The following fields from the input dataset cannot be appended to the selected layer due to a field type mismatch: id, Date_Observed_str, Date_Created_str, and Date_Completed_str.
Message code: ADP_102082

The issue also occurs when using a GeoJSON URL as the input in ArcGIS Data Pipelines. Refer to ArcGIS Data Pipelines: ADP_102082: The following fields from the input dataset cannot be appended to the specified layer due to a field type mismatch: <fields> for more information.

Cause

ArcGIS Data Pipelines interprets date values in a GeoJSON file or GeoJSON URL as String field types when the file is added as a pipeline input. In contrast, when the same GeoJSON file is uploaded as an item in ArcGIS Online, ISO-formatted date strings are automatically converted to a Date Only field type. As a result, overwriting the hosted feature layer using the pipeline output results in a field type mismatch between the String fields from the pipeline and the Date fields in the existing layer.

Solution or Workaround

Note:
ArcGIS Data Pipelines consumes credits when a compute resource is active. Refer to ArcGIS Data Pipelines: Credit consumption for more information.

Delete existing date fields and add new date fields in ArcGIS Online

1. Log in to ArcGIS Online with an organization account.
2. Click Content > My content and select the hosted feature layer shown with a blue check mark. In this example, the layer is sample_incidents2.

3. Click Data > Fields and select the existing date fields with the Timestamp Offset field type. In this example, the fields are Date_Observed_str, Date_Created_str, and Date_Completed_str.

4. Click Delete to delete the selected date fields in Step 3.

5. Click Add field.

6. In the Add field pane, click Dates > Date > Next.

7. In the Date pane, configure the following parameters:
   1. For Field name, input a name for the date field without spaces.
   2. For Display name, input a name for the date field with spaces.
   3. Leave the other parameters unchanged.
   4. Click Add field.

8. Ensure the field is successfully added, as shown by a green check mark. Repeat Steps 5 through 8 to create new date fields.

Use the Create date time tool to overwrite the hosted feature layer in Data Pipelines

1. In ArcGIS Online, click Content > My content and select the data pipeline shown with a blue check mark. In this example, the pipeline is Testing 2.

2. On the Overview tab, click Open in Data Pipelines.

3. On the editor toolbar, click Tools > Create date time. Move the element accordingly. Repeat this step for each date field.

4. On the canvas, click the first Create date time tool element. In this example, it is Create date time obs.

Note:
Configure the parameters of the Create date time tools in sequence, beginning with the tool connected to the inputs.

5. In the Create date time tool pane, configure the following parameters:
   1. Under Fields, for Time field, select the field. In this example, it is Date_Observed_str.

1. 2. Under Fields, for Time format, select the time format. In this example, it is yyyy-MM-dd'T'HH:mm:ssZZ.

1. 3. For Time zone, ensure the default time zone is UTC.

Note:
ArcGIS Online stores date fields in UTC and displays them based on the viewer's local time zone. Therefore, when using the default UTC time zone in Data Pipelines, the displayed date and time in ArcGIS Online may reflect a time zone offset. Refer to ArcGIS Online: Date and time fields in ArcGIS Online for more information.

4. For Output time field name, specify a name with no spaces. In this example, it is Date_Observed.

6. Refer to Step 4 to configure the parameters of the other Create date time tools.
7. On the canvas, click the Replace Feature layer output element. In this example, it is Replace sample_incidents2_points.

8. In the Feature layer pane, leave all parameters at their default values and click Preview to display the new field replacing the existing field in the Table preview.