Unable to create Parquet multifile feature connection in ArcGIS Pro

Description

In ArcGIS Pro, a warning message is returned when a multifile feature connection of a Parquet file is created with nanosecond precision timestamps.

WARNING 120284: Succeeded (0)
Failed (1)
- <folder_name>

Cause

Parquet files with nanosecond precision timestamps are not supported in the GeoAnalytics Desktop tool. The tool only supports timestamps up to milliseconds. As a result, the Parquet file datasets with nanosecond timestamps go undetected and the warning is returned.

Solution or Workaround

Pre-requisites before attempting the workaround (for a successful multifile feature connection):
• Prepare the ArcGIS Pro Python cloned environment.
• Install and verify the required packages for Python, which include pandas, PyArrows, and fastparquets, in the Python shell (REPL) in the Python command prompt.

1. Convert the existing Parquet file with nanosecond timestamp to a new Parquet file with a millisecond timestamp.
   1. Click the Start icon.
   2. Search and double click the Python Command Prompt.
   3. In the command prompt, type python and click Enter.
   4. Copy the following codes and paste them in the command prompt.

   import pandas as pd
   # Path to the source Parquet file
   path = r"C:<parquet_file_path>"
   # Load the Parquet file into a Pandas DataFrame
   df = pd.read_parquet(path)
   # Convert nanosecond precision field to string with millisecond precision
   df['date_new'] = pd.to_datetime(df['<field_name>'], unit='ns').dt.floor('ms').dt.strftime('%Y-%m-%d %H:%M:%S.%f').str[:-3
   # Remove the original nanosecond precision field
   df.drop('<field_name>', axis=1, inplace=True)
   # Save the updated DataFrame as a new Parquet file
   output = r"C:\data\updated_file.parquet"
   df.to_parquet(output, index=False)
   

2. Press Enter and ensure no error message is returned in the command prompt. Exit the command prompt by typing the exit code below.

   exit()

3. Re-establish the multifile feature connection of the updated Parquet file.
   1. Open the ArcGIS Pro project.
   2. On the Analysis ribbon, in the Geoprocessing group, click Tools.
   3. In the Geoprocessing pane, search for and select Create Multifile Feature Connection.
   4. On the Parameters tab, for Multifile Feature Connection Output Location, browse to the output storage folder in File Explorer and select the folder.
   5. Specify a folder name for Output Multifile Feature Connection Output Name.
   6. For Data Source Folder, browse to the data folder in File Explorer and click the source folder.
   7. Check both the Visible Geometry Fields and Visible Time Fields checkboxes.
      
4. Click Run. The image below shows the message returned in the GeoAnalytics Desktop Tools history.
   
5. Add the folder containing the parquet file with millisecond timestamp to the project. Refer to ArcGIS Pro: Connect to an existing folder for more information.
6. In the Catalog pane, expand the output folder and right-click the multifile point feature class. Click Properties.
   1. On the Geometry tab, for GeometryType, select Point.
   2. For Geometry Format Type, select XYZ.
   3. Under Geometry Fields, select x for the X Field, y for the Y Field, and leave the Z field blank.
   4. For Spatial Reference, select WGS 1984 Coordinate System.
   5. Click OK.
      
7. In the Catalog pane, right-click the multifile point feature class and click Add to Current Map.
   
   The map below shows the points properly displayed based on the X/Y coordinates provided in the Parquet file.