Patches and updates

ArcGIS Data Store Data Integrity Patch

Published: October 17, 2017

Summary

The ArcGIS Data Store Data Integrity Patch for 10.4.1, 10.5 and 10.5.1 improves general reliability and availability for relational and spatiotemporal big data stores. It repairs and installs preventive measures to stop the corruption of files within the local data store configuration in situations where the drive that ArcGIS Data Store was installed on runs out of disk space. Moreover, this patch helps prevent data loss when recovering a spatiotemporal big data store.

Description

Esri® announces the ArcGIS Data Store Data Integrity Patch. This 10.4.1, 10.5 and 10.5.1 patch addresses reliability and availability issues with the relational and spatiotemporal big data stores. This patch deals specifically with the issues listed below under Issues Addressed with this patch.

 

Issues Addressed with this patch

 

  • BUG-000106018 - Command utility removemachine should provide an option to remove a machine that is offline.
  • BUG-000101853 - Improve reliability of the ArcGIS Data Store configuration across spatiotemporal data store machines.
  • BUG-000105166 - When the drive that ArcGIS Data Store is installed on runs out of disk space, a configuration file can get corrupted and cause backups to fail.
  • ENH-000108158 - Expand the configuredatastore utility to allow administrators to repair the ArcGIS Data Store local configuration.
  • ENH-000108159 - Improve integrity of the spatiotemporal big data store upon upgrade.
  • ENH-000108160 - ArcGIS Data Store should monitor available disk space and set to Read Only mode if below a threshold value.


To avoid conflicts the ArcGIS Data Store 10.5 version also includes:

  • BUG-000100871 - ArcGIS Data Store configuration fails on Microsoft Azure upon configuration of additional store types.

 

Installing this patch on Windows

 

Instructions for spatiotemporal big data store machines:

 

ArcGIS Data Store 10.5.1, 10.5, or 10.4.1 must be installed before installing this patch.

  1. Download the appropriate file to a location other than your ArcGIS installation location.
        Checksum (Md5)
         
         ArcGIS Data Store 10.5.1 ArcGIS-1051-DS-DI-Patch.msp 790ABB9D66CBB667CCF5A6BAA8C89682
         
         ArcGIS Data Store 10.5 ArcGIS-105-DS-DI-Patch.exe 926E7489258E7C42CC2D149C0C1F40BC
         
         ArcGIS Data Store 10.4.1 ArcGIS-1041-DS-DI-Patch.exe 4FB1B4879FB69069F7A050D140ABF387
         
  2. Make sure you have write access to your ArcGIS installation location.
  3. Stop all GeoEvent services from the GeoEvent Manager before applying the patch.
  4. Stop ArcGIS Data Store service on all of the spatiotemporal big data store machines.
  5. Apply the patch on each spatiotemporal big data store machine.
  6. Double-click ArcGIS-<Version>-DS-DI-Patch.msp/exe to start the setup process. Note: This will stop the ArcGIS Data Store service and restart it after the installation has completed.

    NOTE: If double clicking on the MSP file does not start the setup installation, you can start the setup installation manually by using the following command:
    msiexec.exe /p [location of Patch]\ArcGIS-<Version>-DS-DI-Patch.msp/exe

  7. Log in to the hosting server from the ArcGIS Server Administrator Directory and run the Validate operation for one of the spatiotemporal big data store machines.

    Wait until the validate response shows zero pending tasks ("numOfPendingTasks": 0) before proceeding past this step .This could take a couple of hours depending on the size of the data. For example:

    "https://localhost:6443/arcgis/admin/data/items/nosqlDatabases/AGSDataStore_bigdata_bds_xyz/machines/localhost/validate"

    {
    "datastore.name": "bds_xyz",
    "clusterStatus": "YELLOW",
    "datastore.overallhealth": "Healthy",
    "isHealthy": true,
    "numOfNodes": 1,
    "numOfPendingTasks": 0,
    "activeShards": 1,
    "activePrimaryShards": 1,
    "relocatingShards": 0,
    "initializingShards": 0,
    "unassigned_shards": 1,
    "nodes": [{
    "name": "10.49.52.134",
    "heapSize": "2.2gb"
    }]
    }


  8. Log in to one of the spatiotemporal big data store machines as a Windows administrator, and open a command prompt as an administrator.
  9. Change directories to the ArcGIS Data Store tools directory typically found in this location:
    c:\program files\arcgis\datastore\tools

  10. Open a command prompt as an administrator and run the configuredatastore utility and include '--operation repair'. You only need to run the configuredatastore utility on one of the spatiotemporal big data store machines as this will get applied to all of the configured spatiotemporal big data store machines.
    configuredatastore.bat <serverURL> <serverAdmin> <serverAdminPassword>
    <directory> --stores spatiotemporal --operation repair

Instructions for relational data store machines:

  1. Download the patch to each relational data store machine.
  2. Apply the patch to the primary and standby data store machines.
  3. Log in to the primary relational data store machine as an administrator and open a command prompt as an administrator.
  4. Change directories to the ArcGIS Data Store tools directory typically found in this location:
    c:\program files\arcgis\datastore\tools

  5. Run the configuredatastore utility and specify '--operation repair'. There is no need to run this on the standby relational data store.
    configuredatastore.bat <serverURL> <serverAdmin> <serverAdminPassword>
    <directory> --stores relational --operation repair

 

Installing this patch on Linux

 

Instructions for spatiotemporal big data store machines:

 

Complete the following install steps as the ArcGIS Install owner. The Install owner is the owner of the arcgis folder.

ArcGIS Data Store 10.5.1, 10.5, or 10.4.1 must be installed before installing this patch.

  1. Download the patch to each spatiotemporal big data store machine.
        Checksum (Md5)
         
         ArcGIS Data Store 10.5.1 ArcGIS-1051-DS-DI-Patch-linux.tar 19D409D6BDD58E2BC79E7E962B68ABD1
         
         ArcGIS Data Store 10.5 ArcGIS-105-DS-DI-Patch-linux.tar EBBFE564F38AB1559FB4D33600053540
         
         ArcGIS Data Store 10.4.1 ArcGIS-1041-DS-DI-Patch-linux.tar D8D5A0477E3C660F4F921EA388CD7C84
         
  2. Make sure you have write access to your ArcGIS installation location, and that no one is using ArcGIS.
  3. Stop all GeoEvent services from the GeoEvent Manager before applying the patch.
  4. Stop ArcGIS Data Store service on all of the spatiotemporal big data store machines.
  5. Extract the specified tar file by typing:
    % tar -xvf ArcGIS-<Version>-DS-DI-Patch-lx.tar

  6. Start the installation typing ./applypatch as shown below. Note: This should stop the ArcGIS Data Store service and restart it after the installation has completed. However, at the end of the installation manually check if the service is started and if not start the service by typing ./startdatastore.sh.
    % ./applypatch

    This will start the dialog for the menu-driven installation procedure. Default selections are noted in parentheses ( ). To quit the installation procedure, type 'q' at any time.
  7. Log in to the hosting server from the ArcGIS Server Administrator Directory and run the Validate operation for one of the spatiotemporal big data store machines.

    Wait until the validate response shows zero pending tasks ("numOfPendingTasks": 0) before proceeding past this step .This could take a couple of hours depending on the size of the data. For example:

    "https://localhost:6443/arcgis/admin/data/items/nosqlDatabases/AGSDataStore_bigdata_bds_xyz/machines/localhost/validate"

    {
    "datastore.name": "bds_xyz",
    "clusterStatus": "YELLOW",
    "datastore.overallhealth": "Healthy",
    "isHealthy": true,
    "numOfNodes": 1,
    "numOfPendingTasks": 0,
    "activeShards": 1,
    "activePrimaryShards": 1,
    "relocatingShards": 0,
    "initializingShards": 0,
    "unassigned_shards": 1,
    "nodes": [{
    "name": "10.49.52.134",
    "heapSize": "2.2gb"
    }]
    }
  8. Log in to one of the spatiotemporal big data store machines as the owner of the arcgis folder.
  9. Change directories to the ArcGIS Data Store tools directory typically found in this location:
    /home/username/arcgis/datastore/tools
  10. Open a command prompt as an administrator and run the configuredatastore utility and include '- -operation repair'. You only need to run the configuredatastore utility on one of the spatiotemporal big data store machines as this will get applied to all of the configured spatiotemporal big data store machines.
    ./configuredatastore.sh <serverUR > <serverAdmin> <serverAdminPassword>
    <directory> --stores spatiotemporal ––operation repair

Instructions for relational data store machines:

  1. Download the patch to each relational data store machine.
  2. Apply the patch to the primary and standby data store machines.
  3. Log in to the primary relational data store machine as as the owner of the arcgis folder.
  4. Change directories to the ArcGIS Data Store tools directory typically found in this location:
    /home/username/arcgis/datastore/tools

  5. Run the configuredatastore utility and specify '--operation repair'. There is no need to run this on the standby relational data store.
    ./configuredatastore.sh <serverUR > <serverAdmin> <serverAdminPassword>
    <directory> --stores relational --operation repair

Patch Updates

Check the Patches and Service Packs page periodically for the availability of additional patches. New information about this patch will be posted here.

How to identify which ArcGIS products are installed

To determine which ArcGIS products are installed, choose the appropriate version of the PatchFinder utility for your environment and run it from your local machine. PatchFinder will list all products, hot fixes, and patches installed on your local machine.

Getting Help

Domestic sites, please contact Esri Technical Support at 1-888-377-4575, if you have any difficulty installing this patch. International sites, please contact your local Esri software distributor.


Download ID:7544

Get help from ArcGIS experts

Contact technical support

Download the Esri Support App

Go to download options