Error Message

In the processing job log, the reporting of an incremental processing amount occurs when over 500 documents were processed. The first indication of this processing issue is that no incremental processing count is reported between the "Previous Processed..." and "Completed" log lines in the job log:

06/19/2015 04:01:32   CLEARWELL1 Indexer           Previously Processed 2,169 documents (24.26 MB)
06/19/2015 04:06:25   CLEARWELL1 Indexer           Completed

Compare this with a successful processing job (where over 500 documents were processed):

06/16/2015 15:17:26   CLEARWELL1 Indexer           Previously Processed 1,639 documents (19.56 MB)
06/16/2015 15:18:36   CLEARWELL1 Indexer           Processed 2,169 documents (24.25 MB)
06/16/2015 15:23:35   CLEARWELL1 Indexer           Completed


The main indication of this processing issue are the "WriteFile on admin outPipe failed" errors in PSTCrawler_output.log immediately after the last "CREATE" command:

2015-06-10 15:14:10,375 [7648] INFO crawler.admin null - Creating an admin in-pipe with anonymous access
2015-06-10 15:14:10,375 [7648] INFO crawler.admin null - Creating an admin out-pipe with anonymous access 2015-06-10 15:14:10,375 [7648] INFO crawler.admin null - Admin
InPipe: \\.\pipe\EsaCrawlerAdmin_pst_InPipe Admin OutPipe: \\.\pipe\EsaCrawlerAdmin_pst_OutPipe
2015-06-10 15:14:12,377 [5924] INFO crawler.admin null - Received admin command: CREATE SECvTamas_1689018313252971_SECvTamas__PST9_16890183132529710.2.1.0 PST SECvTamas_1689018313252971_562954248388608 6017
2015-06-10 15:14:12,565 [5924] INFO crawler.admin null - Received admin command: CREATE SECvTamas_1689018313252971_SECvTamas__PST8_16890183132529710.2.1.0 PST SECvTamas_1689018313252971_562954248388608 6017
2015-06-10 15:14:12,726 [5924] INFO crawler.admin null - Received admin command: CREATE SECvTamas_1689018313252971_SECvTamas__PST7_16890183132529710.2.1.0 PST SECvTamas_1689018313252971_562954248388608 6017
2015-06-10 15:14:12,876 [5924] INFO crawler.admin null - Received admin command: CREATE SECvTamas_1689018313252971_SECvTamas__PST6_16890183132529710.2.1.0 PST SECvTamas_1689018313252971_562954248388608 6017
2015-06-10 15:14:13,020 [5924] INFO crawler.admin null - Received admin command: CREATE SECvTamas_1689018313252971_SECvTamas__PST5_16890183132529710.2.1.0 PST SECvTamas_1689018313252971_562954248388608 6017 2
015-06-10 15:14:13,159 [5924] INFO crawler.admin null - Received admin command: CREATE SECvTamas_1689018313252971_SECvTamas__PST4_16890183132529710.2.1.0 PST SECvTamas_1689018313252971_562954248388608 6017
2015-06-10 15:14:13,299 [5924] INFO crawler.admin null - Received admin command: CREATE SECvTamas_1689018313252971_SECvTamas__PST3_16890183132529710.2.1.0 PST SECvTamas_1689018313252971_562954248388608 6017
2015-06-10 15:14:13,438 [5924] INFO crawler.admin null - Received admin command: CREATE SECvTamas_1689018313252971_SECvTamas__PST2_16890183132529710.2.1.0 PST SECvTamas_1689018313252971_562954248388608 6017
2015-06-10 15:14:13,571 [5924] INFO crawler.admin null - Received admin command: CREATE SECvTamas_1689018313252971_SECvTamas__PST1_16890183132529710.2.1.0 PST SECvTamas_1689018313252971_562954248388608 6017
2015-06-10 15:14:15,018 [5924] INFO crawler.admin null - Received admin command: CREATE SECvTamas_1689018313252971_SECvTamas__PST_16890183132529710.2.1.0 PST SECvTamas_1689018313252971_562954248388608 6017
2015-06-10 15:15:08,844 [5924] INFO crawler.admin null - Received admin command: CREATE SECvTamas_1689018313252971_SECvTamas__PST10_16890183132529710.2.1.0 PST SECvTamas_1689018313252971_562954248388608 6017
2015-06-10 15:15:09,132 [5924] INFO crawler.admin null - Received admin command: CREATE SECvTamas_1689018313252971_SECvTamas__PST11_16890183132529710.2.1.0 PST SECvTamas_1689018313252971_562954248388608 6017
2015-06-10 15:15:09,322 [5924] INFO crawler.admin null - Received admin command: CREATE SECvTamas_1689018313252971_SECvTamas__PST12_16890183132529710.2.1.0 PST SECvTamas_1689018313252971_562954248388608 6017
2015-06-10 15:15:09,534 [5924] INFO crawler.admin null - Received admin command: CREATE SECvTamas_1689018313252971_SECvTamas__PST13_16890183132529710.2.1.0 PST SECvTamas_1689018313252971_562954248388608 6017
2015-06-10 15:15:09,961 [5924] INFO crawler.admin null - Received admin command: CREATE SECvTamas_1689018313252971_SECvTamas__PST14_16890183132529710.2.1.0 PST SECvTamas_1689018313252971_562954248388608 6017
2015-06-10 15:26:55,205 [5924] ERROR crawler.admin null - WriteFile on admin outPipe failed
2015-06-10 15:26:55,206 [5924] ERROR crawler.admin null - WriteFile on admin outPipe failed
......
2015-06-10 15:26:55,233 [5924] ERROR crawler.admin null - WriteFile on admin outPipe failed
2015-06-10 15:26:55,233 [5924] INFO crawler.admin null - Pipe broken: Admin client exited.
2015-06-10 15:26:55,233 [5924] INFO crawler.admin null - Stopping Admin manager pipes thread..

Note: A successful processing job will show at least one "SETPROP" command following these "CREATE" commands. 

Metadata is generated by each discovery job. Some of this metadata is residual and is not removed even if the discovery is deleted from the "Manage Sources" page. Over the lifetime of a case this residual data can grow to such a size that it can add a short delay to the processing initialization. In rare instances this delay can affect the synchronization of the various execution threads involved in the processing startup sequence. 

There are currently no plans to address this issue by way of a patch or hotfix in the current or previous versions of the software at the present time. While this issue may be resolved in a future major revision of the software at a later time, it is not currently scheduled for any release.  If you feel this issue has a direct business impact for you and your continued use of the product, please contact your Veritas Sales representative or the Veritas Sales group to discuss these concerns.

Either of the following methods have been found to be successful workarounds for this issue:  

• Set the Clearwell property esa.processing.sources.pst to 2 (the default value is 15).
   
• The user selects fewer sources for re-processing in the "Manage Sources" page.
   

The user selects several existing sources in the Clearwell "Manage Sources" page and re-processes them. Although the "Manage Sources" page indicates there are still documents left to be processed, no new documents are in fact processed. The processing job completes successfully, however the PSTCrawler_output.log file includes multiple occurrences of the error "WriteFile on admin outPipe failed".

ETrack: 3807025