eDiscovery Text View of EML Items is Truncated

book

Article ID: 100014554

calendar_today

Updated On:

Description

Error Message

Text View does not display the full body of the EML file and Metadata Export does not export the full text of the EML file.

In Processing > Exceptions > Message Warnings, there will be informational warnings of "Crawler Truncated."

In Text View scrolling to the end of the document will show the data stopping before the end of the actual document :-

Errors occurred during the processing of this document.  Some of the terms in the document may not have been indexed which means it may not be fully searchable.
 

Cause

By default there is a limit of 1MB for display and text extraction of loose files.

Resolution

To display and extract the full text of a large EML file, it is necessary to increase the value of the esa.crawler.eml.MaxMsgBufSizeBytes property.

Caution must be taken when increasing this property as it will apply to all cases on the appliance, and will adversely affect the performance of processing, production and review tasks. It is recommended that this not be increased for more time than is necessary to perform the appropriate function on the documents.

Process Steps

Set the new property value

  1. Log in to Clearwell eDiscovery as a user with system administrator privileges
  2. Click System
  3. Click Support Features
  4. Select Property Browser  from the Choose a Support Feature
  5. Select System from the Select the case (or system) option
  6. Enter esa.crawler.eml.MaxMsgBufSizeBytes in the Pattern to match option
  7. Click Submit
  8. It will display esa.crawler.eml.MaxMsgBufSizeBytes   = <currentvalue>  if the value has been set previously and is not the default, make a note of the previous value
  9. Remove esa.crawler.eml.MaxMsgBufSizeBytes from Pattern to match
  10. Enter esa.crawler.eml.MaxMsgBufSizeBytes in Name of property to change
  11. Enter 2048000 in New value (leave blank to remove) * This will allow extraction of 2MB of text from all documents
  12. Check the Confirm change. Are you sure? option
  13. Click Submit
  14. The new value of esa.crawler.eml.MaxMsgBufSizeBytes will be displayed


Restart eDiscovery Services

  1. Ensure all users are logged out of Clearwell eDiscovery
  2. Log in to the Clearwell eDiscovery appliance desktop using remote desktop
  3. Start the Clearwell Utility
  4. Stop All Clearwell Services by entering option 3
  5. Once services have stopped, when prompted press any key to display the menu
  6. Start All Clearwell Services by entering option 4
  7. Once services have started, when prompted press any key to display the menu
  8. Quit the Clearwell Utility by entering Q


Run processes requiring the higher setting

  1. Log back in to eDiscovery and perform any processes that require the higher setting eg. Metadata Export with extracted text.


Remove the increased property value

  1. Once the processes are complete Click System > Support Features > Property Browser
  2. Enter esa.crawler.eml.MaxMsgBufSizeBytes in Name of property to change
  3. New value (leave blank to remove) * Leave this blank as this will return it to the default value.
  4. Check the Confirm change. Are you sure? option
  5. Click Submit
  6. The display will confirm removal of esa.crawler.eml.MaxMsgBufSizeBytes


Restart Services

  1. Ensure all users are logged out of Clearwell eDiscovery
  2. Log in to the Clearwell eDiscovery appliance desktop using remote desktop
  3. Start the Clearwell Utility
  4. Stop All Clearwell Services by entering option 3
  5. Once services have stopped, when prompted press any key to display the menu
  6. Start All Clearwell Services by entering option 4
  7. Once services have started, when prompted press any key to display the menu
  8. Quit the Clearwell Utility by entering Q
 

 

Issue/Introduction

When reviewing items in Text View using eDiscovery, large EML files are, by default, truncated at 1,024,000 bytes. (1MB) , this is also the limit set for the amount of extracted text that will be exported in a Metadata Export.