eDiscovery Text View of EML Items is Truncated
book
Article ID: 100014554
calendar_today
Updated On:
Description
Error Message
Text View does not display the full body of the EML file and Metadata Export does not export the full text of the EML file.
In Processing > Exceptions > Message Warnings, there will be informational warnings of "Crawler Truncated."

In Text View scrolling to the end of the document will show the data stopping before the end of the actual document :-
Errors occurred during the processing of this document. Some of the terms in the document may not have been indexed which means it may not be fully searchable.

Cause
By default there is a limit of 1MB for display and text extraction of loose files.
Resolution
To display and extract the full text of a large EML file, it is necessary to increase the value of the esa.crawler.eml.MaxMsgBufSizeBytes property.
Caution must be taken when increasing this property as it will apply to all cases on the appliance, and will adversely affect the performance of processing, production and review tasks. It is recommended that this not be increased for more time than is necessary to perform the appropriate function on the documents.
Process Steps
Set the new property value
- Log in to Clearwell eDiscovery as a user with system administrator privileges
- Click System
- Click Support Features
- Select Property Browser from the Choose a Support Feature
- Select System from the Select the case (or system) option
- Enter esa.crawler.eml.MaxMsgBufSizeBytes in the Pattern to match option
- Click Submit
- It will display esa.crawler.eml.MaxMsgBufSizeBytes = <currentvalue> if the value has been set previously and is not the default, make a note of the previous value
- Remove esa.crawler.eml.MaxMsgBufSizeBytes from Pattern to match
- Enter esa.crawler.eml.MaxMsgBufSizeBytes in Name of property to change
- Enter 2048000 in New value (leave blank to remove) * This will allow extraction of 2MB of text from all documents
- Check the Confirm change. Are you sure? option
- Click Submit
- The new value of esa.crawler.eml.MaxMsgBufSizeBytes will be displayed
Restart eDiscovery Services
- Ensure all users are logged out of Clearwell eDiscovery
- Log in to the Clearwell eDiscovery appliance desktop using remote desktop
- Start the Clearwell Utility
- Stop All Clearwell Services by entering option 3
- Once services have stopped, when prompted press any key to display the menu
- Start All Clearwell Services by entering option 4
- Once services have started, when prompted press any key to display the menu
- Quit the Clearwell Utility by entering Q
Run processes requiring the higher setting
- Log back in to eDiscovery and perform any processes that require the higher setting eg. Metadata Export with extracted text.
Remove the increased property value
- Once the processes are complete Click System > Support Features > Property Browser
- Enter esa.crawler.eml.MaxMsgBufSizeBytes in Name of property to change
- New value (leave blank to remove) * Leave this blank as this will return it to the default value.
- Check the Confirm change. Are you sure? option
- Click Submit
- The display will confirm removal of esa.crawler.eml.MaxMsgBufSizeBytes
Restart Services
- Ensure all users are logged out of Clearwell eDiscovery
- Log in to the Clearwell eDiscovery appliance desktop using remote desktop
- Start the Clearwell Utility
- Stop All Clearwell Services by entering option 3
- Once services have stopped, when prompted press any key to display the menu
- Start All Clearwell Services by entering option 4
- Once services have started, when prompted press any key to display the menu
- Quit the Clearwell Utility by entering Q
Issue/Introduction
When reviewing items in Text View using eDiscovery, large EML files are, by default, truncated at 1,024,000 bytes. (1MB) , this is also the limit set for the amount of extracted text that will be exported in a Metadata Export.
Was this article helpful?
thumb_up
Yes
thumb_down
No