Apple iWork attachments cause EVConverterSandbox to leak memory and eventually cause EV Server to crash/hang.

book

Article ID: 100064324

calendar_today

Updated On:

Description

Error Message

Log Name:      System
Source:        Microsoft-Windows-Resource-Exhaustion-Detector
Event ID:      2004
Task Category: Resource Exhaustion Diagnosis Events
Level:         Warning
Keywords:      Events related to exhaustion of system commit limit (virtual memory).
User:          SYSTEM
Computer:      evserver01.evlab.local
Description:
Windows successfully diagnosed a low virtual memory condition. The following programs consumed the most virtual memory: EVConverterSandbox.exe (36348) consumed 196106526720 bytes, java.exe (33608) consumed 9754206208 bytes, and DTrace.exe (33192) consumed 4171091968 bytes.

 

DTrace:
15377252    18:48:25.893     [4028]    (StorageCrawler)    <28080>    EV:L    {CMimeBodyPartImpl::GetDecodedContentStream} Content-type [application/x-iwork-numbers-sffnumbers], charset [(null)]. Is text type [False]. BodyPart Id [5114A3787F489B937B76F51C366EF0A1/M.2]
15377270    18:48:25.893     [4028]    (StorageCrawler)    <28080>    EV:H    {CContentConverter::ConvertAndAddToItem} Invoking conversion. Mode [0], Subject [Email with iWork file attachment], File type [numbers]
15377405    18:48:25.925     [29348]    (EVConverterSandbox)    <20956>    EV:M    {CINSOConverter::TryExternalConverter} File Id [FI_? (1391)] Sniffed file type [Not found]. Source file type [numbers]
15377406    18:48:25.925     [29348]    (EVConverterSandbox)    <20956>    EV:H    {CINSOConverter::MapExternalConverterResultToInsoStatus} Conversion failed. Reason [(null)] Result [0xc0040602] ==> Status [Operation not supported (16777220)]

 

17053283    18:48:55.948     [29348]    (EVConverterSandbox)    <29224>    EV:L    {CCvtSandboxStub::PulseHeartbeat} (Entry)
17053286    18:48:55.948     [29348]    (EVConverterSandbox)    <29224>    EV:L    {CCvtSandboxStub::PulseHeartbeat} (Exit) Status: [Success]
.
.
23755790    18:52:26.073     [29348]    (EVConverterSandbox)    <29224>    EV:L    {CCvtSandboxStub::PulseHeartbeat} (Entry)
23755791    18:52:26.073     [29348]    (EVConverterSandbox)    <29224>    EV:L    {CCvtSandboxStub::PulseHeartbeat} (Exit) Status: [Success]

 

Cause

Enterprise Vault uses Oracle Outside-In Converter to convert different file types to HTML or Text at the time of archiving or indexing (if conversion fails during archiving). 

Oracle Outside-In does not have support for Apple iWork processing, except in File Identification. It has been identified that Oracle Outside-In is causing a memory leak while processing Apple iWork files which had been reported to Oracle Support.

Resolution

Oracle has released a fix for this issue (Bug 35625039) in their January release and will avoid the memory leak:

https://updates.oracle.com/Orion/Services/download?type=readme&aru=25525641

This will be included in EV 14.5.2 and 15.0. EVConverterSandbox should be able to handle these files without causing the issue as of these releases.

As a workaround, these file types can be excluded from the Conversion settings available at site level.(Site Settings > Advanced > Content Conversion > File types excluded from conversion)

 

Issue/Introduction

Apple iWork attachments, such as .numbers or .pages, cause the EVConverterSandbox process to leak memory and eventually cause the Enterprise Vault (EV) Server to crash/hang

Additional Information

JIRA: CFT-5593