Unable to fetch backlog statistics from node id : <Node ID> reported for Data Insight

book

Article ID: 100054170

calendar_today

Updated On:

Description

Error Message

Following errors can be captured by the watchdog.log

WARNING: #{15} [SyncPerformanceStatsJob.execute] Unable to fetch backlog statistics from node id : | name : | 8282 | 8383 | false | false | true
javax.net.ssl.SSLHandshakeException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target

WARNING: #{15} [NodeInfoUtils.queryDb] Error parsing db query resultset protobuf byte array
javax.net.ssl.SSLHandshakeException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target

WARNING: #{16} [SystemMonitorJob.isVersionSame] Error occured while getting config db version from node
WARNING: #{16} [SystemMonitorJob.compareConfigVersions] There was some issue while communicating DataInsightComm service on node 

NOTE: When this occurs, all nodes including the Management Server will be in a Down State.

Cause

The issue occurs due to an error in the RegenerateCommdCertsJob while regenerating Commd certificates. 

INFO:    #{16} [RegenerateCommdCertsJob.execute] Starting RegenerateCommdCertsJob
WARNING: #{16} [RegenerateCommdCertsJob.execute] Error in regenerating Commd Certs

WARNING: #{16} [RegenerateCommdCertsJob.uploadFileToNode] Error uploading file to node  Status received: 500
WARNING: #{16} [RegenerateCommdCertsJob.uploadFileToNode] Error uploading file commd_renew.keystore

Resolution

When a RegenerateCommdCertsJob fails, it creates two additional keys as commd_renew.keystore and webserver_renew.keystore in the DataInsight \keys folder.

To resolve this issue:

1) Rename the current \keys\commd.keystore to commd.keystore.xxx

2) Rename the \keys\commd_renew.keystore to commd.keystore

3) Restart DataInsightCommd Service.

Issue/Introduction

There may be instances when the entire Data Insight environment may report an error: Unable to fetch backlog statistics from node id : <Node ID>