Weblogic server reports target has encountered metric evaluation errors in grid
Problem
The WLS targets report having metric evaluation errors and the agent log files are full of errors (and filling up rapidly)
Diagnosis
- Check the logfiles:
In the \$AGENT_HOME/sysman/log directory, check the file: emagent.trc
If you see this repeated 1000's of times, we can fix it!
2011-12-01 19:02:39,306 Thread-5888 ERROR engine: [[j2ee_application,/secFarm_GCDomain/GCDomain/EMGC_OMS1/OCMRepeater,Response_internal]] : nmeegd_GetMetricData failed : Java Virtual Machine context could not be obtained.
2011-12-01 19:02:39,306 Thread-5888 ERROR engine: [[/secFarm_GCDomain/GCDomain/EMGC_OMS1/OCMRepeater,j2ee_application]] Failure in step [[0]] : Response_internal. Java Virtual Machine context could not be obtained.. Stopping execution
2011-12-01 19:02:39,306 Thread-5888 ERROR engine: [[/secFarm_GCDomain/GCDomain/EMGC_OMS1/OCMRepeater,j2ee_application]] : Response : nmeeam_GetMetricData failed
2011-12-01 19:02:39,306 Thread-5888 ERROR engine: [[j2ee_application,/secFarm_GCDomain/GCDomain/EMGC_OMS1/OCMRepeater,Response]] : nmeegd_GetMetricData failed : Java Virtual Machine context could not be obtained.
2011-12-01 19:02:39,306 Thread-5888 WARN collector: <nmecmc.c> Error exit. Error message: Java Virtual Machine context could not be obtained.
2011-12-01 19:03:29,395 Thread-3896 ERROR engine: [[/secFarm_GCDomain/GCDomain/EMGC_OMS1,weblogic_j2eeserver]] Response : Can't get query or execution descriptor
2011-12-01 19:03:29,395 Thread-3896 ERROR engine: [[weblogic_j2eeserver,/secFarm_GCDomain/GCDomain/EMGC_OMS1,Response]] : nmeegd_GetMetricData failed : Can't get query descriptor or execution descriptor
2011-12-01 19:03:29,395 Thread-3896 WARN collector: <nmecmc.c> Error exit. Error message: Can't get query descriptor or execution descriptor
2011-12-01 19:03:32,396 Thread-3632 ERROR utl: (nmeurm.c,313):Memory 0x0 encountered, expect struct_id=10023
2011-12-01 19:03:32,396 Thread-3632 ERROR fetchlets: No JVM context
Solution
- Backup emd.properties in \$AGENT_HOME/sysman/config
- Stop the agent:
cd $AGENT_HOME/bin
./emctl stop agent
- Edit emd.properties to add these memory attributes to the agentJavaDefines line:
agentJavaDefines=-Xms256m -Xmx512m ...rest of original line
- Restart the agent:
./emctl start agent
- Force an upload to the Grid:
./emctl upload agent
Go back to the Grid homepage and admire more green!