Thursday, November 5, 2009

JRockit crash and dump

When JRockit crashes, it produces a .dump file

for more info see:
http://download.oracle.com/docs/cd/E13188_01/jrockit/geninfo/diagnos/dumpfile.html


http://download.oracle.com/docs/cd/E13188_01/jrockit/geninfo/diagnos/crash.html

here is a sample .dump file:


===== BEGIN DUMP =============================================================
JRockit dump produced after 0 days, 23:20:28 on Wed Nov 4 17:13:48 2009

**********************************************************
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
**********************************************************

Additional information is available in:
/acme/serveur/wlsapp/IRISDomain/jrockit.27444.dump
No snapshot file (core dump) will be created because core dumps have been
disabled. To enable core dumping, try "ulimit -c unlimited"
before starting JRockit again.

Error Message: Illegal memory access. [54]
Signal info : si_signo=11, si_code=1 si_addr=(nil)
Version : BEA JRockit(R) R27.6.3-40_o-112056-1.5.0_17-20090318-2103-linux-x86_64
CPU : Intel Core 2 SSE SSE2 SSE3 SSSE3 SSE4.1 Core Intel64
Number CPUs : 8
Tot Phys Mem : 16833388544 (16053 MB)
OS version : Red Hat Enterprise Linux Server release 5.3 (Tikanga)
Linux version 2.6.18-128.el5 (mockbuild@hs20-bc1-7.build.redhat.com) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-44)) #1 SMP Wed Dec 17 11:41:38 EST 2008 (x86_64)
Thread System: NPTL
Java locking : Normal
State : JVM is running
Command Line : -Xms4096m -Xmx4096m -Dweblogic.security.SSL.trustedCAKeyStore=/opt/tuxedo/platform922/weblogic92/server/lib/cacerts -Xverify:none -XgcPrio:throughput -Xverbose:gc,gcreport -XverboseTimeStamp -XverboseLog:/serveur/wlsapp/logs/irisappli1/gc.log -da -Dplatform.home=/opt/tuxedo/platform922/weblogic92 -Dwls.home=/opt/tuxedo/platform922/weblogic92/server -Dwli.home=/opt/tuxedo/platform922/weblogic92/integration -Dweblogic.wsee.bind.suppressDeployErrorMessage=true -Dweblogic.http.descriptor.merge=true -Dlog4j.configuration=log4j.xml -Dweblogic.management.discover=false -Dweblogic.management.server=t3://admmaintiris.acme.dns:8501 -Dwlw.iterativeDev=false -Dwlw.testConsole=false -Dwlw.logErrorsToConsole=false -Dweblogic.Stdout=/serveur/wlsapp/logs/irisappli1/stdout.log -Dweblogic.Stderr=/serveur/wlsapp/logs/irisappli1/stderr.log -Dweblogic.ext.dirs=/opt/tuxedo/platform922/patch_weblogic922/profiles/default/sysext_manifest_classpath -Duser.language=fr -Duser.country=FR -Dacme.config.path=/serveur/wlsapp/IRISDomain/acmeConfig -Dacme.framework.server=true -Dlog4j.debug=true -Dacme.persistence.loginAtStartup=false -Dacme.server.standAlone=false -Dweblogic.Name=irisappli1 -Djava.security.policy=/opt/tuxedo/platform922/weblogic92/server/lib/weblogic.policy -Dsun.java.launcher=SUN_STANDARD weblogic.Server
java.home : /opt/jrmc-3.1.0-1.5.0/jre
j.class.path : :/opt/tuxedo/platform922/patch_weblogic922/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/opt/jrockit/lib/tools.jar:/opt/tuxedo/platform922/weblogic92/server/lib/weblogic_sp.jar:/opt/tuxedo/platform922/weblogic92/server/lib/weblogic.jar:/opt/tuxedo/platform922/weblogic92/server/lib/webservices.jar::/opt/tuxedo/platform922/weblogic92/server/lib/jpd.jar:/opt/tuxedo/platform922/weblogic92/integration/L10N:/opt/tuxedo/platform922/weblogic92/integration/lib/worklist-system-required.jar:/opt/tuxedo/platform922/weblogic92/common/eval/pointbase/lib/pbclient51.jar:/opt/tuxedo/platform922/weblogic92/server/lib/xqrl.jar:/serveur/wlsapp/IRISDomain/acmeConfig::/serveur/wlsapp/IRISDomain/acmeLib/framework.jar:/serveur/wlsapp/IRISDomain/acmeLib/commons-beanutils-1.7.0.jar:/serveur/wlsapp/IRISDomain/acmeLib/toplink.jar:/serveur/wlsapp/IRISDomain/acmeLib/baseInfo.jar:/serveur/wlsapp/IRISDomain/acmeLib/commons-lang-2.1.jar:/serveur/wlsapp/IRISDomain/acmeLib/jmxtools-1.1.jar:/serveur/wlsapp/IRISDomain/acmeLib/wtc-internalCollaborate.jar:/serveur/wlsapp/IRISDomain/acmeLib/commons-logging-1.0.2.jar:/serveur/wlsapp/IRISDomain/acmeLib/commons-pool-1.3.jar:/serveur/wlsapp/IRISDomain/acmeLib/log4j-1.2.14.jar:/serveur/wlsapp/IRISDomain/acmeLib/xmlparserv2.jar:/serveur/wlsapp/IRISDomain/acmeLib/baseInfoXmlBeans.jar:/serveur/wlsapp/IRISDomain/acmeLib/jmxri-1.1.jar:/serveur/wlsapp/IRISDomain/acmeLib/ehcache-1.2.2.jar:/serveur/wlsapp/IRISDomain/acmeLib/baseXmlBeans.jar:/serveur/wlsapp/IRISDomain/acmeLib/externalCollaborateField32.jar:/serveur/wlsapp/IRISDomain/acmeLib/wrapperMgt.jar:/serveur/wlsapp/IRISDomain/acmeLib/commons-digester-1.7.jar:/serveur/wlsapp/IRISDomain/acmeLib/xercesImpl.jar:/serveur/wlsapp/IRISDomain/acmeLib/dbunit-2.2.jar:/serveur/wlsapp/IRISDomain/acmeLib/commons-collections-3.2.jar:/serveur/wlsapp/IRISDomain/acmeLib/xml.jar:/serveur/wlsapp/IRISDomain/acmeLib/base.jar:/serveur/wlsapp/IRISDomain/acmeLib/ojdbc14.jar:/serveur/wlsapp/IRISDomain/acmeLib/castor-1.0.5-xml.jar:/opt/tuxedo/platform922/weblogic92/server/lib/xquery.jar:/opt/tuxedo/platform922/weblogic92/server/lib/binxml.jar:/serveur/wlsapp/IRISDomain/configTemp/:
j.lib.path : /opt/jrmc-3.1.0-1.5.0/jre/lib/amd64/jrockit:/opt/jrmc-3.1.0-1.5.0/jre/lib/amd64:/opt/jrmc-3.1.0-1.5.0/jre/../lib/amd64:/opt/tuxedo/platform922/patch_weblogic922/profiles/default/native:/opt/tuxedo/platform922/patch_weblogic922/profiles/default/native:/opt/tuxedo/platform922/weblogic92/server/native/linux/x86_64:/opt/tuxedo/platform922/weblogic92/server/native/linux/x86_64/oci920_8:/opt/tuxedo/platform922/weblogic92/server/native/linux/x86_64:/opt/tuxedo/platform922/weblogic92/server/native/linux/x86_64/oci920_8
JAVA_HOME : /opt/jrockit
_JAVA_OPTIONS: <not set>
LD_LIBRARY_PATH: /opt/jrmc-3.1.0-1.5.0/jre/lib/amd64/jrockit:/opt/jrmc-3.1.0-1.5.0/jre/lib/amd64:/opt/jrmc-3.1.0-1.5.0/jre/../lib/amd64:/opt/tuxedo/platform922/patch_weblogic922/profiles/default/native:/opt/tuxedo/platform922/patch_weblogic922/profiles/default/native:/opt/tuxedo/platform922/weblogic92/server/native/linux/x86_64:/opt/tuxedo/platform922/weblogic92/server/native/linux/x86_64/oci920_8:/opt/tuxedo/platform922/weblogic92/server/native/linux/x86_64:/opt/tuxedo/platform922/weblogic92/server/native/linux/x86_64/oci920_8
LD_ASSUME_KERNEL: <not set>
Method : com/acme/corp/request/RequestCtrlImpl.modifyRequest(Lcom/acme/x2002/bdt/RqtUpdtBDTDocument;)Lcom/acme/x2002/bdt/RqtBDTDocument;
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 0 OutOfMemoryErrors have occured
C Heap : Good; no memory allocations have failed
GC Strategy : Mode: throughput. Currently using strategy: genparpar
GC Status : OC is not running. Last finished OC was OC#393.
: YC is not running. Last finished YC was YC#84.
OC History : Strategy genparpar was used for OC#125.
: Strategy singleparpar was used for OC#126 to OC#127.
: Strategy genparpar was used for OC#128.
: Strategy singleparpar was used for OC#129.
: Strategy genparpar was used for OC#130 to OC#393.
YC History : Ran 3 YCs before OC#389.
: Ran 1 YCs before OC#390.
: Ran 2 YCs before OC#391.
: Ran 2 YCs before OC#392.
: Ran 3 YCs before OC#393.
: Ran 2 YCs since last OC.
YC Promotion : Last YC successfully promoted all objects
Heap : 0x2ad688312000 - 0x2ad788312000 (Size: 4096 MB)
Compaction : 0x2ad6c8312000 - 0x2ad6d8312000 (Current compaction type: external)
NurseryList : 0x2ad6c7eafa98 - 0x2ad752410450
KeepArea : 0x2ad70f0e22d0 - 0x2ad752410450
NurseryMarker: [ 0x2ad6f7450178, 0x2ad70f0e22d0 ]
CompRefs : References are uncompressed 64-bit.

Registers (from ThreadContext: 0x41aaa3b0 / OS context: 0x41aaa470):
rax = 00002ad68806f091 rcx = 0000000000000000
rdx = 00002ad6880d1fac rbx = 0000000000000000
rsp = 0000000041aaa8b0 rbp = 0000000041aaa8f0
rsi = 000000002000002f rdi = 0000000000000000
r8 = 0000000000000000 r9 = 0000000041aaa8c4
r10 = 0000000000000000 r11 = 00002aaaaeb0dbc8
r12 = 0000000041aaabb0 r13 = 00002aaaafcb8f70
r14 = 0000000000000001 r15 = 00002aaac50cb408
cs = 0000000000000033 fs = 0000000400000000
gs = 0004000000000000
rip = 00002ad68806f091 flags = 0000000000000213

Loaded modules:
(* denotes the module causing the exception)
0000000000400000-00000000004119eb /opt/jrmc-3.1.0-1.5.0/bin/java
0000003def800000-0000003def815507 /lib64/libpthread.so.0
0000003a6aa00000-0000003a6aa8122f /lib64/libm.so.6
0000003def000000-0000003def001f93 /lib64/libdl.so.2
0000003deec00000-0000003deed4b937 /lib64/libc.so.6
0000003dee800000-0000003dee81b99f /lib64/ld-linux-x86-64.so.2
00002ad687eae000-00002ad6880de56f */opt/jrmc-3.1.0-1.5.0/jre/lib/amd64/jrockit/libjvm.so
0000003df0800000-0000003df0806e8b /lib64/librt.so.1
00002ad79131d000-00002ad79132664b /lib64/libnss_files.so.2
00002ad791587000-00002ad791593467 /opt/jrmc-3.1.0-1.5.0/jre/lib/amd64/libverify.so
00002ad791696000-00002ad7916b921b /opt/jrmc-3.1.0-1.5.0/jre/lib/amd64/libjava.so
0000003df2800000-0000003df28140c7 /lib64/libnsl.so.1
00002ad7d1850000-00002ad7d185663f /opt/jrmc-3.1.0-1.5.0/jre/lib/amd64/native_threads/libhpi.so
00002aaaae0b6000-00002aaaae0c3fa3 /opt/jrmc-3.1.0-1.5.0/jre/lib/amd64/libzip.so
00002aaaae1fa000-00002aaaae20b5cf /opt/jrmc-3.1.0-1.5.0/jre/lib/amd64/libnet.so
00002aaaae30e000-00002aaaae3145db /opt/jrmc-3.1.0-1.5.0/jre/lib/amd64/libnio.so
00002aaaae41f000-00002aaaae422d73 /lib64/libnss_dns.so.2
0000003df3c00000-0000003df3c10823 /lib64/libresolv.so.2
00002aaaae624000-00002aaaae62918b /opt/jrmc-3.1.0-1.5.0/jre/lib/amd64/libmanagement.so
00002aaaae72b000-00002aaaae73363f /opt/jrmc-3.1.0-1.5.0/jre/lib/amd64/libjmapi.so
00002aaaae845000-00002aaaae8472af /opt/tuxedo/platform922/weblogic92/server/native/linux/x86_64/libwlfileio2.so
00002aaaae9ff000-00002aaaae9ff96b /opt/jrmc-3.1.0-1.5.0/jre/lib/amd64/librmi.so

Stack:
(* marks the word pointed to by the stack pointer)
0000000041aaa8b0: 0000000041aaa920* 000000008805e841 0000000310000408 00002aaaafcb8f70
0000000041aaa8d0: 0000000041aaabb0 0000000000000018 0000000041aaa934 0000000041aaabb0
0000000041aaa8f0: 0000000041aaa920 00002ad68806f287 00000000000005dc 00002aaac50cb408
0000000041aaa910: 00000000000006d8 0000000000000000 0000000041aaa960 00002ad68806f36b
0000000041aaa930: 0000000000000000 0000000000000000 0000000000000001 0000000041aaabb0
0000000041aaa950: 0000000000000000 00002aaac50cb408 0000000041aaa9b0 00002ad688017cd7

Code:
(* marks the word pointed to by the instruction pointer)
00002ad68806f030: 49c08949fff1298f 6674c0854870458b 00000001b8063883 894858ebf0440f44
00002ad68806f050: f8e28102eac148f2 484057034903ffff e0c1481fe083f089 08488b4802034804
00002ad68806f070: 7708fe8341d1014c 29158d48f0894432 488204634800062f eb01634ce0ffd001
00002ad68806f090: 0f4c10eb018b4c15* 01b70f4c0aeb01bf 01bf01be0f4c04eb 415f74ff85000000
00002ad68806f0b0: 8944c2894c485d8b 000000b8ff894cf6 0f41ffee8f59e800 0f06e9c166044db7
00002ad68806f0d0: 048908245c89c9b6 4100000001b94124 0000ba00000001b8 4c0000001dbe0000


"(Code Optimization Thread 1)" id=5 idx=0x34 tid=27456 lastJavaFrame=0xfffffffffffffffc

Stack 0: start=0x41a8a000, end=0x41aac000, guards=0x41a8f000 (ok), forbidden=0x41a8d000
Thread Stack Trace:
at known_ld_opt+685()@0x2ad68806f091
at strength_reduction_generic+158()@0x2ad68806f287
at optStrengthReduction+152()@0x2ad68806f36b
at optmanOptimizeMIR+330()@0x2ad688017cd7
at generateMethodWithStage+102()@0x2ad687f032b7
at cmgrGenerateMethodFromPhase+216()@0x2ad687f04126
at cmgrGenerateNormalMethod+91()@0x2ad687f0322d
at cmgrGenerateCode+209()@0x2ad687f030c1
at generate_code2+205()@0x2ad687fe68a3
at codegenThread+1006()@0x2ad687fe6f45
at tsiCallStartFunction+67()@0x2ad687fbf5cb
at tsiThreadStub+308()@0x2ad687fc07d5
at ptiThreadStub+14()@0x2ad6880288a6
at start_thread+199()@0x3def806367
-- Java stack --

Extended, platform specific info:
libc release: 2.5-stable
Elf headers:
libc ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 0000003deec1da70 PHOFF: 0000000000000040 SHOFF: 00000000001a1080 EF: 0x0 HS: 64 PS: 56 PHN; 10 SS: 64 SHN: 77 STIDX: 76
libpthread ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 0000003def805780 PHOFF: 0000000000000040 SHOFF: 0000000000022ef8 EF: 0x0 HS: 64 PS: 56 PHN; 9 SS: 64 SHN: 39 STIDX: 38
libjvm ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 000000000002de90 PHOFF: 0000000000000040 SHOFF: 000000000252ee50 EF: 0x0 HS: 64 PS: 56 PHN; 3 SS: 64 SHN: 30 STIDX: 27

**********************************************************
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
**********************************************************

===== END DUMP ===============================================================

No comments: