10/22/13

SR Detail

SR 3-7980443951 : [10/22] we are getting -07445: exception encountered: core dump [kslgetl()+120] [SIGSEGV] [Address
Severity 2-Significant
Escalation Status Never Escalated
Last Updated Oct 22, 2013 9:57 PM (13 mins ago)
Bug Reference No Related Bugs
Related Articles
Support Identifier
Account Name
Primary Contact
System
Product

No Related Articles
2613164
Estee Lauder Companies
Raj K
Oracle Database - Enterprise Edition

Status Solution Offered

Opened Oct 21, 2013 8:21 PM (Monday)
alert_drda10g.log,
Attachments drda10g_ora_29190.trc,
drda10g_ora_29192.trc
Related SRs No Related SRs
Alternate Contact
Host No Related Hosts

Product Version 10.2.0.5

Operating System Linux x86-64
OS Version Red Hat Enterprise 5
Project
Project Milestone
We have newly installed a 10g database on Linux 5 (2.6.18-308.el5) Installtion was fine but after install we noticed
there are lots of coredump file generated. adn when checked alert log we are getting follwing error.
Errors in file /db/drda/oracle/admin/drda10g/bdump/drda10g_ora_29292.trc:
ORA-07445: exception encountered: core dump [kslgetl()+120] [SIGSEGV] [Address not mapped to object]
Problem Description
[0x000000210] [] []
ORA-00108: failed to set up dispatcher to accept connection asynchronously
Thu Oct 17 12:16:33 EDT 2013
All dispatchers and shared servers shutdown
Thu Oct 17 12:16:33 EDT 2013
History
ODM Solution/Action Plan
Hi Raj

Oracle Support- Oct 22, 2013 9:57 PM (13 mins ago)

From your trace file, the failing function: kslgetl and the stack trace: kslgetl ksfglt kghfre kmnsbf nsbfr nsiofrrg nsiocancel nsopen_shutitdown
nsclose nsgblclose
Matched to:
Bug 7147411 - LOTS OF ORA-7445 [KSLGETL()+40] REPORTED IN ALERT.LOG
Note 579281.1 Many ORA-7445 [kslgetl] or ORA-600 [ksl_invalid_latch], [kslges] Errors From CJQ0 Process
Even though this has been reported in releases below 11.1, there is no one-off patch for 10.2.0.5 on your platform and language on My Oracle
Support,
Please note that Premier Support for Database 10.2 expired on July 31 2011 so, if you didn't purchased Extended Support, there is NO option
anymore for engaging development troubleshooting/investigating your issues.
For more info have a look at:
o Note 1130327.1 - Oracle Database 10.2 End of Premier Support - Frequently Asked Questions
o Note 161818.1 - Oracle Server (RDBMS) Releases Support Status Summary
o Note 209768.1 - Database, FMW, EM Grid Control, and OCS Software Error Correction Support Policy
o Note 757445.1 - FAQ for Products in Extended Support
o Note 1293180.1 Database Patch Set 10.2.0.4 patching extended to July 31, 2011
We also do not see based on the CSI for this SR that you are on Extended Support, please contact your Service Delivery Manager if you wish
to obtain Extended Support for 10.2 release.
Advantages for being on the latest patchset release:
o Latest patchset contains fix for all the known issues/Bugs raised in previous releases.
o Patchsets doesn't include any new functionality, it's only for bug fixing
o New bugs can only be logged against latest patchset release of supported versions
o Backports can only be requested against latest patchset release of supported versions
o Most stable release since a lot of bugs are already be fixed in the successive patchsets
The solution action plan to resolve this matter is to migrate to 11.1.0.7 or 11.2.0.2 or higher that has this fix.
Development has offered no workaround for Bug 7147411 - LOTS OF ORA-7445 [KSLGETL()+40] REPORTED IN ALERT.LOG
Best regards,

https://support.oracle.com/epmos/faces/SrDetailPrint?sysmsg=true&_afrLoop=27812185202941&srNumber=3-7980443951&print=true&sortBy=Newest+on+To

1/5

10/22/13

Best regards,
Kim Shatteen
Oracle Global Customer Services

SR Detail

ODM Proposed Solution Justif

Oracle Support- Oct 22, 2013 9:52 PM (18 mins ago)
This issue is described in My Oracle Support Note 579281.1 Many ORA-7445 [kslgetl] or ORA-600 [ksl_invalid_latch], [kslges] Errors From CJQ0
Process. The solution is to do the following:
1. Solution is to migrate to either 11.1.0.7 or 11.2.0.2 or higher that has this fix and many others.
ODM Proposed Solution(s)
Solution is to:

Oracle Support- Oct 22, 2013 9:52 PM (18 mins ago)

- Migrate to either 11.1.0.7 or 11.2.0.2 or higher that has this fix and many others.
ODM Cause Justification
This is explained in the following bug:

Oracle Support- Oct 22, 2013 9:49 PM (21 mins ago)

Bug 7147411 - LOTS OF ORA-7445 [KSLGETL()+40] REPORTED IN ALERT.LOG

ODM Cause Determination
Memory corruption can occur in the CJQ process leading to a dump.

Oracle Support- Oct 22, 2013 9:48 PM (22 mins ago)

ODM Issue Verification

Verified the issue in the log file as noted below:

Oracle Support- Oct 22, 2013 9:42 PM (28 mins ago)

LOG FILE
----------------------Filename =drda10g_ora_29190.trc
See the following error:
ORA-07445: exception encountered: core dump [kslgetl()+120] [SIGSEGV] [Address not mapped to object] [0x000000210] [] []
ORA-00108: failed to set up dispatcher to accept connection asynchronously
ODM Issue Clarification
On : 10.2.0.5 version, Internals Errors (ORA-600 & ORA-7445)

Oracle Support- Oct 22, 2013 9:42 PM (28 mins ago)

The following error occurs.

ERROR
----------------------ORA-07445: exception encountered: core dump [kslgetl()+120] [SIGSEGV] [Address not mapped to object] [0x000000210] [] []
ORA-00108: failed to set up dispatcher to accept connection asynchronously
Update from Customer
Any update,Kindly work on this as priority. Thank you
ODM Research
-- Search --

RAJ.KUNDURY@GMAIL.COM- Oct 22, 2013 5:58 PM (4+ hours ago)

Oracle Support- Oct 22, 2013 4:57 AM (17+ hours ago)

Note: This is INTERNAL ONLY research. No action should be taken by the customer on this information. This is research only, and may NOT be
applicable to your specific situation.
Searched on:

Failing Function: kslgetl

Stack Trace: kslgetl ksfglt kghfre kmnsbf nsbfr nsiofrrg nsiocancel nsopen_shutitdown nsclose nsgblclose
Bug 7147411 - LOTS OF ORA-7445 [KSLGETL()+40] REPORTED IN ALERT.LOG
Note 579281.1 Many ORA-7445 [kslgetl] or ORA-600 [ksl_invalid_latch], [kslges] Errors From CJQ0 Process
Note 310413.1 ORA-7445 (kslgetl)
ODM Data Collection
Name
-------=== ODM Data Collection ===

Oracle Support- Oct 22, 2013 4:56 AM (17+ hours ago)

ALERT
---------Thu Oct 17 12:13:47 EDT 2013
Errors in file /db/drda/oracle/admin/drda10g/bdump/drda10g_ora_29190.trc:
ORA-07445: exception encountered: core dump [kslgetl()+120] [SIGSEGV] [Address not mapped to object] [0x000000210] [] []
ORA-00108: failed to set up dispatcher to accept connection asynchronously
Thu Oct 17 12:13:48 EDT 2013
https://support.oracle.com/epmos/faces/SrDetailPrint?sysmsg=true&_afrLoop=27812185202941&srNumber=3-7980443951&print=true&sortBy=Newest+on+To

2/5

10/22/13

SR Detail

TRACE
--------ORA-07445: exception encountered: core dump [kslgetl()+120] [SIGSEGV] [Address not mapped to object] [0x000000210] [] []
ORA-00108: failed to set up dispatcher to accept connection asynchronously
Current SQL information unavailable - no session.
----- Call Stack Trace ----calling call entry argument values in hex
location type point (? means dubious value)
-------------------- -------- -------------------- ---------------------------ksedst()+31 call ksedst1() 000000000 ? 000000001 ?
2B0D03E1BD50 ? 2B0D03E1BDB0 ?
2B0D03E1BCF0 ? 000000000 ?
ksedmp()+610 call ksedst() 000000000 ? 000000001 ?
2B0D03E1BD50 ? 2B0D03E1BDB0 ?
2B0D03E1BCF0 ? 000000000 ?
ssexhd()+629 call ksedmp() 000000003 ? 000000001 ?
2B0D03E1BD50 ? 2B0D03E1BDB0 ?
2B0D03E1BCF0 ? 000000000 ?
__restore_rt()+0 call ssexhd() 00000000B ? 2B0D03E1CD70 ?
2B0D03E1CC40 ? 2B0D03E1BDB0 ?
2B0D03E1BCF0 ? 000000000 ?
kslgetl()+120 signal __restore_rt() 0600E8438 ? 0000000F0 ?
08374F660 ? 0000009E3 ?
000003980 ? 000000001 ?
ksfglt()+108 call kslgetl() 0600E8438 ? 000000001 ?
08374F660 ? 0000009E3 ?
000003980 ? 000000001 ?
kghfre()+2298 call ksfglt() 0600E8438 ? 0600E8438 ?
000000000 ? 08374F660 ?
0000009E3 ? 000000001 ?
kmnsbf()+96 call kghfre() 006AE9A20 ? 060037180 ?
7FFF352CC2D0 ? 000012000 ?
00582C778 ? 000000001 ?
nsbfr()+311 call kmnsbf() 006AE9A20 ? 060037180 ?
7FFF352CC2D0 ? 000012000 ?
00582C778 ? 000000001 ?
nsiofrrg()+473 call nsbfr() 006AE9A20 ? 01DDD0A50 ?
7FFF352CC2D0 ? 000012000 ?
00582C778 ? 000000001 ?
nsiocancel()+198 call nsiofrrg() 01DDCFC70 ? 01DDD0120 ?
000000000 ? 000012000 ?
00582C778 ? 000000001 ?
nsopen_shutitdown() call nsiocancel() 01DDCFC70 ? 01DDD0120 ?
+474 000000000 ? 000012000 ?
00582C778 ? 000000001 ?
nsclose()+412 call nsopen_shutitdown() 01DDADBA0 ? 7FFF352CC530 ?
01DDCFC70 ? 01DDD0120 ?
7FFF00000000 ? 0000000C0 ?
nsgblclose()+272 call nsclose() 7FFF352CC530 ? 000000000 ?
0000000C0 ? 01DDD0120 ?
7FFF00000000 ? 0000000C0 ?
nsgblTRMHelper()+61 call nsgblclose() 0000000C0 ? 000000000 ?
0000000C0 ? 01DDD0120 ?
7FFF00000000 ? 0000000C0 ?
nsgblRealTerm()+174 call nsgblTRMHelper() 01DDCFC70 ? 000000000 ?
0000000C0 ? 01DDD0120 ?
7FFF00000000 ? 0000000C0 ?
nlstdstp()+306 call nsgblRealTerm() 006B0F860 ? 000000000 ?
0000000C0 ? 01DDD0120 ?
7FFF00000000 ? 0000000C0 ?
npinlt()+53 call nlstdstp() 006B0F860 ? 000000000 ?
0000000C0 ? 01DDD0120 ?
7FFF00000000 ? 0000000C0 ?
ksuabt()+624 call npinlt() 006B0F860 ? 000000000 ?
0000000C0 ? 01DDD0120 ?
7FFF00000000 ? 0000000C0 ?
opidrv()+1863 call ksuabt() 006B0F860 ? 006AEA2B4 ?
7FFF352CC970 ? 000000001 ?
6AEA2B400000000 ? 000000000 ?
sou2o()+114 call opidrv() 000000032 ? 000000004 ?
https://support.oracle.com/epmos/faces/SrDetailPrint?sysmsg=true&_afrLoop=27812185202941&srNumber=3-7980443951&print=true&sortBy=Newest+on+To

3/5

10/22/13

sou2o()+114 call opidrv() 000000032 ? 000000004 ?

7FFF352CCC58 ? 000000001 ?
6AEA2B400000000 ? 000000000 ?
opimai_real()+317 call sou2o() 7FFF352CCC30 ? 000000032 ?
000000004 ? 7FFF352CCC58 ?
6AEA2B400000000 ? 000000000 ?
main()+116 call opimai_real() 000000003 ? 7FFF352CCCC0 ?
000000004 ? 7FFF352CCC58 ?
6AEA2B400000000 ? 000000000 ?
__libc_start_main() call main() 000000003 ? 7FFF352CCCC0 ?
+244 000000004 ? 7FFF352CCC58 ?
6AEA2B400000000 ? 000000000 ?
_start()+41 call __libc_start_main() 00072D108 ? 000000001 ?
7FFF352CCE18 ? 000000000 ?
6AEA2B400000000 ? 000000003 ?

SR Detail

--------------------- Binary Stack Dump --------------------drda10g_ora_29190.trc

FileName
---------------FileComment
---------------------ODM Action Plan
Hello Raj -

Oracle Support- Oct 21, 2013 9:37 PM (Monday)

I am currently reviewing/researching the situation and will update the SR / call you as soon as I have relevant information.
Thank you for your patience.
Best regards,
Kim Shatteen
Oracle Global Customer Service
Customer Problem Description
Customer Problem Description
---------------------------------------------------

RAJ.KUNDURY@GMAIL.COM- Oct 21, 2013 8:21 PM (Monday)

Problem Summary
--------------------------------------------------we are getting ORA-07445: exception encountered: core dump [kslgetl()+120] [SIGSEGV] [Address not ma
Problem Description
--------------------------------------------------We have newly installed a 10g database on Linux 5 (2.6.18-308.el5) Installtion was fine but after install we noticed there are lots of coredump
file generated. adn when checked alert log we are getting follwing error.
Errors in file /db/drda/oracle/admin/drda10g/bdump/drda10g_ora_29292.trc:
ORA-07445: exception encountered: core dump [kslgetl()+120] [SIGSEGV] [Address not mapped to object] [0x000000210] [] []
ORA-00108: failed to set up dispatcher to accept connection asynchronously
Thu Oct 17 12:16:33 EDT 2013
All dispatchers and shared servers shutdown
Thu Oct 17 12:16:33 EDT 2013
Error Codes
--------------------------------------------------ORA-07445: exception encountered: core dump [kslgetl()+120] [SIGSEGV] [Address not mapped to object] [0x000000210] [] []
Problem Category/Subcategory
--------------------------------------------------Database Installation, Upgrade & Downgrade (Server & Client)/ORA errors after/during install
Uploaded Files
--------------------------------------------------File: alert_drda10g.log;drda10g_ora_29190.trc;drda10g_ora_29192.trc
Template Question Responses

https://support.oracle.com/epmos/faces/SrDetailPrint?sysmsg=true&_afrLoop=27812185202941&srNumber=3-7980443951&print=true&sortBy=Newest+on+To

4/5

10/22/13

SR Detail

Template Question Responses

--------------------------------------------------1) Is this an Install problem or an Upgrade one?
Install
2) Is the error appearing during the install/upgrade process or after it?
Error occoured after the install of the product
3) What is the error appearing? Please Specify.
Errors in file /db/drda/oracle/admin/drda10g/bdump/drda10g_ora_29290.trc:
ORA-07445: exception encountered: core dump [kslgetl()+120] [SIGSEGV] [Address not mapped to object] [0x000000210] [] []
ORA-00108: failed to set up dispatcher to accept connection asynchronously
Thu Oct 17 12:16:24 EDT 2013
found dead dispatcher 'D000', pid = (16, 28)
Thu Oct 17 12:16:26 EDT 2013
Shutting down instance (immediate)
Thu Oct 17 12:16:26 EDT 2013
Shutting down instance: further logons disabled
Thu Oct 17 12:16:26 EDT 2013
Stopping background process QMNC
Thu Oct 17 12:16:26 EDT 2013
Stopping background process CJQ0
Thu Oct 17 12:16:28 EDT 2013
Stopping background process MMNL
Thu Oct 17 12:16:28 EDT 2013
Stopping background process MMON
License high water mark = 6
Thu Oct 17 12:16:28 EDT 2013
Job queue slave processes stopped
Waiting for dispatcher 'D000' to shutdown
Thu Oct 17 12:16:29 EDT 2013
dispatcher 'D000' encountered error getting listening address
Thu Oct 17 12:16:29 EDT 2013
Errors in file /db/drda/oracle/admin/drda10g/bdump/drda10g_ora_29292.trc:
ORA-07445: exception encountered: core dump [kslgetl()+120] [SIGSEGV] [Address not mapped to object] [0x000000210] [] []
ORA-00108: failed to set up dispatcher to accept connection asynchronously
Thu Oct 17 12:16:33 EDT 2013
4) Was the error logged in the installation log file? (If yes, please specify the log and
upload it)
No this was not logged
5) ### Impact on Business ###
There is a critical impact as we are having Project deadlines.
Update from Customer
Upload to TDS successful for the file drda10g_ora_29192.trc.

RAJ.KUNDURY@GMAIL.COM- Oct 21, 2013 8:18 PM (Monday)

Update from Customer

Upload to TDS successful for the file drda10g_ora_29190.trc.

RAJ.KUNDURY@GMAIL.COM- Oct 21, 2013 8:16 PM (Monday)

Update from Customer

Upload to TDS successful for the file alert_drda10g.log.

RAJ.KUNDURY@GMAIL.COM- Oct 21, 2013 8:13 PM (Monday)

https://support.oracle.com/epmos/faces/SrDetailPrint?sysmsg=true&_afrLoop=27812185202941&srNumber=3-7980443951&print=true&sortBy=Newest+on+To

5/5