Core/Abend in NICI 2.7.0 or NMAS 3.1.2

  • 3316189
  • 30-May-2007
  • 14-Feb-2017

Environment

Novell eDirectory 8.8 SP6
Novell Modular Authentication Service (NMAS) 3.1.2
Novell International Cryptographic Infrastructure (NICI) 2.7.0

Situation

NetWare abend.log states - Running process: Java_246 DirXML Process, Thread Owned by NLM: JAVA.NLM -The CPU encountered a problem executing code in XENGEXP.NLM

ndsd cores in spmDistSetPassword () from /usr/lib//nds-modules/libnmas.so


After applying Security Services 2.0.3 patch, which includes NICI 2.7.0 and NMAS 3.1.2, cores/abends happen. The cores/abends happen when IDM/DirXML attempts to sync a null or blank password.

For Linux, the pstack looks like this:

(gdb) where
#0 0xffffe410 in __kernel_vsyscall ()
#1 0x401f4581 in raise () from /lib/tls/libc.so.6
#2 0x401f5e65 in abort () from /lib/tls/libc.so.6
#3 0x6f74f418 in os::abort () from
/usr/lib/nds-modules/jre/lib/i386/server/libjvm.so
#4 0x6f74c01f in os::handle_unexpected_exception () from
/usr/lib/nds-modules/jre/lib/i386/server/libjvm.so
#5 0x6f74fea6 in JVM_handle_linux_signal () from
/usr/lib/nds-modules/jre/lib/i386/server/libjvm.so
#6 0x6f74ec38 in signalHandler () from
/usr/lib/nds-modules/jre/lib/i386/server/libjvm.so
#7
#8 0x40077b7f in CCSX_NCP () from /usr/sbin/../lib/libccs2.so
#9 0x40071072 in CCSX_NCP () from /usr/sbin/../lib/libccs2.so
#10 0x400699b7 in CCSX_NCP () from /usr/sbin/../lib/libccs2.so
#11 0x40038fe2 in CCSX_Digest () from /usr/sbin/../lib/libccs2.so
#12 0x67e83b59 in CCS_Digest () from /usr/lib//nds-modules/libnmas.so
#13 0x67e34998 in createHSPWithPseudoID () from
/usr/lib//nds-modules/libnmas.so
#14 0x67e34a03 in createHSP () from /usr/lib//nds-modules/libnmas.so
#15 0x67e35416 in createKeyAttrs () from /usr/lib//nds-modules/libnmas.so
#16 0x67e3584c in DPAL_GetNDSPwdUpdates () from
/usr/lib//nds-modules/libnmas.so
#17 0x67e41f32 in DALSetPassword () from /usr/lib//nds-modules/libnmas.so
#18 0x67e65305 in spmSetPassword () from /usr/lib//nds-modules/libnmas.so
#19 0x67e65be9 in spmDistSetPassword () from /usr/lib//nds-modules/libnmas.so
#20 0x688b8260 in DHUtil_submitVerb () from /usr/lib/libdhutilj.so.2.0.10
#21 0x688b8e0c in DHUtil_submitVerb () from /usr/lib/libdhutilj.so.2.0.10
#22 0x688b3884 in Java_com_novell_nds_dhutil_SPMAgent_setSPMDistPassword ()
from /usr/lib/libdhutilj.so.2.0.10

For NetWare 6.5, the abend.log looks like this:

*********************************************************
Novell Open Enterprise Server, NetWare 6.5
PVER: 6.50.06

Server PRV-SD6 halted Tuesday, 28 November 2006 10:52:15.135 am
Abend 1 on P00: Server-5.70.06: Page Fault Processor Exception (Error code 00000000)

Registers:
CS = 0060 DS = 007B ES = 0068 FS = 007B GS = 007B SS = 0068
EAX = 403C179C EBX = 8D878D34 ECX = 403C17A0 EDX = 403C6000
ESI = FFFFF69D EDI = 403C1780 EBP = 44D74088 ESP = 8D878BF8
EIP = 85C7AB2A FLAGS = 00010287
85C7AB2A 8A1A MOV BL, [EDX]=?
EIP in XENGEXP.NLM at code start +00009B2Ah
Access Location: 0x403C6000

The violation occurred while processing the following instruction:
85C7AB2A 8A1A MOV BL, [EDX]
85C7AB2C 305804 XOR [EAX+04], BL
85C7AB2F 42 INC EDX
85C7AB30 40 INC EAX
85C7AB31 39C8 CMP EAX, ECX
85C7AB33 75F5 JNZ 85C7AB2A
85C7AB35 83EE20 SUB ESI, 00000020
85C7AB38 EBE9 JMP 85C7AB23
85C7AB3A 85F6 TEST ESI, ESI
85C7AB3C 7429 JZ 85C7AB67



Running process: Java_246 DirXML Process
Thread Owned by NLM: JAVA.NLM
Stack pointer: 8D878518
OS Stack limit: 8D849CA0
Scheduling priority: 67371008
Wait state: 3030070 Yielded CPU
Stack: --403C5684 ?
--403C1D14 ?
--403C1D00 ?
--00000038 (LOADER.NLM|KernelAddressSpace+38)
--8D878D6C ?
85C75837 (XENGEXP.NLM|(Code Start)+4837)
--403C1D14 ?
--44D74088 ?
--00000001 (LOADER.NLM|KernelAddressSpace+1)
--00000001 (LOADER.NLM|KernelAddressSpace+1)
--8D878D4C ?
--8D878D6C ?
--4036B980 ?
87EB5835 (XMGR.NLM|(Code Start)+B835)
--4036B980 ?
--403C1D00 ?
--44D74088 ?
--00000001 (LOADER.NLM|KernelAddressSpace+1)
--8D878D4C ?
--8D878D6C ?
--4406C4EC ?
--07400001 ?
--44D74088 ?
--00000001 (LOADER.NLM|KernelAddressSpace+1)
--8D878D4C ?
87DB5F5A (CCS.NLM|CCSX_Digest+3A)
--07400001 ?
--44D74088 ?
--00000001 (LOADER.NLM|KernelAddressSpace+1)
--8D878D4C ?
--8D878D6C ?
--07400001 ?
--44D74088 ?
--00000001 (LOADER.NLM|KernelAddressSpace+1)
--F3715E18 ?
8A901E2C ?
--8B97CD20 ?
--07400001 ?
--44D74088 ?
--00000001 (LOADER.NLM|KernelAddressSpace+1)
--8D878D4C ?
--8D878D6C ?
--07400001 ?
--00000010 (LOADER.NLM|KernelAddressSpace+10)
--07400001 ?
--44D74088 ?
8A8E8822 (NMAS.NLM|MAF_PutAttribute+9FF2)
--07400001 ?
--44D74088 ?
--00000001 (LOADER.NLM|KernelAddressSpace+1)
--F3715E18 ?
--8D878D6C ?
--00000001 (LOADER.NLM|KernelAddressSpace+1)
--80000007 ?
--00000004 (LOADER.NLM|KernelAddressSpace+4)
--8D878D70 ?
--86600C06 ?
--F8860148 ?
--08020137 ?
--00000481 (LOADER.NLM|KernelAddressSpace+481)
--8D878CD8 ?
--8D878CC8 ?
--00000010 (LOADER.NLM|KernelAddressSpace+10)
--07400001 ?
--44D74088 ?
--8D878D70 ?
--8D878D6C ?
--8D878D4C ?
8A8E8878 (NMAS.NLM|MAF_PutAttribute+A048)
--00000001 (LOADER.NLM|KernelAddressSpace+1)
--44D74088 ?
--8D878D70 ?
--8D878D6C ?
--8D878D4C ?
--00000000 (LOADER.NLM|KernelAddressSpace+0)
--44D725A8 ?
--8BF4B088 ?
--00000000 (LOADER.NLM|KernelAddressSpace+0)
8A8E90B4 (NMAS.NLM|MAF_PutAttribute+A884)
--07400037 ?
--00000001 (LOADER.NLM|KernelAddressSpace+1)
--44D74088 ?
--8D878D6C ?
--8D878D4C ?
--8D878D70 ?
--44AAFB40 ?
--00000000 (LOADER.NLM|KernelAddressSpace+0)
8A8C85CF (NMAS.NLM|MAF_Free+F)
--DEDEEDED ?
--00000076 (LOADER.NLM|KernelAddressSpace+76)
--0000010F (LOADER.NLM|KernelAddressSpace+10F)
--00000000 (LOADER.NLM|KernelAddressSpace+0)
--8BF4B988 ?
--00000010 (LOADER.NLM|KernelAddressSpace+10)
--0000FB49 (LOADER.NLM|KernelAddressSpace+FB49)
--0000015A (LOADER.NLM|KernelAddressSpace+15A)
--00000000 (LOADER.NLM|KernelAddressSpace+0)
--00000000 (LOADER.NLM|KernelAddressSpace+0)
--07400037 ?
--44D74088 ?

Additional Information:
The CPU encountered a problem executing code in XENGEXP.NLM. The problem may be in that module or in data passed to that module by a process owned by JAVA.NLM.


Resolution

Download and apply NMAS 3.1.2.3 FTF (or greater)

To download the file, go to https://download.novell.com | In the Product or Technology drop down | Select NMAS (Novell Modular Authentication Service) | Search

On the Patches Tab, select "NMAS 3.1.2.3 FTF"

Follow the readme, on how to install.