Discussion:
[Veritas-vx] CVM inactive
Boddula, Shashi Kanth (EB-SW-LIT)
2012-01-19 14:33:09 UTC
Permalink
SFRAC 4.1 on HP-UX 11i v2.

# vxdctl -c mode
mode: enabled: cluster inactive

How to troubleshoot this problem ?

The CVM license is active on all the nodes.

# vxlicrep -e | grep CVM_FULL | grep Enabled
CVM_FULL#VERITAS Volume Manager = Enabled
CVM_FULL = Enabled
CVM_FULL#VERITAS Volume Manager = Enabled
CVM_FULL#VERITAS Volume Manager = Enabled
CVM_FULL = Enabled

The LLT links looks fine.

# lltstat -nv
LLT node information:
Node State Links
0 node1 OPEN 2
1 node2 OPEN 2
2 node3 OPEN 2

The fencing LUNs are visible to all the nodes

# vxdisk -o alldgs list | grep -i vxfendg
EVA80000_0 auto:cdsdisk - (vxfendg) online
EVA80000_1 auto:cdsdisk - (vxfendg) online
EVA80000_2 auto:cdsdisk - (vxfendg) online

The cluster is UP, the gabconfig shows bellow, but the CVM is not coming up.

# gabconfig -a
GAB Port Memberships
===============================================================
Port a gen 1a0501 membership 012
Port b gen 1a0505 membership 012
Port d gen 1a0509 membership 012
Port h gen 1a0504 membership 012
Port o gen 1a0507 membership 012

I see the cvm_vxconfigd is ONLINE, but cvm_clus is OFFLINE

So what might be the problem here and how to solve it?

Thanks & Regards,
Shashi Kanth
Terrie Douglas
2012-01-19 17:13:13 UTC
Permalink
I have a couple questions.
First which cluster software are you using? If Symantec, check your hastatus.
If another, verify the cluster is functional in that software.

For the CVM, use the license reporter to verify it is fully enabled:
vxlicrep -e shows the CVM feature enabled
CVM_FULL = Enabled


-Terrie

From: veritas-vx-***@mailman.eng.auburn.edu [mailto:veritas-vx-***@mailman.eng.auburn.edu] On Behalf Of Boddula, Shashi Kanth (EB-SW-LIT)
Sent: Thursday, January 19, 2012 6:33 AM
To: veritas-***@mailman.eng.auburn.edu; veritas-***@mailman.eng.auburn.edu
Subject: [Veritas-vx] CVM inactive

SFRAC 4.1 on HP-UX 11i v2.

# vxdctl -c mode
mode: enabled: cluster inactive

How to troubleshoot this problem ?

The CVM license is active on all the nodes.

# vxlicrep -e | grep CVM_FULL | grep Enabled
CVM_FULL#VERITAS Volume Manager = Enabled
CVM_FULL = Enabled
CVM_FULL#VERITAS Volume Manager = Enabled
CVM_FULL#VERITAS Volume Manager = Enabled
CVM_FULL = Enabled

The LLT links looks fine.

# lltstat -nv
LLT node information:
Node State Links
0 node1 OPEN 2
1 node2 OPEN 2
2 node3 OPEN 2

The fencing LUNs are visible to all the nodes

# vxdisk -o alldgs list | grep -i vxfendg
EVA80000_0 auto:cdsdisk - (vxfendg) online
EVA80000_1 auto:cdsdisk - (vxfendg) online
EVA80000_2 auto:cdsdisk - (vxfendg) online

The cluster is UP, the gabconfig shows bellow, but the CVM is not coming up.

# gabconfig -a
GAB Port Memberships
===============================================================
Port a gen 1a0501 membership 012
Port b gen 1a0505 membership 012
Port d gen 1a0509 membership 012
Port h gen 1a0504 membership 012
Port o gen 1a0507 membership 012

I see the cvm_vxconfigd is ONLINE, but cvm_clus is OFFLINE

So what might be the problem here and how to solve it?

Thanks & Regards,
Shashi Kanth
Boddula, Shashi Kanth (EB-SW-LIT)
2012-01-20 07:28:23 UTC
Permalink
The cluster was working fine for years, but started giving trouble only after this holiday period.

The Syslog says

Had[2297]: VCS ERROR V-16-1-1005 CVMCluster:???:monitor:node - state: out of cluster
vmunix: WARNING: VxVM vxio V-5-0-23 Open on an spurious volume device (0x4f009088) encountered. This device may be valid, but has not yet been configured in the kernel.

The engine log says

CVMCluster:???:monitor:node - state: out of cluster
monitor procedure did not complete within the expected time

This time I manually tried to enable cvm_clus resource, and it got enabled in few seconds with all depended services groups with RAC databases got automatically started.

So just want to understand, why the CVM not coming online whenever I reboot? Is this because of CVMTimeout ?

http://www.symantec.com/business/support/index?page=content&pmv=print&impressions=&viewlocale=&id=TECH144899

Thank you all.

Thanks & Regards,
Shashi Kanth

From: Rajesh Tadakamadla [mailto:***@gmail.com]
Sent: Friday, January 20, 2012 10:43 AM
To: Boddula, Shashi Kanth (EB-SW-LIT)
Cc: veritas-***@mailman.eng.auburn.edu; veritas-***@mailman.eng.auburn.edu
Subject: Re: [Veritas-ha] CVM inactive

What does your VCS engine log and syslog say about cvm_clus & vxfsckd resources?
You will find your clues there.

Thanks & Regards,
Rajesh
On Thu, Jan 19, 2012 at 8:03 PM, Boddula, Shashi Kanth (EB-SW-LIT) <shashi-***@hp.com<mailto:shashi-***@hp.com>> wrote:
SFRAC 4.1 on HP-UX 11i v2.

# vxdctl -c mode
mode: enabled: cluster inactive

How to troubleshoot this problem ?

The CVM license is active on all the nodes.

# vxlicrep -e | grep CVM_FULL | grep Enabled
CVM_FULL#VERITAS Volume Manager = Enabled
CVM_FULL = Enabled
CVM_FULL#VERITAS Volume Manager = Enabled
CVM_FULL#VERITAS Volume Manager = Enabled
CVM_FULL = Enabled

The LLT links looks fine.

# lltstat -nv
LLT node information:
Node State Links
0 node1 OPEN 2
1 node2 OPEN 2
2 node3 OPEN 2

The fencing LUNs are visible to all the nodes

# vxdisk -o alldgs list | grep -i vxfendg
EVA80000_0 auto:cdsdisk - (vxfendg) online
EVA80000_1 auto:cdsdisk - (vxfendg) online
EVA80000_2 auto:cdsdisk - (vxfendg) online

The cluster is UP, the gabconfig shows bellow, but the CVM is not coming up.

# gabconfig -a
GAB Port Memberships
===============================================================
Port a gen 1a0501 membership 012
Port b gen 1a0505 membership 012
Port d gen 1a0509 membership 012
Port h gen 1a0504 membership 012
Port o gen 1a0507 membership 012

I see the cvm_vxconfigd is ONLINE, but cvm_clus is OFFLINE

So what might be the problem here and how to solve it?

Thanks & Regards,
Shashi Kanth

_______________________________________________
Veritas-ha maillist - Veritas-***@mailman.eng.auburn.edu<mailto:Veritas-***@mailman.eng.auburn.edu>
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-ha

Loading...