Exchange 2010 DAG cannot add any additional members.
Hello, I am attempting to configure a DAG. I have successfully configured the first dag member but when I attempt to add the second member it fails. Here is the exchange setup log DagTasks log of the add operation. Can anyone offer some suggestions. add-databaseavailabiltygroupserver started on machine MBXD-01. [2011-01-27T04:02:52] add-dagserver started [2011-01-27T04:02:52] commandline: $scriptCmd = {& $wrappedCmd @PSBoundParameters } [2011-01-27T04:02:52] Option 'Identity' = 'dag-01'. [2011-01-27T04:02:52] Option 'MailboxServer' = 'MBXD-02'. [2011-01-27T04:02:52] Option 'DatabaseAvailabilityGroupIpAddresses' = ''. [2011-01-27T04:02:52] Option 'WhatIf' = ''. [2011-01-27T04:02:52] Process: w3wp w3wp.exe:6456. [2011-01-27T04:02:52] User context = 'NT AUTHORITY\SYSTEM'. [2011-01-27T04:02:52] Member of group 'Everyone'. [2011-01-27T04:02:52] Member of group 'BUILTIN\Users'. [2011-01-27T04:02:52] Member of group 'NT AUTHORITY\SERVICE'. [2011-01-27T04:02:52] Member of group 'CONSOLE LOGON'. [2011-01-27T04:02:52] Member of group 'NT AUTHORITY\Authenticated Users'. [2011-01-27T04:02:52] Member of group 'NT AUTHORITY\This Organization'. [2011-01-27T04:02:52] Member of group 'BUILTIN\IIS_IUSRS'. [2011-01-27T04:02:52] Member of group 'LOCAL'. [2011-01-27T04:02:52] Member of group 'IIS APPPOOL\MSExchangePowerShellAppPool'. [2011-01-27T04:02:52] Member of group 'BUILTIN\Administrators'. [2011-01-27T04:02:52] Updated Progress 'Validating the parameters.' 2%. [2011-01-27T04:02:52] Working [2011-01-27T04:02:52] Mailbox server: value passed in = MBXD-02, mailboxServer.Name = MBXD-02, mailboxServer.Fqdn = MBXD-02.mydomain.com [2011-01-27T04:02:52] LogClussvcState: clussvc is Stopped on MBXD-02.mydomain.com. Exception (if any) = none [2011-01-27T04:02:52] The IP addresses for the DAG are (blank means DHCP): 10.16.197.104 [2011-01-27T04:02:52] Looking up IP addresses for dag-01. [2011-01-27T04:02:52] dag-01 = [ 10.16.197.104 ]. [2011-01-27T04:02:52] Looking up IP addresses for mbxd-02. [2011-01-27T04:02:52] mbxd-02 = [ 10.16.197.17 ]. [2011-01-27T04:02:52] Looking up IP addresses for MBXD-02.mydomain.com. [2011-01-27T04:02:52] MBXD-02.mydomain.com = [ 10.16.197.17 ]. [2011-01-27T04:02:52] DAG dag-01 has 1 servers: [2011-01-27T04:02:52] DAG dag-01 contains server MBXD-01. [2011-01-27T04:02:52] Updated Progress 'Checking if Mailbox server 'MBXD-02' is in a database availability group.' 4%. [2011-01-27T04:02:52] Working [2011-01-27T04:02:52] GetRemoteCluster() for the mailbox server failed with exception = An Active Manager operation failed. Error: An error occurred while attempting a cluster operation. Error: Cluster API '"OpenCluster(MBXD-02.mydomain.com) failed with 0x6d9. Error: There are no more endpoints available from the endpoint mapper"' failed... This is OK. [2011-01-27T04:02:52] Ignoring previous error, as it is acceptable if the cluster does not exist yet. [2011-01-27T04:02:52] DumpClusterTopology: Opening remote cluster dag-01. [2011-01-27T04:02:52] DumpClusterTopology: Failed opening with Microsoft.Exchange.Cluster.Replay.AmClusterApiException: An Active Manager operation failed. Error: An error occurred while attempting a cluster operation. Error: Cluster API '"OpenCluster(dag-01.mydomain.com) failed with 0x721. Error: A security package specific error occurred"' failed.. ---> System.ComponentModel.Win32Exception: A security package specific error occurred --- End of inner exception stack trace --- at Microsoft.Exchange.Cluster.ClusApi.AmCluster.OpenByName(AmServerName serverName) at Microsoft.Exchange.Management.SystemConfigurationTasks.DumpClusterTopology..ctor(String nameCluster, ITaskOutputHelper output) [2011-01-27T04:02:52] Dumping the cluster by connecting to: dag-01. [2011-01-27T04:02:52] DumpClusterTopology: Not dumping, since the cluster could not be contacted. [2011-01-27T04:02:52] DumpClusterTopology: Opening local cluster. [2011-01-27T04:02:52] Dumping the cluster by connecting to: . [2011-01-27T04:02:52] The cluster's name is: dag-01. [2011-01-27T04:02:52] Groups [2011-01-27T04:02:52] group: Available Storage [not a CMS] [2011-01-27T04:02:52] OwnerNode: MBXD-01.mydomain.com [2011-01-27T04:02:52] State: Offline [2011-01-27T04:02:52] group: Cluster Group [Cluster Main Group] [2011-01-27T04:02:52] OwnerNode: MBXD-01.mydomain.com [2011-01-27T04:02:52] State: Failed [2011-01-27T04:02:52] Resource: Cluster Name [Failed, type = Network Name, PossibleOwners = MBXD-01 ] [2011-01-27T04:02:52] NetName = [dag-01] [2011-01-27T04:02:52] Resource: Cluster IP Address [Online, type = IP Address, PossibleOwners = MBXD-01 ] [2011-01-27T04:02:52] Address = [10.16.197.104] [2011-01-27T04:02:52] EnableDhcp = [0] [2011-01-27T04:02:52] Network = [Cluster Network 1] [2011-01-27T04:02:52] Nodes [2011-01-27T04:02:52] node: MBXD-01.mydomain.com [ state = Up ] [2011-01-27T04:02:52] Subnets [2011-01-27T04:02:52] Name(Cluster Network 1), Mask(10.16.197.0/24), Role(ClusterNetworkRoleInternalAndClient) [2011-01-27T04:02:52] NIC 10.16.197.16 on Node MBXD-01 in State=Up [2011-01-27T04:02:52] Opening the cluster on nodes [mbxd-01]. [2011-01-27T04:02:52] Other mailbox servers in the DAG are already members of cluster 'dag-01' [2011-01-27T04:02:52] The server MBXD-02 does not belong to a cluster, and the other servers belong to dag-01. [2011-01-27T04:02:52] Successfully resolved the servers based on the stopped servers list. [2011-01-27T04:02:52] The following servers are in the StartedServers list (The list is the StartedServers property of the DAG in AD): [2011-01-27T04:02:52] The following servers are in the StoppedServers list: [2011-01-27T04:02:52] Verifiying that the members of database availability group 'dag-01' are also members of the cluster. [2011-01-27T04:02:52] Verifying that the members of cluster 'dag-01' are also members of the database availability group. [2011-01-27T04:02:52] According to GetNodeClusterState(), the server MBXD-02 is NotConfigured. [2011-01-27T04:02:52] The CNO is currently Failed. [2011-01-27T04:02:52] Network name 'dag-01' is not online. Please check that the IP address configuration for the database availability group is correct. [2011-01-27T04:02:52] InternalValidate() done. [2011-01-27T04:02:53] Updated Progress 'Adding server 'MBXD-02' to database availability group 'dag-01'.' 6%. [2011-01-27T04:02:53] Working [2011-01-27T04:02:53] Updated Progress 'Adding server 'MBXD-02' to the cluster.' 8%. [2011-01-27T04:02:53] Working [2011-01-27T04:09:13] The following log entry comes from a different process that's running on machine 'MBXD-01.mydomain.com'. BEGIN [2011-01-27T04:09:13] [2011-01-27T04:02:53] Opening a local AmCluster handle. [2011-01-27T04:02:53] Updated Progress 'Adding server 'mbxd-02' to database availability group 'dag-01'.' 2%. [2011-01-27T04:02:53] Working [2011-01-27T04:02:53] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseValidateNodeState, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 12, szObjectName = MBXD-02, dwStatus = 0x0 ) [2011-01-27T04:02:53] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseValidateNodeState, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 12, szObjectName = , dwStatus = 0x0 ) [2011-01-27T04:02:53] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseGettingCurrentMembership, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 25, szObjectName = dag-01, dwStatus = 0x0 ) [2011-01-27T04:02:53] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseGettingCurrentMembership, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 25, szObjectName = , dwStatus = 0x0 ) [2011-01-27T04:02:53] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseAddNodeToCluster, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 37, szObjectName = MBXD-02, dwStatus = 0x0 ) [2011-01-27T04:02:54] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseAddNodeToCluster, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 37, szObjectName = , dwStatus = 0x0 ) [2011-01-27T04:02:54] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseValidateNetft, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 50, szObjectName = MBXD-02, dwStatus = 0x0 ) [2011-01-27T04:02:54] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseValidateNetft, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 50, szObjectName = , dwStatus = 0x0 ) [2011-01-27T04:02:54] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseValidateClusDisk, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 62, szObjectName = MBXD-02, dwStatus = 0x0 ) [2011-01-27T04:02:54] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseValidateClusDisk, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 62, szObjectName = , dwStatus = 0x0 ) [2011-01-27T04:02:54] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseConfigureClusSvc, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 75, szObjectName = MBXD-02, dwStatus = 0x0 ) [2011-01-27T04:02:54] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseConfigureClusSvc, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 75, szObjectName = , dwStatus = 0x0 ) [2011-01-27T04:02:54] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseStartingClusSvc, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 87, szObjectName = MBXD-02.mydomain.com, dwStatus = 0x0 ) [2011-01-27T04:02:54] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseStartingClusSvc, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 87, szObjectName = , dwStatus = 0x0 ) [2011-01-27T04:02:54] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseNodeUp, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 100, szObjectName = MBXD-02, dwStatus = 0x0 ) [2011-01-27T04:05:54] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseNodeUp, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseFatal, dwPercentComplete = 100, szObjectName = MBXD-02, dwStatus = 0x5b4 ) [2011-01-27T04:05:54] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseFailureCleanup, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 100, szObjectName = MBXD-02, dwStatus = 0x0 ) [2011-01-27T04:09:13] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseFailureCleanup, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 100, szObjectName = , dwStatus = 0x0 ) [2011-01-27T04:09:13] The preceding log entry comes from a different process running on computer 'MBXD-01.mydomain.com'. END [2011-01-27T04:09:13] The operation wasn't successful because an error was encountered. You may find more details in log file "C:\ExchangeSetupLogs\DagTasks\dagtask_2011-01-27_04-02-52.067_add-databaseavailabiltygroupserver.log". [2011-01-27T04:09:13] WriteError! Exception = Microsoft.Exchange.Cluster.Replay.DagTaskOperationFailedException: A server-side database availability group administrative operation failed. Error: The operation failed. CreateCluster errors may result from incorrectly configured static addresses. Error: An error occurred while attempting a cluster operation. Error: Cluster API '"AddClusterNode() (MaxPercentage=100) failed with 0x5b4. Error: This operation returned because the timeout period expired"' failed. ---> Microsoft.Exchange.Cluster.Replay.AmClusterApiException: An Active Manager operation failed. Error: An error occurred while attempting a cluster operation. Error: Cluster API '"AddClusterNode() (MaxPercentage=100) failed with 0x5b4. Error: This operation returned because the timeout period expired"' failed.. ---> System.ComponentModel.Win32Exception: This operation returned because the timeout period expired --- End of inner exception stack trace --- at Microsoft.Exchange.Cluster.ClusApi.AmCluster.AddNodeToCluster(AmServerName nodeName, IClusterSetupProgress setupProgress, IntPtr context, Exception& errorException, Boolean throwExceptionOnFailure) at Microsoft.Exchange.Cluster.Replay.DagHelper.AddDagClusterNode(AmServerName mailboxServerName, String& verboseLog) --- End of inner exception stack trace (Microsoft.Exchange.Cluster.Replay.AmClusterApiException) --- at Microsoft.Exchange.Cluster.Replay.DagHelper.ThrowDagTaskOperationWrapper(Exception exception) at Microsoft.Exchange.Cluster.Replay.DagHelper.AddDagClusterNode(AmServerName mailboxServerName, String& verboseLog) at Microsoft.Exchange.Cluster.ReplayService.ReplayRpcServer.<>c__DisplayClass34.<RpcsAddNodeToCluster>b__33() at Microsoft.Exchange.Data.Storage.Cluster.HaRpcExceptionWrapperBase`2.RunRpcServerOperation(String databaseName, RpcServerOperation rpcOperation) --- End of stack trace on server (MBXD-01.mydomain.com) --- at Microsoft.Exchange.Data.Storage.Cluster.HaRpcExceptionWrapperBase`2.ClientRethrowIfFailed(String databaseName, String serverName, RpcErrorExceptionInfo errorInfo) at Microsoft.Exchange.Cluster.Replay.ReplayRpcClientWrapper.RunRpcOperationDbName(AmServerName serverName, String databaseName, Int32 timeoutMs, IHaRpcExceptionWrapper rpcExceptionWrapperInstance, InternalRpcOperation rpcOperation) at Microsoft.Exchange.Cluster.Replay.ReplayRpcClientWrapper.RunRpcOperation(AmServerName serverName, Nullable`1 dbGuid, Int32 timeoutMs, IHaRpcExceptionWrapper rpcExceptionWrapperInstance, InternalRpcOperation rpcOperation) at Microsoft.Exchange.Cluster.Replay.ReplayRpcClientWrapper.RunAddNodeToCluster(AmServerName serverName, AmServerName newNode, String& verboseLog) at Microsoft.Exchange.Management.SystemConfigurationTasks.AddDatabaseAvailabilityGroupServer.JoinNodeToCluster() [2011-01-27T04:09:15] Updated Progress 'Done!' 100%. [2011-01-27T04:09:15] COMPLETED add-databaseavailabiltygroupserver explicitly called CloseTempLogFile().
January 26th, 2011 11:17pm

Did you try this more than once? I've seen issues where AD replication doesn't keep up with the wizard. Mike Crowley Check out My Blog!
Free Windows Admin Tool Kit Click here and download it now
January 26th, 2011 11:38pm

Hello, Yes I have tried it several times over more than an hour. Bill
January 26th, 2011 11:42pm

Are you adding the server from the Active Server or from the server you wish to add? Try the latter.Casper Pieterse, Principle Consultant - UC, Dimension Data South Africa, Microsoft Certified Master: Exchange 2007 / 2010
Free Windows Admin Tool Kit Click here and download it now
January 27th, 2011 1:06am

Hello, Here is the add-databaseavailabiltygroupserver command run on the new server itself. Still not completing sucessfully. Any ideas? Bill add-databaseavailabiltygroupserver started on machine MBXD-02. [2011-01-27T12:19:19] add-dagserver started [2011-01-27T12:19:19] commandline: $scriptCmd = {& $wrappedCmd @PSBoundParameters } [2011-01-27T12:19:19] Option 'Identity' = 'dag-1'. [2011-01-27T12:19:19] Option 'MailboxServer' = 'MBXD-02'. [2011-01-27T12:19:19] Option 'DatabaseAvailabilityGroupIpAddresses' = ''. [2011-01-27T12:19:19] Option 'WhatIf' = ''. [2011-01-27T12:19:19] Process: w3wp w3wp.exe:3936. [2011-01-27T12:19:19] User context = 'NT AUTHORITY\SYSTEM'. [2011-01-27T12:19:19] Member of group 'Everyone'. [2011-01-27T12:19:19] Member of group 'BUILTIN\Users'. [2011-01-27T12:19:19] Member of group 'NT AUTHORITY\SERVICE'. [2011-01-27T12:19:19] Member of group 'CONSOLE LOGON'. [2011-01-27T12:19:19] Member of group 'NT AUTHORITY\Authenticated Users'. [2011-01-27T12:19:19] Member of group 'NT AUTHORITY\This Organization'. [2011-01-27T12:19:19] Member of group 'BUILTIN\IIS_IUSRS'. [2011-01-27T12:19:19] Member of group 'LOCAL'. [2011-01-27T12:19:19] Member of group 'IIS APPPOOL\MSExchangePowerShellAppPool'. [2011-01-27T12:19:19] Member of group 'BUILTIN\Administrators'. [2011-01-27T12:19:19] Updated Progress 'Validating the parameters.' 2%. [2011-01-27T12:19:19] Working [2011-01-27T12:19:19] Mailbox server: value passed in = MBXD-02, mailboxServer.Name = MBXD-02, mailboxServer.Fqdn = MBXD-02.mydomain.com [2011-01-27T12:19:19] LogClussvcState: clussvc is Stopped on MBXD-02.mydomain.com. Exception (if any) = none [2011-01-27T12:19:19] The IP addresses for the DAG are (blank means DHCP): 10.16.197.104 [2011-01-27T12:19:19] Looking up IP addresses for dag-1. [2011-01-27T12:19:19] dag-1 = [ 10.16.197.104 ]. [2011-01-27T12:19:19] Looking up IP addresses for mbxd-02. [2011-01-27T12:19:19] mbxd-02 = [ 169.254.62.47, 10.16.197.17, 10.16.101.203, ::1 ]. [2011-01-27T12:19:19] Looking up IP addresses for MBXD-02.mydomain.com. [2011-01-27T12:19:19] MBXD-02.mydomain.com = [ 169.254.62.47, 10.16.197.17, 10.16.101.203, ::1 ]. [2011-01-27T12:19:19] DAG dag-1 has 1 servers: [2011-01-27T12:19:19] DAG dag-1 contains server MBXD-01. [2011-01-27T12:19:19] Updated Progress 'Checking if Mailbox server 'MBXD-02' is in a database availability group.' 4%. [2011-01-27T12:19:19] Working [2011-01-27T12:19:19] GetRemoteCluster() for the mailbox server failed with exception = An Active Manager operation failed. Error: An error occurred while attempting a cluster operation. Error: Cluster API '"OpenCluster(MBXD-02.mydomain.com) failed with 0x6d9. Error: There are no more endpoints available from the endpoint mapper"' failed... This is OK. [2011-01-27T12:19:19] Ignoring previous error, as it is acceptable if the cluster does not exist yet. [2011-01-27T12:19:19] DumpClusterTopology: Opening remote cluster dag-1. [2011-01-27T12:19:19] DumpClusterTopology: Failed opening with Microsoft.Exchange.Cluster.Replay.AmClusterApiException: An Active Manager operation failed. Error: An error occurred while attempting a cluster operation. Error: Cluster API '"OpenCluster(dag-1.mydomain.com) failed with 0x721. Error: A security package specific error occurred"' failed.. ---> System.ComponentModel.Win32Exception: A security package specific error occurred --- End of inner exception stack trace --- at Microsoft.Exchange.Cluster.ClusApi.AmCluster.OpenByName(AmServerName serverName) at Microsoft.Exchange.Management.SystemConfigurationTasks.DumpClusterTopology..ctor(String nameCluster, ITaskOutputHelper output) [2011-01-27T12:19:19] Dumping the cluster by connecting to: dag-1. [2011-01-27T12:19:19] DumpClusterTopology: Not dumping, since the cluster could not be contacted. [2011-01-27T12:19:19] Opening the cluster on nodes [mbxd-01]. [2011-01-27T12:19:19] Other mailbox servers in the DAG are already members of cluster 'dag-1' [2011-01-27T12:19:19] The server MBXD-02 does not belong to a cluster, and the other servers belong to dag-1. [2011-01-27T12:19:19] Successfully resolved the servers based on the stopped servers list. [2011-01-27T12:19:19] The following servers are in the StartedServers list (The list is the StartedServers property of the DAG in AD): [2011-01-27T12:19:19] The following servers are in the StoppedServers list: [2011-01-27T12:19:19] Verifiying that the members of database availability group 'dag-1' are also members of the cluster. [2011-01-27T12:19:19] Verifying that the members of cluster 'dag-1' are also members of the database availability group. [2011-01-27T12:19:19] According to GetNodeClusterState(), the server MBXD-02 is NotConfigured. [2011-01-27T12:19:19] The CNO is currently Failed. [2011-01-27T12:19:19] Network name 'dag-1' is not online. Please check that the IP address configuration for the database availability group is correct. [2011-01-27T12:19:19] InternalValidate() done. [2011-01-27T12:19:19] Updated Progress 'Adding server 'MBXD-02' to database availability group 'dag-1'.' 6%. [2011-01-27T12:19:19] Working [2011-01-27T12:19:19] Updated Progress 'Adding server 'MBXD-02' to the cluster.' 8%. [2011-01-27T12:19:19] Working [2011-01-27T12:25:37] The following log entry comes from a different process that's running on machine 'MBXD-01.mydomain.com'. BEGIN [2011-01-27T12:25:37] [2011-01-27T12:19:19] Opening a local AmCluster handle. [2011-01-27T12:19:19] Updated Progress 'Adding server 'mbxd-02' to database availability group 'dag-1'.' 2%. [2011-01-27T12:19:19] Working [2011-01-27T12:19:19] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseValidateNodeState, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 12, szObjectName = MBXD-02, dwStatus = 0x0 ) [2011-01-27T12:19:19] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseValidateNodeState, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 12, szObjectName = , dwStatus = 0x0 ) [2011-01-27T12:19:19] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseGettingCurrentMembership, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 25, szObjectName = dag-1, dwStatus = 0x0 ) [2011-01-27T12:19:19] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseGettingCurrentMembership, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 25, szObjectName = , dwStatus = 0x0 ) [2011-01-27T12:19:19] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseAddNodeToCluster, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 37, szObjectName = MBXD-02, dwStatus = 0x0 ) [2011-01-27T12:19:20] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseAddNodeToCluster, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 37, szObjectName = , dwStatus = 0x0 ) [2011-01-27T12:19:20] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseValidateNetft, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 50, szObjectName = MBXD-02, dwStatus = 0x0 ) [2011-01-27T12:19:20] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseValidateNetft, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 50, szObjectName = , dwStatus = 0x0 ) [2011-01-27T12:19:20] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseValidateClusDisk, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 62, szObjectName = MBXD-02, dwStatus = 0x0 ) [2011-01-27T12:19:20] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseValidateClusDisk, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 62, szObjectName = , dwStatus = 0x0 ) [2011-01-27T12:19:20] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseConfigureClusSvc, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 75, szObjectName = MBXD-02, dwStatus = 0x0 ) [2011-01-27T12:19:20] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseConfigureClusSvc, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 75, szObjectName = , dwStatus = 0x0 ) [2011-01-27T12:19:20] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseStartingClusSvc, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 87, szObjectName = MBXD-02.mydomain.com, dwStatus = 0x0 ) [2011-01-27T12:19:20] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseStartingClusSvc, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 87, szObjectName = , dwStatus = 0x0 ) [2011-01-27T12:19:20] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseNodeUp, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 100, szObjectName = MBXD-02, dwStatus = 0x0 ) [2011-01-27T12:22:20] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseNodeUp, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseFatal, dwPercentComplete = 100, szObjectName = MBXD-02, dwStatus = 0x5b4 ) [2011-01-27T12:22:20] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseFailureCleanup, ePhaseType = ClusterSetupPhaseStart, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 100, szObjectName = MBXD-02, dwStatus = 0x0 ) [2011-01-27T12:25:37] ClusterSetupProgressCallback( eSetupPhase = ClusterSetupPhaseFailureCleanup, ePhaseType = ClusterSetupPhaseEnd, ePhaseSeverity = ClusterSetupPhaseInformational, dwPercentComplete = 100, szObjectName = , dwStatus = 0x0 ) [2011-01-27T12:25:37] The preceding log entry comes from a different process running on computer 'MBXD-01.mydomain.com'. END [2011-01-27T12:25:37] The operation wasn't successful because an error was encountered. You may find more details in log file "C:\ExchangeSetupLogs\DagTasks\dagtask_2011-01-27_12-19-19.060_add-databaseavailabiltygroupserver.log". [2011-01-27T12:25:37] WriteError! Exception = Microsoft.Exchange.Cluster.Replay.DagTaskOperationFailedException: A server-side database availability group administrative operation failed. Error: The operation failed. CreateCluster errors may result from incorrectly configured static addresses. Error: An error occurred while attempting a cluster operation. Error: Cluster API '"AddClusterNode() (MaxPercentage=100) failed with 0x5b4. Error: This operation returned because the timeout period expired"' failed. ---> Microsoft.Exchange.Cluster.Replay.AmClusterApiException: An Active Manager operation failed. Error: An error occurred while attempting a cluster operation. Error: Cluster API '"AddClusterNode() (MaxPercentage=100) failed with 0x5b4. Error: This operation returned because the timeout period expired"' failed.. ---> System.ComponentModel.Win32Exception: This operation returned because the timeout period expired --- End of inner exception stack trace --- at Microsoft.Exchange.Cluster.ClusApi.AmCluster.AddNodeToCluster(AmServerName nodeName, IClusterSetupProgress setupProgress, IntPtr context, Exception& errorException, Boolean throwExceptionOnFailure) at Microsoft.Exchange.Cluster.Replay.DagHelper.AddDagClusterNode(AmServerName mailboxServerName, String& verboseLog) --- End of inner exception stack trace (Microsoft.Exchange.Cluster.Replay.AmClusterApiException) --- at Microsoft.Exchange.Cluster.Replay.DagHelper.ThrowDagTaskOperationWrapper(Exception exception) at Microsoft.Exchange.Cluster.Replay.DagHelper.AddDagClusterNode(AmServerName mailboxServerName, String& verboseLog) at Microsoft.Exchange.Cluster.ReplayService.ReplayRpcServer.<>c__DisplayClass34.<RpcsAddNodeToCluster>b__33() at Microsoft.Exchange.Data.Storage.Cluster.HaRpcExceptionWrapperBase`2.RunRpcServerOperation(String databaseName, RpcServerOperation rpcOperation) --- End of stack trace on server (MBXD-01.mydomain.com) --- at Microsoft.Exchange.Data.Storage.Cluster.HaRpcExceptionWrapperBase`2.ClientRethrowIfFailed(String databaseName, String serverName, RpcErrorExceptionInfo errorInfo) at Microsoft.Exchange.Cluster.Replay.ReplayRpcClientWrapper.RunRpcOperationDbName(AmServerName serverName, String databaseName, Int32 timeoutMs, IHaRpcExceptionWrapper rpcExceptionWrapperInstance, InternalRpcOperation rpcOperation) at Microsoft.Exchange.Cluster.Replay.ReplayRpcClientWrapper.RunRpcOperation(AmServerName serverName, Nullable`1 dbGuid, Int32 timeoutMs, IHaRpcExceptionWrapper rpcExceptionWrapperInstance, InternalRpcOperation rpcOperation) at Microsoft.Exchange.Cluster.Replay.ReplayRpcClientWrapper.RunAddNodeToCluster(AmServerName serverName, AmServerName newNode, String& verboseLog) at Microsoft.Exchange.Management.SystemConfigurationTasks.AddDatabaseAvailabilityGroupServer.JoinNodeToCluster() [2011-01-27T12:25:37] Updated Progress 'Done!' 100%. [2011-01-27T12:25:37] COMPLETED add-databaseavailabiltygroupserver explicitly called CloseTempLogFile().
January 27th, 2011 7:33am

DumpClusterTopology: Failed opening with Microsoft.Exchange.Cluster.Replay.AmClusterApiException: An Active Manager operation failed. Error: An error occurred while attempting a cluster operation. Error: Cluster API '"OpenCluster(dag-1.mydomain.com) failed with 0x721. Error: A security package specific error occurred"' failed …….. The CNO is currently Failed …….. Network name 'dag-1' is not online. Please check that the IP address configuration for the database availability group is correct According to the error above, MBXD-02 has some trouble to contact dag-1. Please verify if there’s any issue to contact dag-1’s NetBOIS or FQDN from MBXD-02 Please run “DCDiag /v /a” and “NetDiag /v” to check the health of DC and connection to DC from MBXD-02 Please check the status of all resources in the “Failover Cluster Management” console Please check the IP configuration as mentioned in error information Deploying High Availability and Site Resilience Also, I saw “169.254.62.47” IP address in the log, why you have such IP address on MBXD-02? James Luo TechNet Subscriber Support in forum If you have any feedback on our support, please contact tngfb@microsoft.com Please remember to click Mark as Answer on the post that helps you, and to click Unmark as Answer if a marked post does not actually answer your question. This can be beneficial to other community members reading the thread.
Free Windows Admin Tool Kit Click here and download it now
January 27th, 2011 10:48pm

This topic is archived. No further replies will be accepted.

Other recent topics Other recent topics