All Management Server Pool Unavailable

I have SCOM 2012 R2 RU5 and have the following problem in my test enviroment:

In the active alerts I got an alert "All Management Servers Pool Unavailable. When I look at the Management Group Health, all show gray icons. Also when I deploy an agent it says "Success" but it does not appear in agent managed devices. It stays in Pending, which is weird because it sayd success. When I check the server, the agent is there.

Now I'm not 100% sure if it has anything to do with it, but we just migrated our Operational Database. I did al the regkeys and config file adjustments.

July 30th, 2015 10:38am

Hi,

As your Management Pool is greyed out, so agent will not be able to communicate with the Management servers due to which installation is not displaying in the pending management. 

Please rectify the health of your management servers at the earliest.

Free Windows Admin Tool Kit Click here and download it now
July 30th, 2015 11:35am

All Management Servers Pool Unavailable. When I look at the Management Group Health, all show gray icons.  This means that your management server has issue and you need to troubleshoot Management server. At first, make sure that all management is in monitored state which means that it does not show grey sign. For troubleshoot grey agent, pls. refer to the following post:
https://technet.microsoft.com/en-us/library/hh212723.aspx
https://support.microsoft.com/en-us/kb/2288515
Then you go to Administration workspace --> agent Managed to check whether your installed agent is in agent managed view or pending view. By default, SCOM automatic approve agent which is installed by using agent discovery method. If you manual install agent, you should manual approve the agent under the condition that the SCOM global management server security setting is Review new manual agent installations in pending management view.

roger

July 30th, 2015 11:24pm

When I look at Management servers under the Administration pane, it shows healthy. (In this test enviroment I only have 1 MS). The agents that stay in pending are deployed with SCOM, so no manual agents. I do see some SQL related errors in the eventlog, I'm going to have a look at it.
Free Windows Admin Tool Kit Click here and download it now
July 31st, 2015 4:14am

Hi,

Please take a look at the events and provide the event ID and description.

July 31st, 2015 9:24am

Hi, I did, but haven't been able to fix the problem. I found a solution on Google for someone who upgraded the database where the Compatibility settings of the database were wrong. I checked this, it was still on 2008 from our previous database, changed it to 2012, bot no luck.

Also I found someone who said this: I found out if you define the instance name in the setup when you're using the default instance it will generate the error. So if you're using the default instancedo not add the instance name in the setup.

But we do have a named instance, so this doesn't apply to us.

Here is the event error I see every 10 minutes:

Log Name:      Operations Manager
Source:        OpsMgr Management Configuration
Date:          4-8-2015 15:22:48
Event ID:      29112
Task Category: None
Level:         Error
Keywords:      Classic
User:          N/A
Computer:      x
Description:
OpsMgr Management Configuration Service failed to execute bootstrap work item 'ConfigurationDataProviderInitializeWorkItem' due to the following exception

System.Data.SqlClient.SqlException (0x80131904): A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the instance name is correct and that SQL Server is configured to allow remote connections. (provider: Named Pipes Provider, error: 40 - Could not open a connection to SQL Server) ---> System.ComponentModel.Win32Exception (0x80004005): The system cannot find the file specified
   at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction)
   at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose)
   at System.Data.SqlClient.TdsParser.Connect(ServerInfo serverInfo, SqlInternalConnectionTds connHandler, Boolean ignoreSniOpenTimeout, Int64 timerExpire, Boolean encrypt, Boolean trustServerCert, Boolean integratedSecurity, Boolean withFailover)
   at System.Data.SqlClient.SqlInternalConnectionTds.AttemptOneLogin(ServerInfo serverInfo, String newPassword, SecureString newSecurePassword, Boolean ignoreSniOpenTimeout, TimeoutTimer timeout, Boolean withFailover)
   at System.Data.SqlClient.SqlInternalConnectionTds.LoginNoFailover(ServerInfo serverInfo, String newPassword, SecureString newSecurePassword, Boolean redirectedUserInstance, SqlConnectionString connectionOptions, SqlCredential credential, TimeoutTimer timeout)
   at System.Data.SqlClient.SqlInternalConnectionTds.OpenLoginEnlist(TimeoutTimer timeout, SqlConnectionString connectionOptions, SqlCredential credential, String newPassword, SecureString newSecurePassword, Boolean redirectedUserInstance)
   at System.Data.SqlClient.SqlInternalConnectionTds..ctor(DbConnectionPoolIdentity identity, SqlConnectionString connectionOptions, SqlCredential credential, Object providerInfo, String newPassword, SecureString newSecurePassword, Boolean redirectedUserInstance, SqlConnectionString userConnectionOptions, SessionData reconnectSessionData)
   at System.Data.SqlClient.SqlConnectionFactory.CreateConnection(DbConnectionOptions options, DbConnectionPoolKey poolKey, Object poolGroupProviderInfo, DbConnectionPool pool, DbConnection owningConnection, DbConnectionOptions userOptions)
   at System.Data.ProviderBase.DbConnectionFactory.CreatePooledConnection(DbConnectionPool pool, DbConnection owningObject, DbConnectionOptions options, DbConnectionPoolKey poolKey, DbConnectionOptions userOptions)
   at System.Data.ProviderBase.DbConnectionPool.CreateObject(DbConnection owningObject, DbConnectionOptions userOptions, DbConnectionInternal oldConnection)
   at System.Data.ProviderBase.DbConnectionPool.UserCreateRequest(DbConnection owningObject, DbConnectionOptions userOptions, DbConnectionInternal oldConnection)
   at System.Data.ProviderBase.DbConnectionPool.TryGetConnection(DbConnection owningObject, UInt32 waitForMultipleObjectsTimeout, Boolean allowCreate, Boolean onlyOneCheckConnection, DbConnectionOptions userOptions, DbConnectionInternal& connection)
   at System.Data.ProviderBase.DbConnectionPool.TryGetConnection(DbConnection owningObject, TaskCompletionSource`1 retry, DbConnectionOptions userOptions, DbConnectionInternal& connection)
   at System.Data.ProviderBase.DbConnectionFactory.TryGetConnection(DbConnection owningConnection, TaskCompletionSource`1 retry, DbConnectionOptions userOptions, DbConnectionInternal oldConnection, DbConnectionInternal& connection)
   at System.Data.ProviderBase.DbConnectionInternal.TryOpenConnectionInternal(DbConnection outerConnection, DbConnectionFactory connectionFactory, TaskCompletionSource`1 retry, DbConnectionOptions userOptions)
   at System.Data.SqlClient.SqlConnection.TryOpenInner(TaskCompletionSource`1 retry)
   at System.Data.SqlClient.SqlConnection.TryOpen(TaskCompletionSource`1 retry)
   at System.Data.SqlClient.SqlConnection.Open()
   at Microsoft.EnterpriseManagement.ManagementConfiguration.DataAccessLayer.ConnectionManagementOperation.Execute()
   at Microsoft.EnterpriseManagement.ManagementConfiguration.DataAccessLayer.DataAccessOperation.ExecuteSynchronously(Int32 timeoutSeconds, WaitHandle stopWaitHandle)
   at Microsoft.EnterpriseManagement.ManagementConfiguration.CmdbOperations.CmdbDataProvider.Initialize()
   at Microsoft.EnterpriseManagement.ManagementConfiguration.Engine.ConfigurationDataProviderInitializeWorkItem.ExecuteWorkItem()
   at Microsoft.EnterpriseManagement.ManagementConfiguration.Interop.ConfigServiceEngineWorkItem.Execute()
ClientConnectionId:00000000-0000-0000-0000-000000000000
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
  <System>
    <Provider Name="OpsMgr Management Configuration" />
    <EventID Qualifiers="49152">29112</EventID>
    <Level>2</Level>
    <Task>0</Task>
    <Keywords>0x80000000000000</Keywords>
    <TimeCreated SystemTime="2015-08-04T13:22:48.000000000Z" />
    <EventRecordID>100327</EventRecordID>
    <Channel>Operations Manager</Channel>
    <Computer>x</Computer>
    <Security />
  </System>
  <EventData>
    <Data>OpsMgr Management Configuration Service</Data>
    <Data>ConfigurationDataProviderInitializeWorkItem</Data>
    <Data>System.Data.SqlClient.SqlException (0x80131904): A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the instance name is correct and that SQL Server is configured to allow remote connections. (provider: Named Pipes Provider, error: 40 - Could not open a connection to SQL Server) ---&gt; System.ComponentModel.Win32Exception (0x80004005): The system cannot find the file specified
   at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction)
   at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose)
   at System.Data.SqlClient.TdsParser.Connect(ServerInfo serverInfo, SqlInternalConnectionTds connHandler, Boolean ignoreSniOpenTimeout, Int64 timerExpire, Boolean encrypt, Boolean trustServerCert, Boolean integratedSecurity, Boolean withFailover)
   at System.Data.SqlClient.SqlInternalConnectionTds.AttemptOneLogin(ServerInfo serverInfo, String newPassword, SecureString newSecurePassword, Boolean ignoreSniOpenTimeout, TimeoutTimer timeout, Boolean withFailover)
   at System.Data.SqlClient.SqlInternalConnectionTds.LoginNoFailover(ServerInfo serverInfo, String newPassword, SecureString newSecurePassword, Boolean redirectedUserInstance, SqlConnectionString connectionOptions, SqlCredential credential, TimeoutTimer timeout)
   at System.Data.SqlClient.SqlInternalConnectionTds.OpenLoginEnlist(TimeoutTimer timeout, SqlConnectionString connectionOptions, SqlCredential credential, String newPassword, SecureString newSecurePassword, Boolean redirectedUserInstance)
   at System.Data.SqlClient.SqlInternalConnectionTds..ctor(DbConnectionPoolIdentity identity, SqlConnectionString connectionOptions, SqlCredential credential, Object providerInfo, String newPassword, SecureString newSecurePassword, Boolean redirectedUserInstance, SqlConnectionString userConnectionOptions, SessionData reconnectSessionData)
   at System.Data.SqlClient.SqlConnectionFactory.CreateConnection(DbConnectionOptions options, DbConnectionPoolKey poolKey, Object poolGroupProviderInfo, DbConnectionPool pool, DbConnection owningConnection, DbConnectionOptions userOptions)
   at System.Data.ProviderBase.DbConnectionFactory.CreatePooledConnection(DbConnectionPool pool, DbConnection owningObject, DbConnectionOptions options, DbConnectionPoolKey poolKey, DbConnectionOptions userOptions)
   at System.Data.ProviderBase.DbConnectionPool.CreateObject(DbConnection owningObject, DbConnectionOptions userOptions, DbConnectionInternal oldConnection)
   at System.Data.ProviderBase.DbConnectionPool.UserCreateRequest(DbConnection owningObject, DbConnectionOptions userOptions, DbConnectionInternal oldConnection)
   at System.Data.ProviderBase.DbConnectionPool.TryGetConnection(DbConnection owningObject, UInt32 waitForMultipleObjectsTimeout, Boolean allowCreate, Boolean onlyOneCheckConnection, DbConnectionOptions userOptions, DbConnectionInternal&amp; connection)
   at System.Data.ProviderBase.DbConnectionPool.TryGetConnection(DbConnection owningObject, TaskCompletionSource`1 retry, DbConnectionOptions userOptions, DbConnectionInternal&amp; connection)
   at System.Data.ProviderBase.DbConnectionFactory.TryGetConnection(DbConnection owningConnection, TaskCompletionSource`1 retry, DbConnectionOptions userOptions, DbConnectionInternal oldConnection, DbConnectionInternal&amp; connection)
   at System.Data.ProviderBase.DbConnectionInternal.TryOpenConnectionInternal(DbConnection outerConnection, DbConnectionFactory connectionFactory, TaskCompletionSource`1 retry, DbConnectionOptions userOptions)
   at System.Data.SqlClient.SqlConnection.TryOpenInner(TaskCompletionSource`1 retry)
   at System.Data.SqlClient.SqlConnection.TryOpen(TaskCompletionSource`1 retry)
   at System.Data.SqlClient.SqlConnection.Open()
   at Microsoft.EnterpriseManagement.ManagementConfiguration.DataAccessLayer.ConnectionManagementOperation.Execute()
   at Microsoft.EnterpriseManagement.ManagementConfiguration.DataAccessLayer.DataAccessOperation.ExecuteSynchronously(Int32 timeoutSeconds, WaitHandle stopWaitHandle)
   at Microsoft.EnterpriseManagement.ManagementConfiguration.CmdbOperations.CmdbDataProvider.Initialize()
   at Microsoft.EnterpriseManagement.ManagementConfiguration.Engine.ConfigurationDataProviderInitializeWorkItem.ExecuteWorkItem()
   at Microsoft.EnterpriseManagement.ManagementConfiguration.Interop.ConfigServiceEngineWorkItem.Execute()
ClientConnectionId:00000000-0000-0000-0000-000000000000</Data>
  </EventData>
</Event>

Free Windows Admin Tool Kit Click here and download it now
August 4th, 2015 9:57am

Hi,

Could you please check the TCP connection of SQL DB from SQL server connection manager?

Additionally, check the status of your databases through sp_helpDB

August 4th, 2015 12:27pm

Hi, TCP is enabled and also Allow remote connections is enabled.
Free Windows Admin Tool Kit Click here and download it now
August 6th, 2015 10:04am

Was there any change done in the SCOM environment ? Was this working fine before ?
August 6th, 2015 4:20pm

There could be issue with synchronization. Please execute the sync stored procedure in opsDB
Free Windows Admin Tool Kit Click here and download it now
August 7th, 2015 2:23am

Was there any change done in the SCOM environment ? Was this working fin
August 7th, 2015 2:52am

There could be issue with synchronization. Please execute the sync stored procedure in opsDB

That doesn't seem to be the problem..
Free Windows Admin Tool Kit Click here and download it now
August 7th, 2015 5:46am

Hi

If you have moved the database then have you followed all the steps:

https://technet.microsoft.com/en-us/library/hh278848.aspx?f=255&MSPPError=-2147217396

1. Updating registry Keys

Update the registry to refer to the new SQL Server-based computer.

System_CAPS_noteNote

Before editing the registry, follow your organizations backup policies with regard to the registry.

  1. Log on to the management server with Administrator permissions.

  2. Click Start, select Run, type regedit in the Open box, and then click OK to start Registry Editor.

  3. Navigate to HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Microsoft Operations Manager\3.0\Setup.

  4. For each of the following keys, double-click the name, change the value to the hostname of the SQL Server-based computer now hosting the operational database, and then click OK to save your changes.

    • DatabaseName

    • DatabaseServerName

      System_CAPS_noteNote

      If you are using a named instance of SQL Server, be sure to use the ServerName\Instance name format.

  5. Navigate to HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\System Center\2010\Common\Database and repeat step d.

  6. Close the Registry Editor.

2. Updating Config Settings

On each management server, edit the following file:

%ProgramFiles%\System Center 2012\Operations Manager\Server\ConfigService.config 

In the <Category> tags named Cmdb and ConfigStore, change the value for ServerName to the name of the new SQL server.

I have been working recently with a customer who had the same issue and they had missed item 2.

Cheers

Graham

August 7th, 2015 10:43am

Please check if this can help you:

Symptom:

Management Group is unhealthy/grey with Resource Pools being unavailable &  Getting events 26319 on SCOM management server

Cause: # Error :

OpsMgr Management Configuration Service

Microsoft.EnterpriseManagement.ManagementConfiguration.DataAccessLayer.DataAccessOperationAbortedException: Exception of type 'Microsoft.EnterpriseManagement.ManagementConfiguration.DataAccessLayer.DataAccessOperationAbortedException' was thrown.

   at Microsoft.EnterpriseManagement.ManagementConfiguration.DataAccessLayer.DataAccessOperation.ExecuteSynchronously(Int32 timeoutSeconds, WaitHandle stopWaitHandle)

   at Microsoft.EnterpriseManagement.ManagementConfiguration.SqlConfigurationStore.ConfigurationStore.ExecuteOperationSynchronously(IDataAccessConnectedOperation operation, String operationName)

   at Microsoft.EnterpriseManagement.ManagementConfiguration.SqlConfigurationStore.ConfigurationStore.GetConfiguration(IDictionary`2 agentList, ConfigurationSignature configurationSignature)

   at Microsoft.EnterpriseManagement.ManagementConfiguration.Engine.AgentRequestProcessor.ProcessConfigurationRequest(ICollection`1 requestList, Int32& processedRequestsCount)

   at Microsoft.EnterpriseManagement.ManagementConfiguration.Engine.AgentRequestProcessor.Execute()

   at Microsoft.EnterpriseManagement.ManagementConfiguration.Engine.ThreadManager.ResponseThreadStart(Object state

Resolution:

# R\un stored proc

exec cs.SnapshotSynchronizationForce

exec CS.SnapshotSynchronizationStart 

Free Windows Admin Tool Kit Click here and download it now
August 21st, 2015 8:19am

This topic is archived. No further replies will be accepted.

Other recent topics Other recent topics