Hello I have an Exchange 2007 CCR node and no matter which node is active the mailbox assistant is generating lots of event ID9040 errors. If I restart the service I get a 4999 watson dw20.exe error too. The CCR node is ADsite1 and a CAS,HT,MB is in ADSite2. That server is working fine, only the CCR nodes arent. I found a few links they all said RU9 fixed this, but I'm on SP2 RU4 on all my 2007 boxes. Any suggestions would be great, might have to turn on advanced logging, but seems something with the watson is causing the issue to begin with. ========================== Log Name: ApplicationSource: MSExchange AssistantsDate: 4/22/2010 10:36:15 PMEvent ID: 9040Task Category: AssistantsLevel: ErrorKeywords: ClassicUser: N/AComputer: E2K7CCR1-01.thedigitalpostman.comDescription:Service MSExchangeMailboxAssistants. An error has been detected due to this exception: Microsoft.Exchange.Assistants.AIGrayException ---> Microsoft.Exchange.Common.GrayException ---> Microsoft.Exchange.Data.Storage.ObjectNotFoundException: Could not get properties. ---> Microsoft.Mapi.MapiExceptionNotFound: MapiExceptionNotFound: Unable to get properties on object. (hr=0x80004005, ec=-1601)Diagnostic context: Lid: 18969 EcDoRpcExt2 called [length=472] Lid: 27161 EcDoRpcExt2 returned [ec=0x0][length=378][latency=0] Lid: 23226 --- ROP Parse Start --- Lid: 27962 ROP: ropOpenMessage [3] Lid: 17082 ROP Error: 0xFFFFF9BF Lid: 26977 Lid: 21921 StoreEc: 0xFFFFF9BF Lid: 27962 ROP: ropExtendedError [250] Lid: 1494 ---- Remote Context Beg ---- Lid: 1238 Remote Context Overflow Lid: 8660 StoreEc: 0x8004010F PropTag: 0x672D0003 Lid: 23921 StoreEc: 0x3EC Lid: 21970 StoreEc: 0x8004010F PropTag: 0x668F0040 Lid: 14164 StoreEc: 0xFFFFFA1D PropTag: 0x672D0003 Lid: 8660 StoreEc: 0x8004010F PropTag: 0x672D0003 Lid: 21970 StoreEc: 0x8004010F PropTag: 0x672D0003 Lid: 23921 StoreEc: 0x3EC Lid: 21970 StoreEc: 0x8004010F PropTag: 0x672F0014 Lid: 23921 StoreEc: 0x3EC Lid: 21970 StoreEc: 0x8004010F PropTag: 0x67A40014 Lid: 23921 StoreEc: 0x3EC Lid: 21970 StoreEc: 0x8004010F PropTag: 0x6708000B Lid: 23921 StoreEc: 0x3EC Lid: 21970 StoreEc: 0x8004010F PropTag: 0x674B0014 Lid: 21097 Lid: 8756 StoreEc: 0xFFFFF9BF Lid: 4353 StoreEc: 0xFFFFF9BF Lid: 17114 Lid: 6153 StoreEc: 0xFFFFF9BF Lid: 21810 Lid: 5249 StoreEc: 0xFFFFF9BF Lid: 1750 ---- Remote Context End ---- Lid: 27962 ROP: ropGetPropsSpecific [7] Lid: 17082 ROP Error: 0x4B9 Lid: 26465 Lid: 21921 StoreEc: 0x4B9 Lid: 27962 ROP: ropExtendedError [250] Lid: 1494 ---- Remote Context Beg ---- Lid: 26426 ROP: ropGetPropsSpecific [7] Lid: 1750 ---- Remote Context End ---- Lid: 26849 Lid: 21817 ROP Failure: 0x4B9 Lid: 20385 Lid: 28577 StoreEc: 0xFFFFF9BF Lid: 32001 Lid: 29953 StoreEc: 0xFFFFF9BF at Microsoft.Mapi.MapiExceptionHelper.ThrowIfError(String message, Int32 hresult, Object objLastErrorInfo) at Microsoft.Mapi.MapiProp.GetProps(PropTag[] propTagsRequested) at Microsoft.Exchange.Data.Storage.MapiPropertyBag.GetProperties(IList`1 propertyDefinitions) --- End of inner exception stack trace --- at Microsoft.Exchange.Data.Storage.MapiPropertyBag.GetProperties(IList`1 propertyDefinitions) at Microsoft.Exchange.Data.Storage.StoreObjectPropertyBag.InternalLoad(PropertyDefinition[] properties, Boolean forceReload) at Microsoft.Exchange.Data.Storage.StoreObjectPropertyBag..ctor(StoreSession session, MapiProp mapiProp, Origin origin, PropertyDefinition[] autoloadProperties, Boolean canSaveOrDisposeMapiProp) at Microsoft.Exchange.Data.Storage.StoreObjectPropertyBag..ctor(StoreSession session, MapiProp mapiProp, Origin origin, PropertyDefinition[] autoloadProperties) at Microsoft.Exchange.Data.Storage.Item.InternalBindItem(StoreSession session, StoreObjectId itemId, Byte[] changeKey, ItemBindOption itemBindOption, PropertyDefinition[] allPropsToLoad) at Microsoft.Exchange.Data.Storage.Item.InternalBind[T](StoreSession session, StoreId id, ItemBindOption itemBindOption, PropertyDefinition[] allPropsToLoad) at Microsoft.Exchange.Data.Storage.Item.InternalBind[T](StoreSession session, StoreId id, PropertyDefinition[] allPropsToLoad) at Microsoft.Exchange.InfoWorker.Common.SingleInstanceItemHandler.UpdateRetryable(MailboxSession itemStore, Boolean getExisting, ContentUpdater updater) at Microsoft.Exchange.InfoWorker.Common.SingleInstanceItemHandler.Update(MailboxSession itemStore, Boolean getExisting, ContentUpdater updater) at Microsoft.Exchange.InfoWorker.Assistants.OOF.OofScheduleStore.Save(List`1 actions) at Microsoft.Exchange.InfoWorker.Assistants.OOF.OofScheduleStore.ScanForScheduledOof() at Microsoft.Exchange.InfoWorker.Assistants.OOF.OofScheduleStore.Load(Boolean useCache) at Microsoft.Exchange.InfoWorker.Assistants.OOF.OofScheduler..ctor(DatabaseInfo databaseInfo, Boolean useCache) at Microsoft.Exchange.InfoWorker.Assistants.OOF.OofAssistant.OnStartInternal(EventBasedStartInfo startInfo) at Microsoft.Exchange.InfoWorker.Assistants.EventBasedAssistant.OnStart(EventBasedStartInfo startInfo) at Microsoft.Exchange.Assistants.EventBasedAssistantCollection.StartAssistants(EventBasedStartInfo startInfo) at Microsoft.Exchange.Assistants.EventController.Start() at Microsoft.Exchange.Assistants.OnlineDatabase.Start() at Microsoft.Exchange.Assistants.Util.<>c__DisplayClass2.<CatchMeIfYouCan>b__0() at Microsoft.Exchange.Common.IL.ILUtil.DoTryFilterCatch(TryDelegate tryDelegate, FilterDelegate filterDelegate, CatchDelegate catchDelegate) --- End of inner exception stack trace --- at Microsoft.Exchange.Common.GrayException.ExceptionCatcher(Object exception) at Microsoft.Exchange.Common.IL.ILUtil.DoTryFilterCatch(TryDelegate tryDelegate, FilterDelegate filterDelegate, CatchDelegate catchDelegate) at Microsoft.Exchange.Common.GrayException.MapAndReportGrayExceptions(UserCodeDelegate tryCode) at Microsoft.Exchange.Assistants.Util.CatchMeIfYouCan(CatchMe function) --- End of inner exception stack trace --- at Microsoft.Exchange.Assistants.Util.CatchMeIfYouCan(CatchMe function) at Microsoft.Exchange.Assistants.Base.CatchMeIfYouCan(CatchMe function).Event Xml:<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event"> <System> <Provider Name="MSExchange Assistants" /> <EventID Qualifiers="49156">9040</EventID> <Level>2</Level> <Task>1</Task> <Keywords>0x80000000000000</Keywords> <TimeCreated SystemTime="2010-04-22T14:36:15.000Z" /> <EventRecordID>19959</EventRecordID> <Channel>Application</Channel> <Computer>E2K7CCR1-01.thedigitalpostman.com</Computer> <Security /> </System> <EventData> <Data>MSExchangeMailboxAssistants</Data> <Data>Microsoft.Exchange.Assistants.AIGrayException ---&gt; Microsoft.Exchange.Common.GrayException ---&gt; Microsoft.Exchange.Data.Storage.ObjectNotFoundException: Could not get properties. ---&gt; Microsoft.Mapi.MapiExceptionNotFound: MapiExceptionNotFound: Unable to get properties on object. (hr=0x80004005, ec=-1601)Diagnostic context: Lid: 18969 EcDoRpcExt2 called [length=472] Lid: 27161 EcDoRpcExt2 returned [ec=0x0][length=378][latency=0] Lid: 23226 --- ROP Parse Start --- Lid: 27962 ROP: ropOpenMessage [3] Lid: 17082 ROP Error: 0xFFFFF9BF Lid: 26977 Lid: 21921 StoreEc: 0xFFFFF9BF Lid: 27962 ROP: ropExtendedError [250] Lid: 1494 ---- Remote Context Beg ---- Lid: 1238 Remote Context Overflow Lid: 8660 StoreEc: 0x8004010F PropTag: 0x672D0003 Lid: 23921 StoreEc: 0x3EC Lid: 21970 StoreEc: 0x8004010F PropTag: 0x668F0040 Lid: 14164 StoreEc: 0xFFFFFA1D PropTag: 0x672D0003 Lid: 8660 StoreEc: 0x8004010F PropTag: 0x672D0003 Lid: 21970 StoreEc: 0x8004010F PropTag: 0x672D0003 Lid: 23921 StoreEc: 0x3EC Lid: 21970 StoreEc: 0x8004010F PropTag: 0x672F0014 Lid: 23921 StoreEc: 0x3EC Lid: 21970 StoreEc: 0x8004010F PropTag: 0x67A40014 Lid: 23921 StoreEc: 0x3EC Lid: 21970 StoreEc: 0x8004010F PropTag: 0x6708000B Lid: 23921 StoreEc: 0x3EC Lid: 21970 StoreEc: 0x8004010F PropTag: 0x674B0014 Lid: 21097 Lid: 8756 StoreEc: 0xFFFFF9BF Lid: 4353 StoreEc: 0xFFFFF9BF Lid: 17114 Lid: 6153 StoreEc: 0xFFFFF9BF Lid: 21810 Lid: 5249 StoreEc: 0xFFFFF9BF Lid: 1750 ---- Remote Context End ---- Lid: 27962 ROP: ropGetPropsSpecific [7] Lid: 17082 ROP Error: 0x4B9 Lid: 26465 Lid: 21921 StoreEc: 0x4B9 Lid: 27962 ROP: ropExtendedError [250] Lid: 1494 ---- Remote Context Beg ---- Lid: 26426 ROP: ropGetPropsSpecific [7] Lid: 1750 ---- Remote Context End ---- Lid: 26849 Lid: 21817 ROP Failure: 0x4B9 Lid: 20385 Lid: 28577 StoreEc: 0xFFFFF9BF Lid: 32001 Lid: 29953 StoreEc: 0xFFFFF9BF at Microsoft.Mapi.MapiExceptionHelper.ThrowIfError(String message, Int32 hresult, Object objLastErrorInfo) at Microsoft.Mapi.MapiProp.GetProps(PropTag[] propTagsRequested) at Microsoft.Exchange.Data.Storage.MapiPropertyBag.GetProperties(IList`1 propertyDefinitions) --- End of inner exception stack trace --- at Microsoft.Exchange.Data.Storage.MapiPropertyBag.GetProperties(IList`1 propertyDefinitions) at Microsoft.Exchange.Data.Storage.StoreObjectPropertyBag.InternalLoad(PropertyDefinition[] properties, Boolean forceReload) at Microsoft.Exchange.Data.Storage.StoreObjectPropertyBag..ctor(StoreSession session, MapiProp mapiProp, Origin origin, PropertyDefinition[] autoloadProperties, Boolean canSaveOrDisposeMapiProp) at Microsoft.Exchange.Data.Storage.StoreObjectPropertyBag..ctor(StoreSession session, MapiProp mapiProp, Origin origin, PropertyDefinition[] autoloadProperties) at Microsoft.Exchange.Data.Storage.Item.InternalBindItem(StoreSession session, StoreObjectId itemId, Byte[] changeKey, ItemBindOption itemBindOption, PropertyDefinition[] allPropsToLoad) at Microsoft.Exchange.Data.Storage.Item.InternalBind[T](StoreSession session, StoreId id, ItemBindOption itemBindOption, PropertyDefinition[] allPropsToLoad) at Microsoft.Exchange.Data.Storage.Item.InternalBind[T](StoreSession session, StoreId id, PropertyDefinition[] allPropsToLoad) at Microsoft.Exchange.InfoWorker.Common.SingleInstanceItemHandler.UpdateRetryable(MailboxSession itemStore, Boolean getExisting, ContentUpdater updater) at Microsoft.Exchange.InfoWorker.Common.SingleInstanceItemHandler.Update(MailboxSession itemStore, Boolean getExisting, ContentUpdater updater) at Microsoft.Exchange.InfoWorker.Assistants.OOF.OofScheduleStore.Save(List`1 actions) at Microsoft.Exchange.InfoWorker.Assistants.OOF.OofScheduleStore.ScanForScheduledOof() at Microsoft.Exchange.InfoWorker.Assistants.OOF.OofScheduleStore.Load(Boolean useCache) at Microsoft.Exchange.InfoWorker.Assistants.OOF.OofScheduler..ctor(DatabaseInfo databaseInfo, Boolean useCache) at Microsoft.Exchange.InfoWorker.Assistants.OOF.OofAssistant.OnStartInternal(EventBasedStartInfo startInfo) at Microsoft.Exchange.InfoWorker.Assistants.EventBasedAssistant.OnStart(EventBasedStartInfo startInfo) at Microsoft.Exchange.Assistants.EventBasedAssistantCollection.StartAssistants(EventBasedStartInfo startInfo) at Microsoft.Exchange.Assistants.EventController.Start() at Microsoft.Exchange.Assistants.OnlineDatabase.Start() at Microsoft.Exchange.Assistants.Util.&lt;&gt;c__DisplayClass2.&lt;CatchMeIfYouCan&gt;b__0() at Microsoft.Exchange.Common.IL.ILUtil.DoTryFilterCatch(TryDelegate tryDelegate, FilterDelegate filterDelegate, CatchDelegate catchDelegate) --- End of inner exception stack trace --- at Microsoft.Exchange.Common.GrayException.ExceptionCatcher(Object exception) at Microsoft.Exchange.Common.IL.ILUtil.DoTryFilterCatch(TryDelegate tryDelegate, FilterDelegate filterDelegate, CatchDelegate catchDelegate) at Microsoft.Exchange.Common.GrayException.MapAndReportGrayExceptions(UserCodeDelegate tryCode) at Microsoft.Exchange.Assistants.Util.CatchMeIfYouCan(CatchMe function) --- End of inner exception stack trace --- at Microsoft.Exchange.Assistants.Util.CatchMeIfYouCan(CatchMe function) at Microsoft.Exchange.Assistants.Base.CatchMeIfYouCan(CatchMe function)</Data> </EventData></Event> ============ Log Name: ApplicationSource: MSExchange CommonDate: 4/22/2010 10:36:11 PMEvent ID: 4999Task Category: GeneralLevel: ErrorKeywords: ClassicUser: N/AComputer: E2K7CCR1-01.thedigitalpostman.comDescription:Watson report about to be sent to dw20.exe for process id: 4248, with parameters: E12, c-RTL-AMD64, 08.02.0254.000, MSExchangeMailboxAssistants, M.E.StoreProvider, M.M.MapiProp.GetProps, M.Mapi.MapiExceptionNotFound, 9415, 08.02.0253.000. ErrorReportingEnabled: TrueEvent Xml:<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event"> <System> <Provider Name="MSExchange Common" /> <EventID Qualifiers="16388">4999</EventID> <Level>2</Level> <Task>1</Task> <Keywords>0x80000000000000</Keywords> <TimeCreated SystemTime="2010-04-22T14:36:11.000Z" /> <EventRecordID>19958</EventRecordID> <Channel>Application</Channel> <Computer>E2K7CCR1-01.thedigitalpostman.com</Computer> <Security /> </System> <EventData> <Data>4248</Data> <Data>E12</Data> <Data>c-RTL-AMD64</Data> <Data>08.02.0254.000</Data> <Data>MSExchangeMailboxAssistants</Data> <Data>M.E.StoreProvider</Data> <Data>M.M.MapiProp.GetProps</Data> <Data>M.Mapi.MapiExceptionNotFound</Data> <Data>9415</Data> <Data>08.02.0253.000</Data> <Data>True</Data> </EventData></Event>

Any help from: http://support.microsoft.com/kb/948934 Event ID: 9040 may occur every 15 minutes on a computer that is running Exchange Server 2007

Yea ive checked that already here is the output, all the mailboxes are for the same server those accounts are on, so i dont see that being the issue. I have a mx of 2003, 2007, and 2010 MB servers. All have users on them that work, this is a test lab, the 2010 and 2007 servers are working fine, but the CCR node is not. Name : Exchange2007CCR ExchangeLegacyDN : /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\ /o=First Organization/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=Exchange2007CCR\

Being its a test lab I moved all the mailboxes to another server, ran start-managefolderassistant and it completed successfully for all mailboxes on that server including the ones i moved. Deleted the old DB and SG Created new DB and SG Moved one user back and ran start-managedfolderassistant and it completed successfully now on the CCR nodes Moved the rest back and ran it one more time, everything is processing fine. Not sure why moving the mailbox back and forth fixed it, but it did clear up something that was an issue. Either way test lab simple fix, production would had been a pain.