HI,

I migrated server 2003 to 2008.transfered the fsmo roles to 2oo8 sever.Now the user cannot login to the domain if the 2003 server is unavailable.can anyone help me with a solution to solve this issue.

• Edited by AnsarAbu Tuesday, August 25, 2015 10:59 AM

Hi

 Please make sure fsmo roles succesfully moved to Server 2008,for check run "netdom query fsmo" and also run "dcdiag" on both DC for errors.

 Check the replication between dc's "repadmin /replsum",last check on the clients Dns settings (prefered and alternate settings has right setting).

Hello,

is the new DC also DNS server for the domain and are the clients configured to use it as preferred on theNIC ONLY?

Please post an unedited ipconfig/all from theold/new DC/DNS servers and one client with problems.

Hi,

Yes the new dc is also a dns server.

The domain is ociauh.com

Server 2003 DC was oci-dc.ociauh.com -192.168.1.8

Server 2008 DC ad1.ociauh.com -192.168.1.16

FSMO roles were transferred successfully.

Still if i ping to ociauh.com reply is from the old server 192.168.1.8

If i isolate the new server and try to add a new client it is not contacting the ociauh.com dc

If i give the server 2008 ip as the preferred DNS and 2003 server as the alternate the client can be added.

Hope the error is with the DNS replication.

Please share me your valuable points on this regard

Hi,

Yes the new dc is also a dns server.

All the FSMO roles are in the new DC.

The domain is ociauh.com

Server 2003 DC was oci-dc.ociauh.com -192.168.1.8

Server 2008 DC ad1.ociauh.com -192.168.1.16

FSMO roles were transferred successfully.

Still if i ping to ociauh.com reply is from the old server 192.168.1.8

If i isolate the new server and try to add a new client it is not contacting the ociauh.com dc

If i give the server 2008 ip as the preferred DNS and 2003 server as the alternate the client can be added.

Hope the error is with the DNS replication.

Please share me your valuable points on this regard

Hi

 Could run "dcdiag /test:dns" on both server.And also check ip configuration on DC's run "ipconfig /all"..

Hi,

Please find the below mentioned ipconfig/all and dcdiag details

Server 2003


Windows IP Configuration



   Host Name . . . . . . . . . . . . : Oci-Dc

   Primary Dns Suffix  . . . . . . . : OciAuh.com

   Node Type . . . . . . . . . . . . : Unknown

   IP Routing Enabled. . . . . . . . : No

   WINS Proxy Enabled. . . . . . . . : No

   DNS Suffix Search List. . . . . . : OciAuh.com



Ethernet adapter Local Area Connection VLAN10:



   Connection-specific DNS Suffix  . : 

   Description . . . . . . . . . . . : HP NC373i Multifunction Gigabit Server Adapter

   Physical Address. . . . . . . . . : 00-1C-C4-D8-87-B4

   DHCP Enabled. . . . . . . . . . . : No

   IP Address. . . . . . . . . . . . : 192.168.1.8

   Subnet Mask . . . . . . . . . . . : 255.255.255.0

   Default Gateway . . . . . . . . . : 192.168.1.3

   DNS Servers . . . . . . . . . . . : 192.168.1.8

                                       213.42.20.20

Server 2008

Windows IP Configuration

   Host Name . . . . . . . . . . . . : AD1
   Primary Dns Suffix  . . . . . . . : OciAuh.com
   Node Type . . . . . . . . . . . . : Hybrid
   IP Routing Enabled. . . . . . . . : No
   WINS Proxy Enabled. . . . . . . . : No
   DNS Suffix Search List. . . . . . : OciAuh.com

Ethernet adapter Local Area Connection:

   Connection-specific DNS Suffix  . :
   Description . . . . . . . . . . . : Intel(R) 82567V-2 Gigabit Network Connect
ion
   Physical Address. . . . . . . . . : 00-22-64-BD-31-92
   DHCP Enabled. . . . . . . . . . . : No
   Autoconfiguration Enabled . . . . : Yes
   Link-local IPv6 Address . . . . . : fe80::ad36:5869:318f:a801%10(Preferred)
   IPv4 Address. . . . . . . . . . . : 192.168.1.16(Preferred)
   Subnet Mask . . . . . . . . . . . : 255.255.255.0
   Default Gateway . . . . . . . . . : 192.168.1.3
   DHCPv6 IAID . . . . . . . . . . . : 218112612
   DHCPv6 Client DUID. . . . . . . . : 00-01-00-01-1D-66-82-42-00-22-64-BD-31-92

   DNS Servers . . . . . . . . . . . : ::1
                                       192.168.1.16
                                       127.0.0.1
   NetBIOS over Tcpip. . . . . . . . : Enabled

Tunnel adapter Local Area Connection* 8:

   Media State . . . . . . . . . . . : Media disconnected
   Connection-specific DNS Suffix  . :
   Description . . . . . . . . . . . : isatap.{D80F344B-B620-44C8-AD3B-0C52C9548
3B1}
   Physical Address. . . . . . . . . : 00-00-00-00-00-00-00-E0
   DHCP Enabled. . . . . . . . . . . : No
   Autoconfiguration Enabled . . . . : Yes

Hi,

DCDIAG

Domain Controller Diagnosis server 2003 192.168.1.8


Performing initial setup:
   Done gathering initial info.

Doing initial required tests

   Testing server: Default-First-Site-Name\OCI-DC
      Starting test: Connectivity
         The host c311bb41-7c03-45f7-a973-dae1a61d316b._msdcs.OciAuh.com could n
ot be resolved to an
         IP address.  Check the DNS server, DHCP, server name, etc
         Although the Guid DNS name
         (c311bb41-7c03-45f7-a973-dae1a61d316b._msdcs.OciAuh.com) couldn't be
         resolved, the server name (Oci-Dc.OciAuh.com) resolved to the IP
         address (192.168.1.8) and was pingable.  Check that the IP address is
         registered correctly with the DNS server.
         ......................... OCI-DC failed test Connectivity

Doing primary tests

   Testing server: Default-First-Site-Name\OCI-DC
      Skipping all tests, because server OCI-DC is
      not responding to directory service requests

   Running partition tests on : ForestDnsZones
      Starting test: CrossRefValidation
         ......................... ForestDnsZones passed test CrossRefValidation

      Starting test: CheckSDRefDom
         ......................... ForestDnsZones passed test CheckSDRefDom

   Running partition tests on : DomainDnsZones
      Starting test: CrossRefValidation
         ......................... DomainDnsZones passed test CrossRefValidation

      Starting test: CheckSDRefDom
         ......................... DomainDnsZones passed test CheckSDRefDom

   Running partition tests on : Schema
      Starting test: CrossRefValidation
         ......................... Schema passed test CrossRefValidation
      Starting test: CheckSDRefDom
         ......................... Schema passed test CheckSDRefDom

   Running partition tests on : Configuration
      Starting test: CrossRefValidation
         ......................... Configuration passed test CrossRefValidation
      Starting test: CheckSDRefDom
         ......................... Configuration passed test CheckSDRefDom

   Running partition tests on : OciAuh
      Starting test: CrossRefValidation
         ......................... OciAuh passed test CrossRefValidation
      Starting test: CheckSDRefDom
         ......................... OciAuh passed test CheckSDRefDom

   Running enterprise tests on : OciAuh.com
      Starting test: Intersite
         ......................... OciAuh.com passed test Intersite
      Starting test: FsmoCheck
         Warning: DcGetDcName(TIME_SERVER) call failed, error 1355
         A Time Server could not be located.
         The server holding the PDC role is down.
         Warning: DcGetDcName(GOOD_TIME_SERVER_PREFERRED) call failed, error 135
5
         A Good Time Server could not be located.
         ......................... OciAuh.com failed test FsmoCheck

SERVER 2008

Directory Server Diagnosis server 2008 192.168.1.16


Performing initial setup:
   Trying to find home server...
   Home Server = AD1
   * Identified AD Forest.
   Done gathering initial info.

Doing initial required tests

   Testing server: Default-First-Site-Name\AD1
      Starting test: Connectivity
         ......................... AD1 passed test Connectivity

Doing primary tests

   Testing server: Default-First-Site-Name\AD1
      Starting test: Advertising
         Warning: DsGetDcName returned information for \\Oci-Dc.OciAuh.com,
         when we were trying to reach AD1.
         SERVER IS NOT RESPONDING or IS NOT CONSIDERED SUITABLE.
         ......................... AD1 failed test Advertising
      Starting test: FrsEvent
         There are warning or error events within the last 24 hours after the
         SYSVOL has been shared.  Failing SYSVOL replication problems may cause
         Group Policy problems.
         ......................... AD1 passed test FrsEvent
      Starting test: DFSREvent
         There are warning or error events within the last 24 hours after the
         SYSVOL has been shared.  Failing SYSVOL replication problems may cause
         Group Policy problems.
         ......................... AD1 failed test DFSREvent
      Starting test: SysVolCheck
         ......................... AD1 passed test SysVolCheck
      Starting test: KccEvent
         ......................... AD1 passed test KccEvent
      Starting test: KnowsOfRoleHolders
         ......................... AD1 passed test KnowsOfRoleHolders
      Starting test: MachineAccount
         ......................... AD1 passed test MachineAccount
      Starting test: NCSecDesc
         Error NT AUTHORITY\ENTERPRISE DOMAIN CONTROLLERS doesn't have
            Replicating Directory Changes In Filtered Set
         access rights for the naming context:
         DC=ForestDnsZones,DC=OciAuh,DC=com
         Error NT AUTHORITY\ENTERPRISE DOMAIN CONTROLLERS doesn't have
            Replicating Directory Changes In Filtered Set
         access rights for the naming context:
         DC=DomainDnsZones,DC=OciAuh,DC=com
         ......................... AD1 failed test NCSecDesc
      Starting test: NetLogons
         Unable to connect to the NETLOGON share! (\\AD1\netlogon)
         [AD1] An net use or LsaPolicy operation failed with error 67,
         The network name cannot be found..
         ......................... AD1 failed test NetLogons
      Starting test: ObjectsReplicated
         ......................... AD1 passed test ObjectsReplicated
      Starting test: Replications
         ......................... AD1 passed test Replications
      Starting test: RidManager
         ......................... AD1 passed test RidManager
      Starting test: Services
         ......................... AD1 passed test Services
      Starting test: SystemLog
         An Error Event occurred.  EventID: 0x0000041E
            Time Generated: 08/25/2015   17:04:30
            Event String:
            The processing of Group Policy failed. Windows could not obtain the
name of a domain controller. This could be caused by a name resolution failure.
Verify your Domain Name Sysytem (DNS) is configured and working correctly.
         An Error Event occurred.  EventID: 0x0000041E
            Time Generated: 08/25/2015   17:09:30
            Event String:
            The processing of Group Policy failed. Windows could not obtain the
name of a domain controller. This could be caused by a name resolution failure.
Verify your Domain Name Sysytem (DNS) is configured and working correctly.
         An Error Event occurred.  EventID: 0x0000041E
            Time Generated: 08/25/2015   17:14:30
            Event String:
            The processing of Group Policy failed. Windows could not obtain the
name of a domain controller. This could be caused by a name resolution failure.
Verify your Domain Name Sysytem (DNS) is configured and working correctly.
         An Error Event occurred.  EventID: 0x0000041E
            Time Generated: 08/25/2015   17:16:58
            Event String:
            The processing of Group Policy failed. Windows could not obtain the
name of a domain controller. This could be caused by a name resolution failure.
Verify your Domain Name Sysytem (DNS) is configured and working correctly.
         An Error Event occurred.  EventID: 0x0000041E
            Time Generated: 08/25/2015   17:19:30
            Event String:
            The processing of Group Policy failed. Windows could not obtain the
name of a domain controller. This could be caused by a name resolution failure.
Verify your Domain Name Sysytem (DNS) is configured and working correctly.
         An Error Event occurred.  EventID: 0x0000041E
            Time Generated: 08/25/2015   17:24:30
            Event String:
            The processing of Group Policy failed. Windows could not obtain the
name of a domain controller. This could be caused by a name resolution failure.
Verify your Domain Name Sysytem (DNS) is configured and working correctly.
         An Error Event occurred.  EventID: 0x0000041E
            Time Generated: 08/25/2015   17:29:30
            Event String:
            The processing of Group Policy failed. Windows could not obtain the
name of a domain controller. This could be caused by a name resolution failure.
Verify your Domain Name Sysytem (DNS) is configured and working correctly.
         An Error Event occurred.  EventID: 0x0000041E
            Time Generated: 08/25/2015   17:34:30
            Event String:
            The processing of Group Policy failed. Windows could not obtain the
name of a domain controller. This could be caused by a name resolution failure.
Verify your Domain Name Sysytem (DNS) is configured and working correctly.
         An Warning Event occurred.  EventID: 0xA004001B
            Time Generated: 08/25/2015   17:38:02
            Event String:
            Intel(R) 82567V-2 Gigabit Network Connection Link has been disconnec
ted.
         An Warning Event occurred.  EventID: 0x80000008
            Time Generated: 08/25/2015   17:38:31
            Event String:
            The jobs in the print queue for printer Microsoft XPS Document Write
r (redirected 1) were deleted. No user action is required.
         An Warning Event occurred.  EventID: 0x80000004
            Time Generated: 08/25/2015   17:38:31
            Event String:
            Printer Microsoft XPS Document Writer (redirected 1) will be deleted
. No user action is required.
         An Warning Event occurred.  EventID: 0x80000003
            Time Generated: 08/25/2015   17:38:31
            Event String:
            Printer Microsoft XPS Document Writer (redirected 1) was deleted, an
d users will no longer be able to print to this printer. No user action is requi
red.
         An Error Event occurred.  EventID: 0xC00A0038
            Time Generated: 08/25/2015   17:38:31
            Event String:
            The Terminal Server security layer detected an error in the protocol
 stream and has disconnected the client.
         An Error Event occurred.  EventID: 0x0000041E
            Time Generated: 08/25/2015   17:39:30
            Event String:
            The processing of Group Policy failed. Windows could not obtain the
name of a domain controller. This could be caused by a name resolution failure.
Verify your Domain Name Sysytem (DNS) is configured and working correctly.
         An Error Event occurred.  EventID: 0x0000041E
            Time Generated: 08/25/2015   17:44:30
            Event String:
            The processing of Group Policy failed. Windows could not obtain the
name of a domain controller. This could be caused by a name resolution failure.
Verify your Domain Name Sysytem (DNS) is configured and working correctly.
         An Warning Event occurred.  EventID: 0x8000001D
            Time Generated: 08/25/2015   17:49:17
            Event String:
            The Key Distribution Center (KDC) cannot find a suitable certificate
 to use for smart card logons, or the KDC certificate could not be verified. Sma
rt card logon may not function correctly if this problem is not resolved. To cor
rect this problem, either verify the existing KDC certificate using certutil.exe
 or enroll for a new KDC certificate.
         An Error Event occurred.  EventID: 0x0000041E
            Time Generated: 08/25/2015   17:49:30
            Event String:
            The processing of Group Policy failed. Windows could not obtain the
name of a domain controller. This could be caused by a name resolution failure.
Verify your Domain Name Sysytem (DNS) is configured and working correctly.
         An Error Event occurred.  EventID: 0x0000041E
            Time Generated: 08/25/2015   17:54:30
            Event String:
            The processing of Group Policy failed. Windows could not obtain the
name of a domain controller. This could be caused by a name resolution failure.
Verify your Domain Name Sysytem (DNS) is configured and working correctly.
         An Error Event occurred.  EventID: 0x00000457
            Time Generated: 08/25/2015   17:59:29
            Event String:
            Driver Xerox WorkCentre Pro 133 PCL 6 required for printer Black Cop
y Room Main Office is unknown. Contact the administrator to install the driver b
efore you log in again.
         An Error Event occurred.  EventID: 0x00000457
            Time Generated: 08/25/2015   17:59:29
            Event String:
            Driver HP Color LaserJet 2600n required for printer HP Color LaserJe
t 2600n is unknown. Contact the administrator to install the driver before you l
og in again.
         An Error Event occurred.  EventID: 0x00000457
            Time Generated: 08/25/2015   17:59:30
            Event String:
            Driver HP LaserJet P1005 required for printer HP LaserJet P1005 is u
nknown. Contact the administrator to install the driver before you log in again.

         An Error Event occurred.  EventID: 0x00000457
            Time Generated: 08/25/2015   17:59:30
            Event String:
            Driver Adobe PDF Converter required for printer Adobe PDF is unknown
. Contact the administrator to install the driver before you log in again.
         An Error Event occurred.  EventID: 0x00000457
            Time Generated: 08/25/2015   17:59:31
            Event String:
            Driver Evolis Pebble required for printer Evolis Pebble is unknown.
Contact the administrator to install the driver before you log in again.
         An Error Event occurred.  EventID: 0x00000457
            Time Generated: 08/25/2015   17:59:33
            Event String:
            Driver Send To Microsoft OneNote 2010 Driver required for printer Se
nd To OneNote 2010 is unknown. Contact the administrator to install the driver b
efore you log in again.
         An Error Event occurred.  EventID: 0x00000457
            Time Generated: 08/25/2015   17:59:33
            Event String:
            Driver Xerox Global Print Driver PCL required for printer MPEF is un
known. Contact the administrator to install the driver before you log in again.
         ......................... AD1 failed test SystemLog
      Starting test: VerifyReferences
         ......................... AD1 passed test VerifyReferences


   Running partition tests on : ForestDnsZones
      Starting test: CheckSDRefDom
         ......................... ForestDnsZones passed test CheckSDRefDom
      Starting test: CrossRefValidation
         ......................... ForestDnsZones passed test
         CrossRefValidation

   Running partition tests on : DomainDnsZones
      Starting test: CheckSDRefDom
         ......................... DomainDnsZones passed test CheckSDRefDom
      Starting test: CrossRefValidation
         ......................... DomainDnsZones passed test
         CrossRefValidation

   Running partition tests on : Schema
      Starting test: CheckSDRefDom
         ......................... Schema passed test CheckSDRefDom
      Starting test: CrossRefValidation
         ......................... Schema passed test CrossRefValidation

   Running partition tests on : Configuration
      Starting test: CheckSDRefDom
         ......................... Configuration passed test CheckSDRefDom
      Starting test: CrossRefValidation
         ......................... Configuration passed test CrossRefValidation

   Running partition tests on : OciAuh
      Starting test: CheckSDRefDom
         ......................... OciAuh passed test CheckSDRefDom
      Starting test: CrossRefValidation
         ......................... OciAuh passed test CrossRefValidation

   Running enterprise tests on : OciAuh.com
      Starting test: LocatorCheck
         Warning: DcGetDcName(TIME_SERVER) call failed, error 1355
         A Time Server could not be located.
         The server holding the PDC role is down.
         Warning: DcGetDcName(GOOD_TIME_SERVER_PREFERRED) call failed, error
         1355
         A Good Time Server could not be located.
         ......................... OciAuh.com failed test LocatorCheck
      Starting test: Intersite
         ......................... OciAuh.com passed test Intersite

Hi,

DCDIAG DNS details

                                                                                                                  

Domain Controller Diagnosis 2003 server 192.168.1.8

Performing initial setup:
   Done gathering initial info.

Doing initial required tests

   Testing server: Default-First-Site-Name\OCI-DC
      Starting test: Connectivity
         ......................... OCI-DC passed test Connectivity

Doing primary tests

   Testing server: Default-First-Site-Name\OCI-DC

DNS Tests are running and not hung. Please wait a few minutes...

   Running partition tests on : ForestDnsZones

   Running partition tests on : DomainDnsZones

   Running partition tests on : Schema

   Running partition tests on : Configuration

   Running partition tests on : OciAuh

   Running enterprise tests on : OciAuh.com
      Starting test: DNS
         Test results for domain controllers:

            DC: Oci-Dc.OciAuh.com
            Domain: OciAuh.com


               TEST: Basic (Basc)
                  Warning: adapter [00000001] HP NC373i Multifunction Gigabit Server Adapter has invalid DNS server: 213.42.20.20 (<name unavailable>)

               TEST: Dynamic update (Dyn)
                  Warning: Dynamic update is enabled on the zone but not secure OciAuh.com.

         Summary of test results for DNS servers used by the above domain controllers:

            DNS server: 213.42.20.20 (<name unavailable>)
               1 test failure on this DNS server
               Name resolution is not functional. _ldap._tcp.OciAuh.com. failed on the DNS server 213.42.20.20

         Summary of DNS test results:

                                            Auth Basc Forw Del  Dyn  RReg Ext  
               ________________________________________________________________
            Domain: OciAuh.com
               Oci-Dc                       PASS WARN PASS PASS WARN PASS n/a  

         ......................... OciAuh.com passed test DNS

Server 2008

Directory Server Diagnosis 2008 server 192.168.1.16

Performing initial setup:
   Trying to find home server...
   Home Server = AD1
   * Identified AD Forest.
   Done gathering initial info.

Doing initial required tests

   Testing server: Default-First-Site-Name\AD1
      Starting test: Connectivity
         ......................... AD1 passed test Connectivity

Doing primary tests

   Testing server: Default-First-Site-Name\AD1

      Starting test: DNS

         DNS Tests are running and not hung. Please wait a few minutes...
         ......................... AD1 passed test DNS

   Running partition tests on : ForestDnsZones

   Running partition tests on : DomainDnsZones

   Running partition tests on : Schema

   Running partition tests on : Configuration

   Running partition tests on : OciAuh

   Running enterprise tests on : OciAuh.com
      Starting test: DNS
         Test results for domain controllers:

            DC: AD1.OciAuh.com
            Domain: OciAuh.com


               TEST: Basic (Basc)
                  Warning: The AAAA record for this DC was not found

               TEST: Dynamic update (Dyn)
                  Warning: Failed to delete the test record _dcdiag_test_record
in zone OciAuh.com

               TEST: Records registration (RReg)
                  Network Adapter
                  [00000006] Intel(R) 82567V-2 Gigabit Network Connection:
                     Warning:
                     Missing AAAA record at DNS server 192.168.1.16:
                     AD1.OciAuh.com

                     Warning:
                     Missing AAAA record at DNS server 192.168.1.16:
                     gc._msdcs.OciAuh.com

                     Warning:
                     Missing AAAA record at DNS server 192.168.1.16:
                     AD1.OciAuh.com

                     Warning:
                     Missing AAAA record at DNS server 192.168.1.16:
                     gc._msdcs.OciAuh.com

                     Warning:
                     Missing AAAA record at DNS server ::1:
                     AD1.OciAuh.com

                     Warning:
                     Missing AAAA record at DNS server ::1:
                     gc._msdcs.OciAuh.com

               Warning: Record Registrations not found in some network adapters

               AD1                          PASS WARN PASS PASS WARN WARN n/a
         ......................... OciAuh.com passed test DNS

Hi,

If i check for the shard folders on server 2008 the netlogon and sysvol folders are not displayed.

Is that an issue.

Please guide me.

Hi

 First on the server 2008 ip settings dns settings points to Ipv6 (DNS Servers . . . . . . . . . . . : ::1),you could set it to Ipv4,you can modify the protocol bindings

Check this how to

https://technet.microsoft.com/en-us/library/cc732472%28v=ws.10%29.aspx?f=255&MSPPError=-2147217396

after that run "ipconfig /flushdns" then "ipconfig /registerdns" finally check on Dns correct Ipv4 settings formed.

Also run "repadmin /syncall /force" for manual replication.Finaly check sysvol and netlogon folder is displayed,if still does not display check this ms article and follow the steps

https://support.microsoft.com/en-us/kb/257338

Hello,

first step is to remove the public DNS server ip address 213.42.20.20 from all domain machines, especially the old OS DC. Public ip addresses on DCs are BAD DESIGN.

For internet access configure the FORWARDERS in the DNS management console of the DNS Servers.

On the Windows Server 2008 DC uncheck DNS Server on the NIC settings and use ONLY the existing DNS Server 192.168.1.8 NONE else.

Now reboot the new promoted DC. Now give it one day and then check again if you are able:

- ping from DC to DC with ip address, computername and FQDN

- ping from a client to oldDC and newDC with ip address, computername and FQDN

If that is fine assure that on both DCs exist the NETLOGON and SYSVOL shares having equal content. IF NOT please provide the following output files via ONEDRIVE.

ipconfig /all >c:\ipconfig.log [all DCs]
dcdiag /v /c /d /e /s:dcname >c:\dcdiag.log
repadmin /showrepl dc* /verbose /all /intersite >c:\repl.log  ["dc* is a place holder for the starting name of the DCs if they all begin the same (if more then one DC exists)]
dnslint /ad /s "DCipaddress" (http://support.microsoft.com/kb/321045)
ADREPLSTATUS: http://www.microsoft.com/en-us/download/details.aspx?id=30005 can also be exported to file.

As the output will become large, DON'T post them into the thread, please use Windows OneDrive(with open access!) https://onedrive.live.com and add the link from it here. Also the /e in dcdiag scans the complete forest, so better run it on COB.