2 of Windows 2003 R2 hardware servers with san storage having problems that I couldn't figure out. We have other servers that have same type of hardware, OS and are on san storage and they don't have this issue. If someone can help me to troubleshoot
the issue
I would greatly appriciate. Here is the problem.
When large number of files to be created/deleted/moved in any folder by any production application, few of the them are not created/deleted/moved and the error we are getting is access denied.

Here are the things I have done to troubleshoot and fix the issue without success;
1- Checked event logs and saw no errors
2- I removed latest patches that have been installed from one of the servers and rebooted it.

3- The server seemed to function properly meaning i was able to create as many files as I want without getting any error for whole freaking day. And then I get a call next morning for the same issue.

4- Used "filemon" and saw nothing out of ordinary
5- Used "handle.exe" did not see anything out of ordinary
6- Created a Test directory on the servers mentioned
7- while in the test directory, from command prompt I run "FOR /L %A IN (1,1,5000) DO @ECHO THIS IS TEST>TestFile%A.txt" command (This command creates 5000 files in test directory) .

Creation of few of the 5000 files always fails (those files show in operating system as created but they have 0 length) and reason is "Access Denied".
When I try to delete the files with 0 length I get access denied error message for a period of time and then all of a sudden it can be deleted without problem.Fikret Murat Uzundede Senior Windows Server Admin

There is an amazing pack of free network admin tools. click here to download it

Hello,
Perhaps you have disk corruption or faulty IO causing this problem. Try running a check disk and see what the results are. Also, try moving large files and large number of files with tools like RichCopy.
Cheers


Miguel Fra | Falcon IT Services, Miami, FL

www.falconitservices.com
|

www.falconits.com
|
Blog

There is an amazing pack of free network admin tools. click here to download it

Thank you for answer.
Moving files using the tool mentioned is not an option because they are handled by a production software and files are moved around as part of its process. Unftortunately I can't run check disk on a disk that is on the san.
Fikret Murat Uzundede Senior Windows Server Admin

There is an amazing pack of free network admin tools. click here to download it

Thank you for answer.
Moving files using the tool mentioned is not an option because they are handled by a production software and files are moved around as part of its process. Unftortunately I can't run check disk on a disk that is on the san.
Fikret Murat Uzundede Senior Windows Server Admin

Need to support users over the internet? click here try our remote control online beta

Hi,
According to your description, we found the issue happens randomly, not in a fixed period of time or in a fixed file directory. And sometimes you can edit file located in SAN disk, sometime you cant with access denied error.
Just as Falcon IT Services posted above, I also think this issue is more related to disk issue.
> 2 of Windows 2003 R2 hardware servers with san storage having problems that I couldn't figure out. We
> have other servers that have same type of hardware, OS and are on san storage and they don't have this
> issue.
You mentioned 2 server connect with SAN storage have this issue, are these two server connect same LUN, or different LUN?
Which brand of SAN device do you use, it should have a management tool, check whether it has error log, or run a disk check.
You may also connect that LUN to a new server, test whether you can create large number of files on it.
Please test that and give us feedback for further troubleshooting.
Hope this helps!
TechNet Subscriber Support
If you areTechNet
Subscription user and have any feedback on our support quality, please send your feedback
here.Lawrence
TechNet Community Support

Need to support users over the internet? click here try our remote control online beta

Hi,
According to your description, we found the issue happens randomly, not in a fixed period of time or in a fixed file directory. And sometimes you can edit file located in SAN disk, sometime you cant with access denied error.
Just as Falcon IT Services posted above, I also think this issue is more related to disk issue.
> 2 of Windows 2003 R2 hardware servers with san storage having problems that I couldn't figure out. We
> have other servers that have same type of hardware, OS and are on san storage and they don't have this
> issue.
You mentioned 2 server connect with SAN storage have this issue, are these two server connect same LUN, or different LUN?
Which brand of SAN device do you use, it should have a management tool, check whether it has error log, or run a disk check.
You may also connect that LUN to a new server, test whether you can create large number of files on it.
Please test that and give us feedback for further troubleshooting.
Hope this helps!
TechNet Subscriber Support
If you areTechNet
Subscription user and have any feedback on our support quality, please send your feedback
here.Lawrence
TechNet Community Support

There is an amazing pack of free network admin tools. click here to download it

Hi Lawrence,
Thank you for the reply.
The day before, I uninstalled McAfee antivirus from one of the servers (this was not my first choice of action because I didn't think it would be a problem knowing that servers were having same symptoms even after I disabled antivirus related services) and
what you know!!! problem seemed to be disappeared on the server without AV. It just doesn't make any sense though because the server did function properly couple of weeks with the same antivirus product and same policies applied. Anyway I will be
monitoring the system closely.
I'm not sure if this is still relevant but. The san is Hitachi VSP. I'll be gathering LUN infromation and have storage guys do check also just in case
I'll update the feed if I find anything else. Fikret Murat Uzundede Senior Windows Server Admin

Need to support users over the internet? click here try our remote control online beta

Hi Lawrence,
Thank you for the reply.
The day before, I uninstalled McAfee antivirus from one of the servers (this was not my first choice of action because I didn't think it would be a problem knowing that servers were having same symptoms even after I disabled antivirus related services) and
what you know!!! problem seemed to be disappeared on the server without AV. It just doesn't make any sense though because the server did function properly couple of weeks with the same antivirus product and same policies applied. Anyway I will be
monitoring the system closely.
I'm not sure if this is still relevant but. The san is Hitachi VSP. I'll be gathering LUN infromation and have storage guys do check also just in case
I'll update the feed if I find anything else. Fikret Murat Uzundede Senior Windows Server Admin

Need to support users over the internet? click here try our remote control online beta

Hi,
I would like to confirm what is the current situation? Have you resolved the problem?
If there is anything that we can do for you, please do not hesitate to let us know, and we will be happy to help.
Lawrence
TechNet Community Support

Need to support users over the internet? click here try our remote control online beta

Hi,
I would like to confirm what is the current situation? Have you resolved the problem?
If there is anything that we can do for you, please do not hesitate to let us know, and we will be happy to help.
Lawrence
TechNet Community Support

Need to support users over the internet? click here try our remote control online beta

I can now safely say the problem was caused by antivirus engine (namely Mcafee Virusscan Enterprise engine version 5400.1158) . Because since I uninstalled AV completely (disabling av related services did not work) from the system,
we did not have any problems. From this point on this is in the hands of Mcafee support.

Thank you all for replies. Fikret Murat Uzundede Senior Windows Server Admin

Need to support users over the internet? click here try our remote control online beta