Hi , I have a package configured this way , a for each loop container [which has a DFT in it] iterates through falt files , DFT loads data into sql table .. how is it to validate for any duplicates existing in flat fales so not not load them in sql . i have a unique key [id in all files ] to look into though . Thanks in advance for the pointers .Rajkumar Yelugu

Probably you need to have Lookup component http://consultingblogs.emc.com/jamiethomson/archive/2006/09/12/SSIS_3A00_-Checking-if-a-row-exists-and-if-it-does_2C00_-has-it-changed.aspxBest Regards, Uri Dimant SQL Server MVP http://dimantdatabasesolutions.blogspot.com/ http://sqlblog.com/blogs/uri_dimant/

If you are just interested in taking ne of the 2 or more duplicate records you can sort the data and slect remove duplicates in the Sort transform.My Blog | Ask Me