How can I handle incremental changes, and full reloads?
Aamir, I am looking for a different concept I am getting daily flat files from different clients some sending me incremental and others sending whole database everyday. I need to look if there is a change in any row then insert as a new record otherwise do nothing. Appreciate your quick reply.
February 26th, 2011 3:42am
Since this is a new question, you should be posting a new thread. I've split your question away from the thread you'd posted it to. You do need to use the Lookup component - but for how you do that, look up at the FAQ post at the top of the forum. The third question on the FAQ is How do I check to see if a record exists in my destination and update it, and if it doesn't exist, insert it? Talk to me now on
February 26th, 2011 5:36am
Alternatively , you do it through below way also 1. Load the text files into the temproary table using SSIS. (Data flow task) 2. Compare the main table with the temprory one and insert the incremental records (EXecute SQL task)
February 26th, 2011 5:41am
Check this page: http://vsteamsystemcentral.com/cs21/blogs/applied_business_intelligence/archive/2007/05/21/ssis-design-pattern-incremental-loads.aspx It explains everything you need. Please mark as answer if this helps. Thank you. http://thebipalace.wordpress.com
February 26th, 2011 6:56am