Increamental load in Staging
Hi All,
I have a Table A in the source system which has a column DWInsertDate which is auto populated(GetDate()). This table has the increamental data added everyday.
I have another table in Staging server same as the Table A containing all the columns except DWInsertDate is not autopopulated here and keeping the original value of the Table A DWInsertDate column (source table).
I want to do the increamental data load in Staging by checking the DWInsertDate. Please let me know how I can do this. If I use the Oledb Source and destination then how I can get the last DWInsertDate of the staging table in oledbsource which
I can use in filtering the data from the source table?Thanks, Gaurav
http://gauravsqlserver.blogspot.com
May 16th, 2011 3:37pm
You may try the sync approach as described here
Get all from Table A that isn't in Table B
http://www.sqlis.com/post/Get-all-from-Table-A-that-isnt-in-Table-B.aspxArthur My Blog
Free Windows Admin Tool Kit Click here and download it now
May 16th, 2011 3:41pm
Thanks Arthur Z...this is a good piece of informationThanks, Gaurav
http://gauravsqlserver.blogspot.com
May 16th, 2011 3:47pm
this is good article about Incremental Load using SSIS:
http://sqlblog.com/blogs/andy_leonard/archive/2007/07/09/ssis-design-pattern-incremental-loads.aspxhttp://www.rad.pasfu.com
Free Windows Admin Tool Kit Click here and download it now
May 16th, 2011 3:49pm