Incremental loading data in SSIS (Network Steve Forum)

Incremental loading data in SSIS

Hi I am looking to load data incrementally from staging to spectrum database.
Master = Staging table
Detail = Spectrum table
On below logic

If record from Detail (Spectrum table) is null
then do insert the record into Spectrum table
set status_flag to 'A' for active
else do update the record (replace all old values with new values)
set status_flag to 'A' for active
end-if
If record from Master (Staging table) is null
then do soft delete
set status_flag to 'D' for delete
end-if

Could any one help me how the ssis package help me to achieve the above scenario.

August 30th, 2015 4:09am

Hi Vipin,

There are many approaches to load incremental data. Please check following blogs:

http://sqlblog.com/blogs/andy_leonard/archive/2007/07/09/ssis-design-pattern-incremental-loads.aspx

http://sql-bi-dev.blogspot.com/2010/11/incremental-load-using-ssis-package.html

http://msdn.microsoft.com/en-us/library/bb895315.aspx

Hope this helpfully,

Free Windows Admin Tool Kit Click here and download it now

August 30th, 2015 4:25am

Hi Vipin,

Check the similar threads where mulitple options have been listed

https://social.msdn.microsoft.com/Forums/sqlserver/en-US/e32a1def-5c64-4536-b534-47e97cb182d3/best-way-for-incremental-data-load-in-ssis?forum=sqlintegrationservices

https://social.msdn.microsoft.com/Forums/sqlserver/en-US/1bda92f5-5476-4b35-82f1-63d19de8082e/incremental-loading-of-data-in-ssis?forum=sqldatawarehousing

https://social.msdn.microsoft.com/Forums/sqlserver/en-US/98fc7a4e-60b4-4117-a03a-3cb3f9cd7e1a/incremental-data-load-in-ssis?forum=sqlanalysisservices

August 30th, 2015 12:51pm

This topic is archived. No further replies will be accepted.