Incremental loading a fact table
Hi All,
I'm new to SSIS, I'm trying to load a fact table of around 50 million records using SSIS 2008. I could able to dump for the first time but can anyone please help me with a example/steps for incremental load. The source table
has timestamp column and on that basis i want do incremental load.
I did some research but i could not find the step by step process/with example.
thanks in advance,
July 2nd, 2011 1:17pm
Best approach is to record the date and time of the Package Executeion some place. I suggest you use an additional table in your warehouse or Configuration database for just this purpose. AND record the fact that it succeeded OK.
Then every time you kick off the package, you first query that special table for the LAST time the pacakge was run successfully to completeion, grab that date, and stick it in a Package Level Variable. Then pass that variable down to the query that pull
the fact rows:
SELECT * FROM dbo.FactTable
WHERE DateTimeColumn > ?
and MAP the parameter to the DatTime Variable.Todd C - MSCTS SQL Server 2005 - Please mark posts as answered where appropriate.
Free Windows Admin Tool Kit Click here and download it now
July 2nd, 2011 1:38pm
Or if you have SQL Server 2008 Enterprise edition or a later version, you can use CDC (change data capture) to find out all the changes to your source tables and propagate them to your fact table.MCTS, MCITP - Please mark posts as answered where appropriate.
July 2nd, 2011 2:47pm


