Call SSIS packages asynchronously
I want to write a control flow task which pings a FTP location for a set of files. Once it receives the files, it should unzip them (community task) and then loop over each extracted file and process them.
However I want to do it in such a way that each data flow task for processing extracted files runs concurrently.
this is pretty easy in a C# type of environment where I can spawn threads and then wait for all threads to complete.
In SSIS how to call a data flow task in a loop but wait only in the end .... so that each data flow task executes concurrently.
February 14th, 2011 6:48am
somehow these days google gives me good results only after I have posted.
So found this post
http://blogs.msdn.com/b/sqlperf/archive/2007/05/11/implement-parallel-execution-in-ssis.aspx
So If I set the MaxConcurrentExecutables to 12 (since I have a 2 proc hex core machine) then I each data flow will execute in parallel (till 14 files).
Correct?
Free Windows Admin Tool Kit Click here and download it now
February 14th, 2011 7:22am
Correct, depending on your precedence constraints.
Talk to me now on
February 14th, 2011 11:10am