Call SSIS packages asynchronously
I want to write a control flow task which pings a FTP location for a set of files. Once it receives the files, it should unzip them (community task) and then loop over each extracted file and process them. However I want to do it in such a way that each data flow task for processing extracted files runs concurrently. this is pretty easy in a C# type of environment where I can spawn threads and then wait for all threads to complete. In SSIS how to call a data flow task in a loop but wait only in the end .... so that each data flow task executes concurrently.
February 14th, 2011 6:48am
somehow these days google gives me good results only after I have posted. So found this post http://blogs.msdn.com/b/sqlperf/archive/2007/05/11/implement-parallel-execution-in-ssis.aspx So If I set the MaxConcurrentExecutables to 12 (since I have a 2 proc hex core machine) then I each data flow will execute in parallel (till 14 files). Correct?
February 14th, 2011 7:22am
Correct, depending on your precedence constraints. Talk to me now on
February 14th, 2011 11:10am