MaxConcurrentExecutables Parameter : Parallel Procesing of Packages
Hi, i got number of extraction feeds (from source to staging), performing simple data extraction into staging database. I would like to run these packages parallel in master package( at least 3 packages at a time). to execute these child packages, need to use number of execute SQL tasks in sequence container of master package. Instead of using number of execute package tasks, can i use for each loop containers( at least 3, to run 3 child packages at a time) in sequence container. Maxconcurrentexecutables Parameter runs different tasks parallel, but not containers.Could you please suggest me the best possible way to implement parallel execution of SSIS packages Jai
May 12th, 2011 10:05am

How large is the number of iterations and do you have access to 64 bit multiprocessor machine?Arthur My Blog
Free Windows Admin Tool Kit Click here and download it now
May 12th, 2011 10:13am

yes... i have 64 bit processor, Sql server 2008 R2 Iterations : it should execute package through Execute package task
May 12th, 2011 10:17am

How do you know how many times you need to cycle? I suspect you are not geared toward an optimal design for parallel processing. Can you read this post please: Concurrently running packages http://consultingblogs.emc.com/jamiethomson/archive/2006/04/03/SSIS_3A00_-Concurrently-running-packages.aspx Arthur My Blog
Free Windows Admin Tool Kit Click here and download it now
May 12th, 2011 10:28am

Each for each loop container gets the data from configuration table. this data determines, how many times for each loop container should cycle.
May 12th, 2011 10:35am

What is the point in cycling (sorry still do not get why not to process all the data)?Arthur My Blog
Free Windows Admin Tool Kit Click here and download it now
May 12th, 2011 10:35am

Arthur, i am just extracting data from source to staging area, build number of packages. you know that tables in staging DB are non related, so i want to extract the data from source in parallel, in that case i need to run all child packages at a time in master package. But we can't run these many child packages at a time, because number of processes might impact system performance. i would like to run few packages in parallel, lets say 3. so i want to use 3 for each loop containers, calling 3 child packages at a time by using execute package task. we can run number of tasks in parallel in SSIS, but i am not sure whether we can run number of containers(for each loop) parallel. my question here is : is it possible to run multiple containers parallel
May 12th, 2011 10:48am

You can if you simply do not connect them - they will run in parallel. But it will not be a true parallel run. Some will finish sooner and some others later. If you have no referential integrity in staging then why bother running such a package in parallel? I think you need one package with multiple DFTs (Data Flow Tasks) not linked together, this is it.Arthur My Blog
Free Windows Admin Tool Kit Click here and download it now
May 12th, 2011 10:57am

Hello, Can anyon tell me please, is it possible to run multiple containers parallel
May 13th, 2011 3:06am

I doubt parallel execution can be configured at the container level. Related article: Implement Parallel Execution in SSIS Kalman Toth, SQL Server & BI Training; SQL 2008 GRAND SLAM
Free Windows Admin Tool Kit Click here and download it now
May 13th, 2011 10:09am

This topic is archived. No further replies will be accepted.

Other recent topics Other recent topics