Hi there, I am trying to run One data flow task which has 10 look up and source and destination adapters.it loads around 20 million rows in destination but its giving below error. I had ran successfully couple of time this data flow task but its giving me error now. 'increase the threads or buffer can't create more' appreciated any help on this. Thanks, Reply Quot

Have not seen this before, but this is an apparent memory exhaustion situation, afterall you are running lookups against so many rows. Please go inspect the memory load and tell us your findings.Arthur My Blog

Hi there, how to find that memory load can you please tell me. basically on ssis on progress tab i can see all look up caching all data. but when data will start to come in pipeline it will give error below. DTS.Pipeline] Error: The pipeline received a request to cancel and is shutting down. Thanks,

The reference sets used in the lookup components, how big are they? (How many rows do the lookup tables contain?) What is the caching option that you use for those lookup components. Can you post all the exact error messages that you get?MCTS, MCITP - Please mark posts as answered where appropriate.

... how to find that memory load can you please tell me... You can for now simply Ctrl-Shift-Esc to bring the Windows Task Manager and go see the Performances Tab. What is your observation? I would consider not using the lookups, perhaps instead try doing that a stored procedure way.Arthur My Blog

You should probably consider using partial or no caching on some of those Lookups. What version of SSIS are you using? Talk to me now on

I am using Sql 2005. I used that partial look up option but still its failed.

I am looking up more then 10 million rows in each look up.

I am using Partial caching option.Its full load just for first time kind of initial load. I just ran package it will be me error after some time and i will post that.

You need to understand that you just can't stuff that many rows into memory. You may need to use uncached lookups on some of those steps. Talk to me now on

uncached means no cache option right?

uncached means no cache option right? Indeed.MCTS, MCITP - Please mark posts as answered where appropriate.