SSIS Memory Utilization
Hi,
Please look for buffer size details below :
Estimated Row Size
Not configurable
DefaultMaxBufferRows
configurable setting of the SSIS Data Flow task
automatically set at 10,000 records
DefaultMaxBufferSize
configurable setting of the SSIS Data Flow task
automatically set to 10 MB by default
constrained by
MaxBufferSize which is set to 100 MB & can not be changed.
MinBufferSize
not configurable
defined by the granularity of operating systems virtual memory allocation
Typically, this is set to 65,536 bytes, but it differs from machine to machine.
Scenario 1 When
Estimated Row Size * DefaultMaxBufferRows exceeds MaxBufferSize, SSIS reduces the number of rows that will be stored in a given buffer to manage the memory footprint.
Scenario 2 - When
Estimated Row Size * DefaultMaxBufferRows is less than MinBufferSize, SSIS increases the number of rows that will be stored in a given buffer to maximize memory utilization.
Scenario 3 If the
Estimated Row Size * DefaultMaxBufferRows is somewhere in between MinBufferSize and DefaultMaxBufferSize, then SSIS attempts to size the buffer as closely possible to result of Estimated
Row Size * DefaultMaxBufferRows using a multiple of the
MinBufferSize to increase memory utilization.
Also follow the below links for
best practices :
http://www.sql-server-performance.com/2009/ssis-an-inside-view-part-1/
http://www.mssqltips.com/sqlservertip/1867/sql-server-integration-services-ssis-performance-best-practices/
http://consultingblogs.emc.com/jamiethomson/archive/2005/10/21/2289.aspx
http://consultingblogs.emc.com/jamiethomson/archive/2005/10/02/2227.aspx
*Regards*
*Samay Shrivastava*
*Please mark it as Answered if it answered your question or mark it as Helpful if it helped you solve your problem.*
October 7th, 2012 7:06am
I got few notes on BufferTempStoragePath and BLOBTempStoragePath which can save memory reserved only for use of respective DFT. Any suggestions on same property?
Free Windows Admin Tool Kit Click here and download it now
October 8th, 2012 3:40am
Hi,
Is there any way to reserve a part of memory for particular package so that it will completely utilise that memory block.
1.Is it possible? If so how?
2.Is this best approach.
Thanks in advance,
paddy
October 8th, 2012 4:48am
I do not think that is possible. If you do a massive workload, please use OLEDB Destination control that has Fast Load option.Best Regards,Uri Dimant SQL Server MVP,
http://sqlblog.com/blogs/uri_dimant/
MS SQL optimization: MS SQL Development and Optimization
MS SQL Blog:
Large scale of database and data cleansing
MS SQL Consultants:
Improves MS SQL Database Performance
Free Windows Admin Tool Kit Click here and download it now
October 8th, 2012 5:04am