Hi,
we designed a staging ssis solution in which 50 child packages are running through master package.
The problem is in some child packages, after loading data from oracle source table to sql server destination table in data flow task, remaining data is not inserting. i.e., suppose consider 3lakhs rows are there in source oracle table, after inserting 1lakh rows around in sql server destination table, it is showing same count in data pipeline of source to destination(means data is not inserting) and keep on executing mode and not showing any error in progress. earlier we don't have this problem. now we are facing this problem. why? we are facing this problem randomly(may occur in any package and can't predict).
note1: after hanging dataflowtask, if we stop exection manually and started masterpackage again, then data is inserting fine in respective child package for some time(here hanging package starts againg becasue of our package design). most of time, i observed initially data is inserting fine and after some time of execution, not inserting rows(this problem is in middle of execution and not at starting of execution)
note2: checked task manager, it is showing ram is not full.physical memory is 56% and cpu usage is 17% and also we configured some properties(default buffer max rows are 40000 and default buffer size is 8gb and ram is 16gb as suggested in google) and also configured rows per batch to 10,000 rows in some packages loading large volume of date and unchecked table lock also in ole db destination in all packages
what is the solution for