The buffer manager failed a memory allocation call for 65472 bytes
Plese help Me I created pakage in that i going to populate fact in that 20 sort transformations are there but tryinhg to execute 2 laks records the plage will execute successfully but if tryj to execute with 8 milions of records its giving this
below error plese give me neat explanation how it will solve the problem it will help for me a lot
Information: The buffer manager failed a memory allocation call for 65472 bytes, but was unable to swap out any buffers to relieve memory pressure. 1 buffers were considered and 0 were locked. Either not enough memory is available to the pipeline because
thaanks
August 11th, 2011 1:01am
Trying to sort 8 million records using 20 sort transformations is insane. Why on earth are you trying to do this?
The error you receive is due to the fact that the machine has run out of physical memory (i.e. RAM) and is unable to swap out to harddisk. I suggest that you look into removing the SORT transformations. I also suggest you have a read of the following
to get a better understanding of how SORT transformations can affect performance and memory consumption
http://msdn.microsoft.com/en-us/library/ms141031.aspx
Jeff Wharton
MSysDev (C.Sturt), MDbDsgnMgt (C.Sturt), MCT, MCPD, MCITP, MCDBA
Blog: Mr. Wharty's Ramblings
MC ID:
Microsoft Transcript
Please mark answered if I've answered your question and vote for it as helpful to help other user's find a solution quicker
Free Windows Admin Tool Kit Click here and download it now
August 11th, 2011 1:21am
iam new to this ssis i know only to join 2 database tables with sort trasnsformation and then
merge join with that i am getting joining id getting key for example
db1.table1
db2.table2
select key,key...... from
db1.table1
inner join db2.table2
on db1.table1.ID=db2.table2.id
inner join
.....
....
....
how can we do this ?
with sort condition only na ?
if any transformation is there ?
pleae help in this task
prashanth
August 11th, 2011 2:32am
first : what is your sources?
All of them are tables on same database?
or they are completely different sources ( for example one of them flat file, another one excel, another one database table, etc )
if all exists on same database it will be much better to join them with t-sql like the script you wrote;
select table1.* , table2.*,table3
from table1
inner join table2
on table1.matchcol=table2.matchcol
inner join tabl3
on table2.matchcol2=table3.machcol2
and then use an ole db source and write this script there, and then use any destination you like and map columns.
but if all sources exists on different database, you can use merge join transform, or you can import them all into database tables and then join them again with t-sql queries.
http://www.rad.pasfu.com
My Submitted sessions at sqlbits.com
Free Windows Admin Tool Kit Click here and download it now
August 11th, 2011 2:43am
my source is sql only
databases are in the same server and database names are (casd2,dwhs_in)if i write a querry for that its ok or not
dateabase name casd2(sql_server)
and target db will dwhs_in(sql_server)
in the target db i have dimentions
-i have tables in casd2
example
table
in that table
id is joining to targeted db
alredy created dimentions are there so i have join with one of related dimention (join with id) i am retriving our bussinesskey from the selected dimetion table
that all keys sending to one fact table for that iam doing sort and merge join is it worg are else any prossess is there to do the same ???????????????
plese urzent
how it possible can i write querry is that ok
select businesskey from
sourceid =dimetionid
or else any method is there ?
prashanth
August 11th, 2011 7:38am
thanks given reply
source is sql server
can i write querry for that using db.shemaname.tablename
is that ok ??????prashanth
Free Windows Admin Tool Kit Click here and download it now
August 11th, 2011 7:43am
yes, you can query with this structure:
<database>.<schema>.<table>
so your queries can be like this :
select db1.dbo.table1.* ,db2.dbo.table2.*
from db1.dbo.table1
inner join db2.dbo.table2
on db1.dbo.table1.field1=db2.dbo.table2.field2
http://www.rad.pasfu.com
My Submitted sessions at sqlbits.com
August 11th, 2011 7:54am
ok yes like that olly can i send my querry ?????????is that is best process are elese
using sort transformation is best process ?????????
prashanth
Free Windows Admin Tool Kit Click here and download it now
August 11th, 2011 7:56am
--this is my querry
select
apt.APT_KEY,apt_co.APT_CODE_KEY,dpt1.DPT_KEY,mgr1.MGR_KEY,pat.PAT_KEY,
usr
.USR_KEY SCH_PROV_KEY,reson.RESCH_CANCEL_KEY,RSCH_DATE,
APT_DATE
,spl.SPL_KEY,aptst.APT_STATUS_KEY
from JOLIET.FOAPT001MT
FOAPTMT
left
JOIN JOLIET.ADDPT001MT
DPT
ON
FOAPTMT.DPT_ID=DPT.DPT_ID
LEFT
JOIN JOLIET.ADMGR001MT
MGR
ON
DPT.MGR_ID=MGR.MGR_ID
LEFT
join DWHS_IND.JOLIET.DMAPT001MT
apt
on
FOAPTMT.APT_ID=apt.APT_ID
LEFT
join DWHS_IND.JOLIET.DMAPT003LT
apt_co
on
FOAPTMT.APT_CODE_ID=apt_co.APT_CODE_ID
LEFT
join DWHS_IND.JOLIET.DMDPT001MT
dpt1
on
FOAPTMT.DPT_ID=dpt1.DPT_ID
LEFT
join DWHS_IND.JOLIET.DMMGR001MT
mgr1
on
MGR.MGR_ID=mgr1.MGR_ID
LEFT
join DWHS_IND.JOLIET.DMPAT001MT
pat
on
FOAPTMT.PAT_ID=pat.PAT_ID
LEFT
join DWHS_IND.JOLIET.DMUSR001MT
usr
on
FOAPTMT.SCH_PROV_ID=usr.
USER_ID
LEFT
join DWHS_IND.JOLIET.DMAPT005LT
reson
on
FOAPTMT.RSCH_REASON_ID=reson.RESCH_CANCEL_ID
left
join DWHS_IND.JOLIET.DMSPECIALITY
spl
on
FOAPTMT.SPL_ID=spl.SPL_ID
inner
join DWHS_IND.JOLIET.DMAPTSTATUS
aptst
on
FOAPTMT.APT_ACTIVITY_STATE=aptst.APT_STATUSprashanth
August 11th, 2011 7:59am