Row restriction when pulling data from Oracle
I am using an OLE DB Provider for Oracle to get the source data for my Data flow transformation to load data into my MS SQL 2k8 database. However, if the row count is < 1500 (where rownum < 1500), i will get the data. Otherwise, my ssis package
does nothing.
Please help!
October 21st, 2011 8:43am
what do u mean when u say "my ssis package does nothing"
are the data need been transferred/picked in that case ?
plz check if the ERROR OUTPUT property in the OLEDB Source, if it is set to ignore failure.
in that case the records after 1500 would be having some error and hence ignored
Free Windows Admin Tool Kit Click here and download it now
October 21st, 2011 9:00am
Thanks for your reply. What are you trying to say?
Basically, it remains "Yellow" indefinitely... no rows are being transferred. there is no warning.
OK -- so my test cases are as follows:
SOURCE DATA: ORACLE 10G DB
DEST LOCATION: SQL SERVER 2K8
oracle_db_table_x has 3 million records...
Test case #1: select * from oracle_db_table_x where rownum < 1400
>>> This runs to completion; i.e. Visual Studio has the box as green
Test case #2: select * from oracle_db_table_x where rownum < 2000
>>> This one starts executing within Visual studio and so the box changes to Yellow and stays this way indefinitely.
Test case #3: select * from oracle_db_table_x
>>> This one starts executing within Visual studio and so the box changes to Yellow and stays this way indefinitely.
Please help!!
October 21st, 2011 1:00pm
one question .
do you have any condition in your package such that if the count is greater than 1500 then you r storing the value in some variable and "by some chance" used the same variable to configure the connection string of the connection manager ?
i tried to replicate the error in my environment but no luck....
Free Windows Admin Tool Kit Click here and download it now
October 28th, 2011 10:26am
one question .
do you have any condition in your package such that if the count is greater than 1500 then you r storing the value in some variable and "by some chance" used the same variable to configure the connection string of the connection manager ?
i tried to replicate the error in my environment but no luck....
October 28th, 2011 10:26am
No i have no such restriction...
I have have several dataflows... those that complete are the ones with less than 1500 rows. The others do not even start -- they stay yellow (indefinitely)
Free Windows Admin Tool Kit Click here and download it now
October 28th, 2011 12:03pm
No i have no such restriction...
I have have several dataflows... those that complete are the ones with less than 1500 rows. The others do not even start -- they stay yellow (indefinitely)
October 28th, 2011 12:03pm
Hi Phill_doh,
I suggest you can try to use Conditional Split Transformation:
http://www.bimonkey.com/2009/06/the-conditional-split-transformation/|
http://stackoverflow.com/questions/3801964/how-to-create-conditional-destinations-in-ssis-data-flow
Hope that helps.
Thanks,
Eileen
Free Windows Admin Tool Kit Click here and download it now
October 29th, 2011 5:34am
Hi Phill_doh,
I suggest you can try to use Conditional Split Transformation:
http://www.bimonkey.com/2009/06/the-conditional-split-transformation/|
http://stackoverflow.com/questions/3801964/how-to-create-conditional-destinations-in-ssis-data-flow
Hope that helps.
Thanks,
Eileen
October 29th, 2011 5:34am