Need suggestion on SSIS usage
Hi, I work on a wcf data service that reads data from a huge xml and inserts it to correponding entities in the DB. Recently we figured out that we started receiving xmls in which we have multiple records for each DB entity in a single xml. But because the dataservice currently expects only one record, it processes the first records of the entity from xml and inserts them to DB. Now we have fixed the data service to process multiple records, but the major challenge is to correct the data which is already in prod and has single records inserted where multiple records have to be . If I run through all files which have multiple records again through the service that will create duplicate records in some tables which is not appropriate. I could think of three possible solutions. 1) Making changes to service and deploy it to Prod and drop files with multiple records. I think this does not make much sense to have a service to temporarily handle situations like this. 2) SQl scripts to make inserts to only those entities that have multiple records 3) SSIS in place of sql scripts that does the same as the second case I need experts advice on the approach Thanks, Haripriya
August 31st, 2012 7:13am

if you are working with file imports on periodic basis then SSIS would be a better way to go. Web technologies has their own limitation when it come to working with large set of data and 2 way communication. WCF can be an alternative but that is not what WCF is build for.Please mark the post as answered if it answers your question
Free Windows Admin Tool Kit Click here and download it now
August 31st, 2012 7:26am

Well sounds like whatever you do will be a temporary solution to take care of those files where only single records have been created instead of multiple records. If thats the case then I would advise going for sql scripts that will cleanup the dirty data and then re-process the older files with the new version of the web service. If you cant cleanup the dirty data, then write sql scripts that will insert the differential data. The advantage is lesser development time and no overhead of deployment since it sounds like a temprary fix.http://btsbee.wordpress.com/
August 31st, 2012 10:02am

This topic is archived. No further replies will be accepted.

Other recent topics Other recent topics