Using SSIS to save data on several url from web to csv file(s)
I'll try to explain what I'm trying to achieve. I have url in this format: http://www.something.com/query?page=1&category=1 http://www.something.com/query?page=2&category=1 http://www.something.com/query?page=3&category=1 and so on.. This pages on this URLs have data in basic text form.I want to scrap data from this url, and also the urls where I increase the page numbers (upto 100 pages), and put it into a file (txt. or csv) on my local drive. I have looked at som script task examples, but with no luck. Can I achieve this with SSIS 2008? regards .r
June 7th, 2012 3:54am

Here is how you download files within ssis: http://microsoft-ssis.blogspot.nl/2011/05/download-source-file-from-website-with.html you could use a for loop to create a variable with a counter... and within that loop you could add a script task that downloads the file..Please mark the post as answered if it answers your question | My SSIS Blog: http://microsoft-ssis.blogspot.com | Twitter
Free Windows Admin Tool Kit Click here and download it now
June 7th, 2012 5:19am

Thanks for answer - I'll try this. regards .r
June 7th, 2012 6:18am

This topic is archived. No further replies will be accepted.

Other recent topics Other recent topics