Using SSIS to save data on several url from web to csv file(s)
I'll try to explain what I'm trying to achieve. I have url in this format:
http://www.something.com/query?page=1&category=1
http://www.something.com/query?page=2&category=1
http://www.something.com/query?page=3&category=1 and so on..
This pages on this URLs have data in basic text form.I want to scrap data from this url, and also the urls where I increase the page numbers (upto 100 pages), and put it into a file (txt. or csv) on my local drive.
I have looked at som script task examples, but with no luck.
Can I achieve this with SSIS 2008?
regards .r
June 7th, 2012 3:54am
Here is how you download files within ssis:
http://microsoft-ssis.blogspot.nl/2011/05/download-source-file-from-website-with.html
you could use a for loop to create a variable with a counter... and within that loop you could add a script task that downloads the file..Please mark the post as answered if it answers your question | My SSIS Blog:
http://microsoft-ssis.blogspot.com |
Twitter
Free Windows Admin Tool Kit Click here and download it now
June 7th, 2012 5:19am
Thanks for answer - I'll try this. regards .r
June 7th, 2012 6:18am