Boards.ie

DealDay · 16-05-2012, 14:03

I'm trying to extract data from a website. I have a table of data (customer sales) online that updates daily. I can import this into excel no problems but the issue I'm having is that one of the columns is actually a column of links. When I click each link it shows the product details, I need to extract this information into my excel sheet rather than clicking into each link and typing in the product manually as there are 3,000 sales.
Do I need to highlight the column of links using a data extraction program, identify the URL and then use this to access the text(data) that I need? What software could I use, preferably free or is there anyway to do this through excel web queries?

Khannie · 16-05-2012, 17:10

Not sure about excel web queries. There are tools that can do this in an automated way for you (wget springs to mind). My brain hurts when trying to figure out how I'd achieve this on windows because I am de-windows-ified, but it would be trivial enough on Linux (or any Unix variant).

16-05-2012, 14:03	#1
DealDay Registered User Join Date: May 2012 Posts: 6 Adverts \| Friends	Data Extraction or Data Scraping from Web I'm trying to extract data from a website. I have a table of data (customer sales) online that updates daily. I can import this into excel no problems but the issue I'm having is that one of the columns is actually a column of links. When I click each link it shows the product details, I need to extract this information into my excel sheet rather than clicking into each link and typing in the product manually as there are 3,000 sales. Do I need to highlight the column of links using a data extraction program, identify the URL and then use this to access the text(data) that I need? What software could I use, preferably free or is there anyway to do this through excel web queries?

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search

16-05-2012, 17:10	#2
Khannie PDeux Join Date: May 2004 Posts: 7,684 Adverts \| Friends HMod: TTC	Not sure about excel web queries. There are tools that can do this in an automated way for you (wget springs to mind). My brain hurts when trying to figure out how I'd achieve this on windows because I am de-windows-ified, but it would be trivial enough on Linux (or any Unix variant).