Advertisement
If you have a new account but are having problems posting or verifying your account, please email us on hello@boards.ie for help. Thanks :)
Hello all! Please ensure that you are posting a new thread or question in the appropriate forum. The Feedback forum is overwhelmed with questions that are having to be moved elsewhere. If you need help to verify your account contact hello@boards.ie
Hi there,
There is an issue with role permissions that is being worked on at the moment.
If you are having trouble with access or permissions on regional forums please post here to get access: https://www.boards.ie/discussion/2058365403/you-do-not-have-permission-for-that#latest

Data Extraction or Data Scraping from Web

  • 16-05-2012 1:03pm
    #1
    DealDay
    Registered Users, Registered Users 2 Posts: 6 ✭


    I'm trying to extract data from a website. I have a table of data (customer sales) online that updates daily. I can import this into excel no problems but the issue I'm having is that one of the columns is actually a column of links. When I click each link it shows the product details, I need to extract this information into my excel sheet rather than clicking into each link and typing in the product manually as there are 3,000 sales.
    Do I need to highlight the column of links using a data extraction program, identify the URL and then use this to access the text(data) that I need? What software could I use, preferably free or is there anyway to do this through excel web queries?
    Tagged:


Comments

  • #2
    Khannie
    Registered Users, Registered Users 2 Posts: 37,485 ✭✭✭✭Khannie


    Not sure about excel web queries. There are tools that can do this in an automated way for you (wget springs to mind). My brain hurts when trying to figure out how I'd achieve this on windows because I am de-windows-ified, but it would be trivial enough on Linux (or any Unix variant).


Advertisement