Advertisement
Help Keep Boards Alive. Support us by going ad free today. See here: https://subscriptions.boards.ie/.
If we do not hit our goal we will be forced to close the site.

Current status: https://keepboardsalive.com/

Annual subs are best for most impact. If you are still undecided on going Ad Free - you can also donate using the Paypal Donate option. All contribution helps. Thank you.
https://www.boards.ie/group/1878-subscribers-forum

Private Group for paid up members of Boards.ie. Join the club.

Scrape eir(com) DSLStats

  • 18-09-2017 04:17PM
    #1
    Johnboy1951
    Registered Users, Registered Users 2 Posts: 13,948 ✭✭✭✭


    I use Linux, hence the reason this post is in this section.

    dslstats.eir.ie/commoncgi/dslstats/showstats.cgi?username=<phone number>&password=<account number>&sid=<some sequence of letters>

    Above is the format of a URL to view the usage statics for a DSL broadband account on an eir line.

    What I would like to do is to monitor that usage without using a browser. I expect that wget with some options or such might manage to scrape the numbers, but I have failed to get any information so far.

    Has anyone with eir broadband done this?
    If so, care to share how?

    I am clueless regarding web things so have no idea what I am doing.

    Any help appreciated.


Comments

  • #2
    [Deleted User]
    Posts: 11,642 ✭✭✭✭ [Deleted User]


    Johnboy1951 wrote: »
    I use Linux, hence the reason this post is in this section.

    dslstats.eir.ie/commoncgi/dslstats/showstats.cgi?username=<phone number>&password=<account number>&sid=<some sequence of letters>

    Above is the format of a URL to view the usage statics for a DSL broadband account on an eir line.

    What I would like to do is to monitor that usage without using a browser. I expect that wget with some options or such might manage to scrape the numbers, but I have failed to get any information so far.

    Has anyone with eir broadband done this?
    If so, care to share how?

    I am clueless regarding web things so have no idea what I am doing.

    Any help appreciated.

    I could write a scraper for you in python. It wouldnt take very long. However I dont have an eir account.

    Could you save the webpage and send it to me for testing?


  • #3
    Johnboy1951
    Registered Users, Registered Users 2 Posts: 13,948 ✭✭✭✭Johnboy1951


    Deleted User wrote: »
    I could write a scraper for you in python. It wouldnt take very long. However I dont have an eir account.

    Could you save the webpage and send it to me for testing?

    Thanks, that would be great.

    I hope this is what you mean

    https://www.dropbox.com/deleted

    Let me know if there is something else.

    Thanks.


  • #4
    Johnboy1951
    Registered Users, Registered Users 2 Posts: 13,948 ✭✭✭✭Johnboy1951


    I seem to have found the correct means of getting the info using wget.

    I had been using this form of URL
    wget dslstats.eir.ie/commoncgi/dslstats/showstats.cgi?username=<phone number>&password=<account number>

    When I changed it (after lots of trial and error) to
    wget --post-data='username=<phone number>&password=<account number>' dslstats.eir.ie/commoncgi/dslstats/showstats.cgi?

    I got the page saved.

    I can then extract the stats info from the saved page.

    Thanks for reading, and particular thanks to denartha for the really kind offer to write a python script for me.

    HappyChappy :D


Advertisement