Advertisement
Help Keep Boards Alive. Support us by going ad free today. See here: https://subscriptions.boards.ie/.
If we do not hit our goal we will be forced to close the site.

Current status: https://keepboardsalive.com/

Annual subs are best for most impact. If you are still undecided on going Ad Free - you can also donate using the Paypal Donate option. All contribution helps. Thank you.
https://www.boards.ie/group/1878-subscribers-forum

Private Group for paid up members of Boards.ie. Join the club.

Opensource Data - Waterlevel.ie

  • 13-01-2016 11:45PM
    #1
    L.Jenkins
    Moderators, Computer Games Moderators, Technology & Internet Moderators Posts: 19,242 Mod ✭✭✭✭


    If it wasn't for the flooding this year, I may not have come across Water Level. I find it interesting, as it provides as close to live data as possible, on average, every 15 minutes. Has anyone ever seen this one before? I have time on my hands, so I'm working on a little project to gather data from the site and then figure out a way to provide some form of analysis, for future events.


Comments

  • #2
    oscarBravo
    Technology & Internet Moderators Posts: 28,862 Mod ✭✭✭✭oscarBravo


    I presume you'll be using the API?


  • #3
    L.Jenkins
    Moderators, Computer Games Moderators, Technology & Internet Moderators Posts: 19,242 Mod ✭✭✭✭L.Jenkins


    I'm beating around the bush somewhat by using https://waterlevel.ie/last/02/. It provides the latest data, without having to traverse the site and downloading files.


  • #4
    oscarBravo
    Technology & Internet Moderators Posts: 28,862 Mod ✭✭✭✭oscarBravo


    Does that have information you can't get through the API?


  • #5
    L.Jenkins
    Moderators, Computer Games Moderators, Technology & Internet Moderators Posts: 19,242 Mod ✭✭✭✭L.Jenkins


    It's essentially all the same data all the way back to December 2011.


  • #6
    dreinzy
    Registered Users, Registered Users 2 Posts: 13 ✭dreinzy


    Let us know how you get on


  • Advertisement
  • #7
    h57xiucj2z946q
    Closed Accounts Posts: 2,267 ✭✭✭h57xiucj2z946q


    Itzy wrote: »
    I'm beating around the bush somewhat by using https://waterlevel.ie/last/02/. It provides the latest data, without having to traverse the site and downloading files.

    That is taking the long route to be honest. This route, you need to write a html scraper. They could change their page layout/structure at any time without notice, potentially breaking your scraper.

    The API provides json and csv data which in my opinion is more suitable to use.


  • #8
    L.Jenkins
    Moderators, Computer Games Moderators, Technology & Internet Moderators Posts: 19,242 Mod ✭✭✭✭L.Jenkins


    Downloading data in csv data would be much easier and I'll be making use of it this weekend.


  • #9
    snowstreams
    Registered Users, Registered Users 2 Posts: 1,347 ✭✭✭snowstreams


    L.Jenkins wrote: »
    It's essentially all the same data all the way back to December 2011.

    Where is the data that goes back to 2011?
    I could only find csv files that go back 5 weeks?
    Although Im only interested in temperature because I swim in some of the rivers regularly.


  • #10
    L.Jenkins
    Moderators, Computer Games Moderators, Technology & Internet Moderators Posts: 19,242 Mod ✭✭✭✭L.Jenkins


    snowstreams wrote: »
    Where is the data that goes back to 2011?
    I could only find csv files that go back 5 weeks?
    Although Im only interested in temperature because I swim in some of the rivers regularly.

    http://waterlevel.ie/last/02/ It doesn't give water temperatures though.


Advertisement